John, from what I know of the history of the TT, which is not much, it think that in 1904 the Manx Government allowed the roads to be closed for the Gordon Bennett car races. Maybe this is where the date in the book comes from. I don't think there were any bike events though 'till 1907.
Some TT buff will know for sure.