Most people visit Bathurst en route to someplace else, although you may want to make the trip out from Sydney for the big race. Bathurst is at the end of the CityRail network and is also served by NSW TrainLink trains with regular services from Sydney to Dubbo and Broken Hill.
Buses and coaches also stop at the train station.