Just before you arrive at Kitaguchi Hongu Fuji Sengen Shrine there is a traditional inn which was once patronized by followers of Fujiko (the faith that venerated Mount Fuji). The Mount Fuji area was quite popular with religious tourists for centuries, especially during the Edo period (1603-1868).
The Togawa Oshi House is less than a 10-minute walk from the Kitaguchi Hongu Fuji Sengen Shrine. The entrance fee is ¥100 for adults and ¥50 for children. It is closed on Tuesdays, the day after a national holiday, and from December 28–January 3rd. An English audio guide is available.
Take an express train from JR Shinjuku Station to JR Otsuki Station on the JR Chuo Line (about an hour). Change to the privately-run Fuji Kyuko Line for Mt. Fuji Station, Fujisan Station (JR Rail Pass not accepted). The regular train takes about 50 minutes to reach Mt. Fuji Station (Fujisan Station). Mt. Fuji Station (Fujisan Station), is the station closest to the Kitaguchi Hongu Fuji Sengen Shrine and the Yoshida Trail. During the climbing season, July through August, there is a bus from Mt. Fuji Station (Fujisan Station) to the shrine and Umagaeshi (the entrance to the Yoshida Trail).