Since the beginning of the 18th century, Neckarsteinach had a synagogue or a prayer room in a building. In this was also a ritual bath. 1801 to 1803, the community decided to establish a new synagogue. For this purpose, a house was bought on the road to Hirschhorn (Hirschstraße) and a prayer room with a bathroom and a teacher's apartment was established in it. In 1886, however, the old synagogue had to be torn down due to dilapidation.

Initially there was a prayer room (synagogue) in a private Jewish house. In 1846, during a visit to Ober-Gleen, the Grand Ducal Land Rabbi Levy recommended the extension of the synagogue. Whether this was done at that time is not known. There were insufficient funds for a new building at that time. After all, a fund for a new synagogue building was created in October 1846.