Union Inn was the first inn travellers encountered when they crossed the river by ferry. In 1873 the Union Inn became the private home of Thomas Ellison and it remained in the family until 1930 when the property was sold to Stanley Martin. In 1944 it was sold to Henry and Yvonne Gray who turned it into a boarding house known as Nepean Lodge. It would eventually be destroyed by fire.