Originally known as Nepean Cottage Hospital when it was built in 1895, it served as the area's hospital until a new hospital complex was built in 1956. It then became the Governor Phillip Special Hospital. The original building was partly enclosed by additions but still retained its central entry tower and weather vane. It was acquired by RSL Lifecare who has remodelled the site and opened a nursing home called Governor Phillip Manor.