Here is an 1876 map showing the Clifton Hotel (red outline) in relation to modern day. The neighboring Ballard Hotel (just to the south of the red outline on the same block) was built in 1855, closed along with the Exchange Hotel in 1896 (after suffering from new competitor The Jefferson Hotel) and demolished around the turn of the century just prior to Clifton. When George Tolman visited the Clifton site to take the survey published in American Architect and Building News, his perspectives indicate no neighboring structures.
renaissancerva.co 