- Royal Redoubt (1712–1808)
- Quebec City Common Gaol (1813–1868)
- Morrin College (1862-c1902)
- Literary and Historical Society of Quebec (1868–present)
In 2004, the Literary and Historical Society of Quebec became owners of the historic site through an emphyteutic lease. In the last decade, the Society has broadened its mandate. The building was entirely renovated, and transformed into the Morrin Centre, which not only houses the library but also acts as Quebec City’s English-language cultural centre and a historical interpretation site.