The Museum is housed in the former Carnegie Library Building , built in 1904/05. The building served as the public library for the City of San Luis Obispo until 1955, when a new library was built at the corner of Palm and Morro Streets.