Libraries are a reflection of the city's growth through the books that collect dust at the back of shelves :) The first thing I would look for would be something about the city the library is in. Maybe some old maps, memoirs and the like.
One of my favourite public libraries in Bombay, the David Sasoon Reading Room is frozen in time and a great place to discover first edition books about Bombay.
