There are lots of art galleries in La Jolla and for music lovers, a stop at the Athenaeum Music and Arts Library may be a special treat.
This is a non-profit member's library that is open to the public and offers a wide range of activities that are worth checking out. Their year-round schedule of art exhibitions, concerts, including classical, jazz, and really new music, and interesting lectures. Some of which are free.
In fact, I happened upon a free and unscheduled concert the last time I passed by the Library. A talented young man had set himself up on the steps of the entrance--it was a Sunday and the Library was closed--he played his heart out and it was quite beautiful to listen to. His instrument case was open and all who appreciated his offering dropped money into the case.
Before going to La Jolla, check out their webpage to see if a concert or exhibition is being offered at this location, it will add a nice dimension to your trip.