Well, each time I have been to London, I have always come away with the impression of how expensive it is. Understand I am not trying to be negative about it, just realistic. I had a good time and all but I found it too expensive in the long run to facilitate my staying there for any extended period of time.
You should go to the Tower though simply because of its history. the same is true for Westminster Abbey.