I visit Rockport twice monthly. I never miss eating at HU DAT. This is a wonderful oriental cafe owned by the parents of Dat Nguyen of the Dallas Cowboys. The fishing boats dock behind the place. A fresher meal can't be had. The variety is great and flavors orgasmic.
Another place, Charlotte Plumbers, has some of the best crab cakes I've ever tasted. You can sit indoors or outdoors on a balcony overlooking the water. They also offer steaks and chicken.
Both places are moderately priced and a joy to experince.