Actually, depending on what you do, Florida isn't too expensive. I spent a week on Pine Island a couple of years ago and I was unemployed! Nothing like laying on the beach in the beginning of March, while back at home a blizzard was hitting hard.

If you don't mind the cold, then that opens up your options quite a bit. If you're looking to escape it, then you'll be more limited.

Since you don't do amusement parks, that will keep the costs down significantly. What are your interests? Keep in mind in order to have a good time, you'll have to include things that you both enjoy (not necessarily mutually), to stave off boredom.