You can be in Maine in as little as 4 hours from New York City, or you could take all four days just wandering the nooks and crannies of the coast and the back roads inland. One possible itinerary that would include much of what you want goes something like this. Just suck it up and get by New Haven on I-95. After that the Connecticut and Rhode Island coasts open up a bit and you can take some scenic routes like CT-146, CT-156 and RI-1A. Hike along the shore at some of the state parks such as Hammonasset and Misquamicut. Soak up a little history and culture at Mystic Seaport and Newport. Then head up inland into the Connecticut Valley region of southern New Hampshire and Vermont. There is great camping and hiking at places like Monadnock State Park and White Rocks National Recreation Area as well as the stunning beauty of New England in the fall. Finally work your way back south through the Berkshires of western Massachusetts, particularly Mount Greylock area. NY-22 would make a fine scenic road for the return to the city. And you can do this entire trip while driving less than 175 miles a day for each of your 4 days.
AZBuck