I think you should get out of NYC before afternoon rush - I-95 has some of the worst traffic on the planet.

Better check the ferry schedules to MV carefully - you need to get around Boston before afternoon rush too. Fridays are particularly bad.