Celebrate the Season with Cape May's Historic Holiday Events CAPE MAY - Cape May, New Jersey. This coastal town fully embraces its historic roots, transforming into a picture-perfect winter wonderland filled with Victorian charm, glowing gas lamps, and strolling carolers.