Is it an outdoor concert? Atlanta in December can get chilly, sure, though is mostly spared the frigid temps of climes further to the north (and the mountains just outside the Big Peach). As for family activities, you've got the Georgia Aquarium, World of Coca-Cola, CNN studio tours, and High Museum of Art. Have fun at the concert.