This is something you say when you're slightly surprised, scared, happy, or feel some other emotion. It's like "Oh my God":

Oh my God, that's wonderful!

But "Oh my goodness" sounds more mild. The emotion doesn't sound as strong as it does when you say "Oh my God." Also, there are some people (mostly older, conservative women) who don't say "Oh my God" for religious reasons.