This phrase means "quickly". You can think of something happening so quickly that it finishes before you notice that it's happening. It's usually used to describe time lengths of months or years that pass by quickly:

Before you know it, you'll be finished with school and ready to find a job.

Summer will be over before you know it.