This phrase introduces a serious point that you want to make after you've been joking about something. When you're ready to stop joking, say something like this:

But seriously, we need to hurry up and finish this.