This phrase means to do something soon, and not wait. You use it like this:

I think we should talk to an accountant sooner rather than later.

If you're going to break it off with him, you ought to do it sooner rather than later.