Doing something "on purpose" means that you intended to do it. In other words, it wasn't a mistake.

A: Did you do that on purpose?

B: No, it was an accident.

You can also use the word "purposefully":

A: You purposefully lied to me!

B: No, I thought I was telling you the truth.