To be “on the verge of” doing something is similar to being “about to” do something. It means you are very close to doing it.

They were on the verge of closing down until the economy improved.

Yeah, I was on the verge of saying something but decided to keep quiet.