You can talk about something that you don't like for yourself this way:

I don't like waiting for people.

I don't like spending a lot of money on restaurants.

But if you want to talk about things that you don't like for someone else, you say it this way:

I don't like him looking at you like that.

I don't like you coming around here and eating all our food! (To a stray cat.)

Of course, it's not only "I don't like" which can be followed by this structure. There are also lots of other phrases like:

I remember you asking me whether I had a boyfriend.

There's nothing wrong with us taking a little time off for ourselves every now and then, away from the kids.