Sorry, there isn’t a rule. You have to learn which verbs go with which pattern.

The verbs followed by  -ing include enjoy, mind, stop and recommend.

I told him you really enjoy cooking.
Would you mind helping me?
It didn't stop raining all day yesterday.
Daisy recommends trying Alfie’s tiramisu.

The negative is verb + not + -ing.

Imagine not having pizza! I eat it all the time.

Verbs usually followed by -ing

stop     finish     imagine     suggest     recommend      avoid      mind      miss      risk      enjoy 

Yes, you’re right, you can. But we’re not looking at the more complex patterns with that or an object today.

These include decide, want, promise, plan and forget.

She decided to go with Elliot instead.
I wanted to visit Rome.
She promised to take me there.
I planned to go to some real Italian restaurants.
She didn’t forget to phone.

The negative is verb + not + infinitive.

They decided not to make pizza.

Here are more verbs that are usually followed by the infinitive:

hope     offer     fail     agree     forget     manage     learn     afford     arrange     ask     expect     would like     decide     plan     promise     want     invite

These include start, begin, continue and bother.

It started raining. or  It started to rain.
Don’t bother waiting for me.  or  Don’t bother to wait for me.

The verbs like, love and hate can be followed by -ing or the infinitive when talking about repeated actions.

I love reading long novels.   (British English or American English) 
I love to read long novels.    (American English)

But when we are talking about situations, we use the -ing form.

Paulo loves living by the beach in Rio.
Do you like working as a waitress?

Exactly. But there are some more verbs which can be followed by -ing or the infinitive, but the two options have different meanings, for example remember and stop.

I never remember to lock the door, and my mum gets really angry!
     (remember + infinitive = remember something and then do it)
I never remember locking the door, but when I go back and check I always have.
     (remember + -ing = remember something you did before)

She stopped smoking three years ago.
     (stop + -ing = to not do something any more)
It was hot, so we stopped to have a drink.   (we stopped walking)
     (stop + infinitive = to not do something in order to do something else)

OK, later on you can try to remember all the patterns.