Monkeys are intelligent animals. They can recognized an insult. Don't underestimate a monkey.
Heard some people say the same with crows. If you disturb a crow (throw things at the crow etc - crows hang around at place where there are people so that they can eat droppings, leftover etc), the crow will attack you the next time he sees you - the crow is intelligent enough to recognize human faces.