My ex-boyfriend keeps saying bad stuff about my new boyfriend?

okay, me and my ex-boyfriend(tony) do not communicate at all. i'm back with my other ex(ray) and i don;t want nothing to do wih Tony and he keeps trying to talk to me. i told Tony when i was with him bad things about Ray like saying Ray's was boring and that his d**k was small..but i only said it out of anger. So today, i seen him and he was with his friend whom i still ociate with and Tony kept throwing it in my face about what i use to say about Ray. but i really didn't mean it i just said it out of anger. and it bothers me that Tony keeps saying thing about my boyfriend who i love. i don't know what to do....can some one please give me advice??