Help! I need some positive reinforcement that this is the right thing to do?

I lost my virginity to a guy that I wasn't dating. He always told me he was to busy with college and work to have girlfriend. I've been involved in this, I guess, friends with benefits relationship. I've also managed to fall in love with him. It has been very off and on. I've dated two other people during the time we've been together, always ending all contact with him while I was with someone else. But those other people didn't last but two weeks and me and my fwb always got back together. My fwb always told me he'd make me his girlfriend and then never did. He use to tell me sweet things, but now hes said things like I'm not hot, that I'm "alright" and that having with me doesn't really do anything for him. Then he told me he was interested in another girl so we ended things. Then he called me last weekend. I called him back but he didn't pick up. I know things being over is the best thing for me but I just need more encouragement because sometimes I miss him so much that I'd give anything to be with him.