I would say if he never been there for you or the your child it's best to try to move on from the time the two of you spend together and do your best to make it on your own. Don't live in the past because it will only bring you bad memories and tears, make your life for yourself and your child.
My oldest son's father was only involved when his wife made him get involved when she found out he had a 5yr old son he had nothing to do with, of course they got divorced when he became an ass to her as well and then he stopped caring, my then 7 year old me promise he'd never have to see his father again...no problem..promise kept and he is 10 years old now. with my youngest...my ex husband decided he liked the idea rather than the actual parenting part, I left him. He tried for a while to be there but it wasn't because he wanted to be, it's because he was trying to hurt me for leaving him. then he stopped showing up and calling..so I made sure he could never use my son again or hurt him, took visitation away and full custody and then he left the state. He's been gone for three years now and hasn't sent a card, called nothing. he doesn't want to be there..I will never let him. My children can decide when they are older if they ever want to reach out, I have their info and know how to contact them. for now both my boys are better off without those "men"