Would I be able to file child abandoment against my sons father?

My son's father left me for another woman with no warning only a week after I was laid off from my job and left me with no way to provide for our son. I took him for child support and am receiving it thru the state now but he hasn't called in six months to see how his son is. It has been me calling him only to get his voice mail or his girlfriend but he refuses to communicate with me and if I do reach him by chance he is very disrespectful and uncooperative. I live in maryland and was wondering if there was anyway to file abandonment charges against him and possibly have his custodial rights taken away all together since he has shown no interest thus far.