Scared Of His Dad Being Released - By 'Alice'

My son is scared to death of his dad being released from prison. We have been through hell as a family. My son has been bullied and just generally persecuted because his dad is in prison. His friends and regrettably some of our family have said in front of my son that his dad is a waste of space and that he will end up in prison again. Probation have agreed my partner can come home. But when this is mentioned, my son cries and says he does not want his dad home. Prison visits between the three of us have been fine. But my son now does not want his dad to come home because of all the negative things people are saying about him.