I Feel Like I Am In Prison - By Partner Of A Prisoner

My partner is in prison, but I feel like it is me who is serving the sentence. I am scowled at in the street, my kids are picked on at school and I feel like my life is locked in a cell because I am finding it hard to move on and ignore the nasty comments made about me and my children.
I love my partner. But I have to be realistic and say that I am not sure whether I can stand by him 100% because he has been sentenced to prison for a long time. Right now I do not know where to turn at all. Families of offenders serve the prison sentence - not the offenders!