Historically, we all know that at some point in time Black people were discriminated and even enslaved by other race. The Orange in the "Orange is the new Black" refers to prisoners (the colour of their uniforms are mostly orange).
Prisoners, even those that are already released and have already served their service are often discriminated and frowned upon in the outside world like the blacks from centuries ago.