Permanent problem or unhappy past that will never be forgotten or overlooked. (Compare to Albatross around one’s neck.) 

“Having an alcoholic husband has been my cross to bear my entire marriage.”