Am I wrong?

So my long term partner has been a compulsive gambler for over 15 years. He also suffers severe depression. In the past he is managed to rack up debts and wasn’t contributing anything to the household often leaving me to pay for the mortgage etc on credit cards whilst he gambled his wage. 
Anyway about three years he seemed to get himself back on track paid of some of the debts I’d incurred when he wasn’t contributing , paid off his own debts, gave me some money to take the kids on a holiday in the Uk and started contributing to the household again. 
However Im certain he is gambling again. He pays monthly towards the house but then the day after pay day is skint, he’s got himself loans and credit cards but won’t show me what the money has been spent on.  Now he’s telling me that I’m controlling him, I took advantage when he was vulnerable and let him pay the debts I’d incurred. I’ve spoken to his mum who was really annoyed so he’s accused me of trying to control and damage the relationship with his mum. I’ve blocked internet access to gambling sites but I’m being made to feel everything I’m doing is wrong and controlling! Im just trying to protect myself and the children. Am I wrong? Am I controlling? My anxiety is through the roof. I don’t know who to talk to or what to do.