Should i just dump him now before its too late?

I'm dating a 37 years old man who is smart, fun and sensitive, however he still lives at home with his divorced mother and 2 brothers, none of the brothers have a girlfriends (i wonder why), they are a very close family clan and they have through a lot, so they stick together. He only comes out to see me on the weekend but he can't go home too late because his mother might get upset, he seems to be stressed out if he goes home too late because his mom may be angry. When i am out with him he is very attentive and his mother never calls him. So i've told him that i am upset that he is still so close to his mother and i want a break up, and he said give him sometime to make a change, he has thought about moving out too, should i give him a chance to make changes or should i just dump him now? I want him to stay with me on weeknights not just weekend, he is a perfect guy except this curfew thing!