He's married and I am single, but we have sex now I want him just for me but he won't leave his wife?

Girl!!!!! What do you think will happen when you sleep with a married person. He loves his wife and is probably going through something right now with her that has upset their relationship...my guess is it was having a child. The best course of action for you is not to sleep with married people.