Well done Val1983. It sounds to me like you have made some very positive changes. I would switch him from briefs to boxers. The air moving around and cooling things off can help too!
Most of all relax. Stress can hinder baby making.
Make a point of letting yourself laugh and smile, it will help you relax.
If he will not go to the dr. with you start out going by your self. He might just see how important it is to you and go because he wants to.