I can kind of understand things from both perspectives, since I'm still a vegetarian myself. In our situation I am in your husband's place - my housemate was (and still is) much more strongly driven to veganism than I am, and while I've made a lot of moves forward in that area of my life, I still get frustrated with the process sometimes and regress. Just yesterday I was craving eggs so badly I almost stopped at the grocery store and picked some up, but since my housemate refuses to eat them, and I don't eat them very often, it didn't seem worth it to give in to the indulgence, so I didn't. I'm still inwardly sulking about it though.
I also really want a few rescue hens so I can eat eggs guilt-free, but for a few reasons (one being I don't want to force any more animals on my animal-disliking housemate) we won't be getting any. I realize that he's absolutely right and that the better option is to give up eggs and cheese entirely, but I'm still finding it difficult. Your husband, while he admires and respects your beliefs, seems like he's having a difficult time with it too.
It's fun to learn how to veganize my cooking, and there are tons of great vegan recipes, techniques, and tricks out there, but it's SUCH a huge deal, especially in our area. Not to mention the fact that it kills me how much cheaper real dairy is in comparison to the dairy substitutes around here, which are sometimes prohibitively expensive in our current financial situation.