If cheese were only bad for me I'd have it often.
I don't because it's really, really bad for cows.
Please keep in mind how far a change you're making. When I first really committed to be vegan it was hard. It seemed like I had think so much, and was so limited. It took a good 6-9 months to really feel that was normal for me.
Now, about 5 years later, my ideas of what to eat are limitless. I'm not all about health but do mostly whole foods and a lot of cooking and baking.
The thought that being vegan makes it harder as a cook or baker is nothing but a cop out. If you even remotely know your way around a kitchen (and like it!) you will LOVE being vegan.
I believe I now eat more new foods than foods I've given up.