If you're excluding animal products from your diet and your lifestyle, I think you can call yourself a vegan. However, I think that people who go vegan for reasons besides animal rights typically have some contradictions in their thinking. For example, I have a friend who gave up meat, eggs, dairy, and almost all other animal products for environmental reasons, but kept eating honey. She eventually quit honey, not for ethical reasons, but simply because she wanted to describe herself as a vegan.
So basically, if you go out of your way to avoid animal exploitation you can call yourself a vegan, whether or not you care about animal rights. But it really wouldn't make much sense to me to do so. It's great if you do, though! The world needs more vegans.
don't take my life away, don't take my life away.