Partners who are not LotR fans

My boyfriend loathes anything to do with LotR and he's not even read the books!!!! In fact he hates it so much he wouldn't even go to see the films with me.
He gets annoyed with me cause I spend so much time online talking to other Tolkien fans cause he thinks I should be spending the time with him.
Don't get me wrong, this is the only issue we have everything else is great, but it can be really hard for me because this has been my greatest interest for the past 20 years of my life and I can't do without (I tried for the first couple of years but I just got so unhappy)
Anytime I mention anything Tolkien related I can see his eyes glaze over and a scowl appear on his usually handsome face, I really would like to share this with him but it's never going to happen.