I don't actively hate Tom, but I do think that it's good that he isn't in the movie for some of the same reasons that everyone else mentioned. I love having Tom and Goldberry, and really the whole Old Forest as my own mental territory with my own unique picture, completely untouched by PJ. I love the movies, though, don't get me wrong!
I also think it's easier to see the characters my way when they're in the Old Forest with Tom and company because it's an area that isn't changed in any way. I can see the characters as my own elsewhere as well, it's just more of a conscious effort on my part. Another reason to love the Old Forest.
If so many people that have been avid book fans for years are still somewhat confused by Tom, imagine the reactions of people just seeing the movies without reading!