It's a lot like cricket in my experience, in that it took me a good 6 hours of viewing before I understood the concept.
Then, like all good sports, you start to appreciate the nuances. In baseball, it's all about predicting which pitch is going to be thrown next.