It sounds worse than it is! Yes, it is an allergy. It sounds simple, but left untreated, it can seriously mess up your GI system.

Why not switch to soy or almond milk? I made the switch over two years ago, and when I tried cow milk again, it was awful! And I had never had a problem prior (cream is okay for me, too, oddly.)