I've never understood Karma to be a reward/punishment thing. Just a statement of fact that one's actions will come back to them. I suppose that some folks won't think about it seriously without divine heavy-handedness, though.