Brushing your teeth afterwards, or at least before bed, helps. If I smoke then go to bed without brushing, I definately taste it in the morning. I don't find it bitter though. I don't think it has to do with how much you smoke, so smoke that thing if you enjoy it.

What are you smoking? Do you notice it more with certain cigars?