A lot of people here have noticed this. I've read that alcohol can do this. Personally, I've pretty much quit drinking during the periods of my life when I feel more fragile or agitated - the next day's anxiety just isn't worth it. Here is part of a post by Ruby under "understanding panic..." where she copy-pasted many interesting tips, this one is on alcohol:
Cut down on Stimulants
The last thing a panic attack needs is more fuel to 'feed' it. Certain stimulants are known to aggravate and even bring on Panic and Anxiety:
Alcohol
Some people see Alcohol as a relaxant and start drinking to try and deal with the devastating effects of an anxiety disorder. This of course is no solution. How do you know the difference between a hang-over and anxiety symptoms? The alcohol withdrawal or hangover tends to reinforce the physical symptoms which people interpret as increasing anxiety levels. This only keeps the cycle of anxiety and panic going. Alcohol will also not help you sleep - yes it may make you fall asleep but the sleep will be disturbed, intermittent and you still wake up feeling even worse!
The process of metabolizing alcohol can use up all the body's B vitamins (and B vitamins are play an important role in regulating anxiety).