Is it true that the swine flu vaccine is actually very dangerous?

A doctor told us that the vaccine can actually cause a dangerous weakening of our immune systems and increase chances of catching the flu. I'm 19 and just got vaccinated before hearing that. Should I be worried?