This is really interesting to me because whenever I see anyone decline a meeting I assume it's because they have too much to do and don't have time to spare. If anything, declining meetings should make your job more secure because everyone will think you're swamped with work.