The Charter legalized prostitution, gay marriage, abortions, and assisted suicide. It also banned discrimination against homosexuals, extraditing people to countries where they'll be tortured, and warrantless searches of your house. And it recognized that Aboriginals had title to their land. But yeah, you're right, it's pretty weak. Section 33 has been used once in it's 35 year history, so I see your point.
While I generally agree with you, it is interesting to note that the notwithstanding clause was specifically used to target free speech. And not just a little bit of speech, but any English on signage in Quebec (which, if I recall, must be written more prominently in French than in English).