What? No. There are many kinds of IQ tests. Some require you to complete patterns of symbols. Most do have a verbal logic and purely verbal dimension, which is sometimes worth just as much as completing patterns.
You're right, I was too absolute in how I worded that. That said, I believe most widely used tests at least have a nonverbal portion. It's kind of a shame that we lump all IQ tests together; it's probably pretty easy for researchers to confirm their biases by using an inappropriate test.