And the best part is that in Qt 5.x the individual components are separate source packages. Off the top of my head ... base for the core Qt; widgets for old style widget library; script and declarative for QtQuick; system for I-don't-remember-what; and so on.
If you don't need QtQuick or QtWebKit, you can actually drop quite a few of the packages.