I'll be getting the Nexus 4 once it's out, but like both of you, the screen size is the biggest drawback for me.
I really hope Google realizes that bigger is not always better!