Yes, absolutely focus is essential. But once you decide what to make you want as many customers as possible. And that obviously includes not turning away half of your customers at the door.
Which is what you do if you don't support IE. Unless of course you have chosen a niche where 95% of your users use firefox. I have yet to see the stats for such a site.