I did this for a long time. But the problems start right away when you want to add some navigation between pages. And then you want to have a chronological display of posts, or a master index, or tags. Then you want some consistent style, headers, menus. Then you figure you'd like comments. And search. And analytics. Then you realize you're half way to writing your own half assed blog engine and go check out Wordpress.
Chronological display of posts? Tags? You have so much content you need so much stuff to organize it?
Don't need menus, headers, consistent style. Use plain html.
Comments? God no. You'll have spam, you'll have to manage it. What you want is a contact page with your email address and your phone number. Everyone knows how to use those.
Search? This means you have too much stuff. Trim, keep the good stuff only.
How fancy does you blog need to be? WP tosses most of the spam, lets you moderate the rest of these comments, makes it minimally painful to post text and images, and works without JavaScript. What more do you need?
Wordpress reminds me of Ron Swanson saying "Never half-ass two things, son. Whole-ass one thing."
But in general, Wordpress is rife with inconsistent UIs, plugins that cause each other problems, and attempting to be all things to all people. It's moved way, way past being just a blog engine.