Awesome! I remember when I first started programming, we started off with command line applications. Immediately I wanted to make a game in the terminal. I never did, now I can finally learn Go and make a terminal game.
You absolutely can. That said, if your application is to look quite static and you don't really need the game-style render-loop, you could use Termbox directly (it's great):