For all the in-depth analysis of MDPs, a very good heuristic for playing 2048 is to just alternate swipes toward a corner (e.g. down and to the right), with an occasional movement in the other direction if it's stuck. How close does this get to the optimal policy?