This is fascinating, thanks for sharing! Oddly enough I worked on something similar in grad school in 2008 (https://cowboyscott.gg/research/micro08.pdf). Our methods and models were quite primitive (though we did have a nice eye tracker) and the work had mixed success. It's great seeing related approaches, but with proper budgets and teams!