Medical records are not well distributed. In most of these statistics, unknown vaccine status is considered to be the same bucket as unvaccinated. My hypothesis is that most of this group is either elderly or homeless.
Similarly, there is a selection problem for the elderly who choose to remain unvaccinated. You're saying that they think vaccines are ineffective -- and this is definitely a cohort of people! But there is a separate cohort of people, who are more likely to be hospitalized, who know they have severe existing health problems.