I think Heidegger was only partly anti-foundationalist. At the root of foundationalist-axiomatic philosophy is a denial of experienced finitudes in the area of knowledge, and by implication many other aspects of reality. Heidegger starts out affirming experienced finitudes in his phenomenology of human existence, but then abandons it for a supernaturalistic view of human history in terms of race or later cosmos.
