The workforce grew, look at the link and table 5. Basically woman and minorities joined the workforce. Worker to population ratio went up and the total number of workers went up faster than the growth in population.
Jim Crow laws, blackballing, and redlining. You ant allowed to work in certain jobs, if you speak out (see Kapernick), no job for you! And you can’t even live within reasonable distance of work!