It's worth keeping in mind that autonomous vehicles find different things challenging than humans do. Weird road shapes and knowing how to route into some lane is pretty straightforward with map data. It's the "normal" parts of driving like predicting other road users that are more difficult.
Totally fair. Things I might find challenging as a human unfamiliar with a given location (though GPS tends to help a lot) are probably different from an autonomous vehicle dealing with a lot of borderline crazy behavior by other cars, cyclists, and pedestrians darting out into traffic. A person also can just process so many inputs at once so you get into situations that are challenging in part because so much is going on.