I wash my hands at least twenty times a day, probably, and they don't become raw. I don't use moisturizer either. It could be you have to build up a tolerance. Some people who don't brush their teeth often will similarly have discomfort and bleeding when they do brush (like right before a dentist's appointment).
Relative humidity has a huge impact on how dry your hands get. Winter in the mid-West my hands would crack even with moisturizer. Winter in SF? Never had an issue.
