Well, it sorta depends on how the anxiety or low self esteem manifests itself. If the person is aware of their anxiety and doesn't try to cover it with over-compensation in the other direction (excessive self assurance or arrogance), then it can be rather charming.
