I don't think open access lists for HIPAA data would be a bad thing. Why do you? In fact, it sounds like a great idea. Shine some light on who is accessing what data.
The fact that a certain specialist has accessed a patient's records would reveal something about their health. Even the frequency of general access conveys information about your health.