Another common error I see is timing (e.g. using data from the "future" to predict an event). To build on your loan example, if you inadvertently included the current FICO score of an applicant that applied 12 months ago, it will be unfairly correlated with the loans current performance.