Credit scoring has been regarded as a core appraisal tool of different institutions during the last few decades and has been widely investigated in different areas, such as finance and accounting. Different scoring techniques are being used in areas of classification and prediction, where statistical techniques have conventionally been used. Both sophisticated and traditional techniques, as well as performance evaluation criteria, are investigated in the literature. The principal aim of this paper, in general, is to carry out a comprehensive review of 214 articles/books/theses that involve credit scoring applications in various areas but in particular primarily in finance and banking. This paper also aims to investigate how credit scoring has developed in importance and to identify the key determinants in the construction of a scoring model, by means of a widespread review of different statistical techniques and performance evaluation criteria. Our review of literature revealed that there is no overall best statistical technique used in building scoring models and the best technique for all circumstances does not yet exist. Also, the applications of the scoring methodologies have been widely extended to include different areas, and this subsequently can help decision makers, particularly in banking, to predict their clients' behaviour. Finally, this paper also suggests a number of directions for future research