Although multiple criteria mathematical program (MCMP), as an alternative method of classification, has been used in various real-life data mining problems, its mathematical structure of solvability is still challengeable. This paper proposes a regularized multiple criteria linear program (RMCLP) for two classes of classification problems. It first adds some regularization terms in the objective function of the known multiple criteria linear program (MCLP) model for possible existence of solution. Then the paper describes the mathematical framework of the solvability. Finally, a series of experimental tests are conducted to illustrate the performance of the proposed RMCLP with the existing methods: MCLP, multiple criteria quadratic program (MCQP), and support vector machine (SVM). The results of four publicly available datasets and a real-life credit dataset all show that RMCLP is a competitive method in classification. Furthermore, this paper explores an ordinal RMCLP (ORMCLP) model for ordinal multigroup problems. Comparing ORMCLP with traditional methods such as One-Against-One, One-Against-The rest on large-scale credit card dataset, experimental results show that both ORMCLP and RMCLP perform well.
In order to improve the performance of support vector machine (SVM) applications in the field of credit risk evaluation, an adaptive Lq SVM model with Gauss kernel (ALqG-SVM) is proposed to evaluate credit risks. The non-adaptive penalty of the object function is extended to (0, 2] to increase classification accuracy. To further improve the generalization performance of the proposed model, the Gauss kernel is introduced, thus the non-linear classification problem can be linearly separated in higher dimensional feature space. Two UCI credit datasets and a real life credit dataset from a US major commercial bank are used to check the efficiency of this model. Compared with other popular methods, satisfactory results are obtained through a novel method in the area of credit risk evaluation. So the new model is an excellent choice.
