Robust ordinal mislabel logistic regression based on γ-divergence

doi:10.7523/j.ucas.2020.0056

Journal of University of Chinese Academy of Sciences ›› 2022, Vol. 39 ›› Issue (3): 289-301.DOI: 10.7523/j.ucas.2020.0056

• Research Articles • Next Articles

Robust ordinal mislabel logistic regression based on γ-divergence

GUO Meijun^1,2, REN Mingyang^1,2, LI Shiming³, ZHANG Sanguo^1,2

1 School of Mathematical Sciences, University of Chinese Academy of Sciences, Beijing 100049, China;
2 Key Laboratory of Big Data Mining and Knowledge Management, Chinese Academy of Sciences, Beijing 100049, China;
3 Beijing Tongren Eye Center, Beijing Tongren Hospital, Beijing Ophthalmology & Visual Science Key Laboratory, Beijing Institute of Ophthalmology, Capital Medical University, Beijing 100730, China

Received:2020-01-03 Revised:2020-04-13 Online:2022-05-15
Supported by:
Supported by University of Chinese Academy of Sciences (Y95401TXX2),Beijing Natural Science Foundation (Z190004),and Key Program of Joint Funds of the National Natural Science Foundation of China (U19B2040)

Abstract

Abstract: Ordinal multi-classification methods have been studied widely. Traditional ordinal multi-classification methods assume that the sample label is not mislabeled. Due to the complexity of the real data and the limited artificial experience, it is unrealistic to obtain completely accurate labels, in which conventional methods perform poorly. In this article, we propose an ordinal mislabel logistic regression method based on γ-divergence, which possessing strong robustness when dealing with ordinal mislabeled response data. That is to say, when mislabeled, the weight of the sample in parameter estimation equation diminish compared to the case that the sample is properly labeled. Our method not only possesses the robustness but also can ignore the mislabel probabilities in the model. We construct the model by minimizing γ-divergence estimation and solve the model by gradient descent algorithm. Both simulation studies and real data analysis demonstrate that the method, namely robust ordinal mislabel logistic regression, is efficient to analyze ordinal mislabeled response data.

Key words: γ-divergence, logistic regression, mislabeled response, ordinal classification, robustness

CLC Number:

O212

GUO Meijun, REN Mingyang, LI Shiming, ZHANG Sanguo. Robust ordinal mislabel logistic regression based on γ-divergence[J]. Journal of University of Chinese Academy of Sciences, 2022, 39(3): 289-301.

References

[1] Dembczyński K, Kotłowski W, Słowiński R. Ordinal classification with decision rules[C]//International Workshop on Mining Complex Data. Springer, Berlin, Heidelberg, 2007: 169-181.DOI:10.1007/978-3-540-68416-9_14.
[2] Cardoso J S, Costa J F. Learning to classify ordinal data: the data replication method[J]. Journal of Machine Learning Research, 2007, 8(Jul): 1393-1429.
[3] Chang K Y, Chen C S, Hung Y P. A ranking approach for human ages estimation based on face images[C]//2010 20th International Conference on Pattern Recognition. August 23-26,2010,Istanbul, Turkey.IEEE, 2010: 3396-3399.DOI:10.1109/ICPR.2010.829.
[4] Frank E, Hall M. A simple approach to ordinal classification[C]//European Conference on Machine Learning. Springer, Berlin, Heidelberg, 2001: 145-156.DOI:10.1007/3-540-44795-4_13.
[5] Shashua A, Levin A. Ranking with large margin principle: two approaches[C]//Advances in Neural Information Processing Systems. 2003: 961-968.
[6] Wang H D, Shi Y, Niu L F, et al. Nonparallel support vector ordinal regression[J]. IEEE Transactions on Cybernetics, 2017, 47(10): 3306-3317.DOI:10.1109/TCYB.2017.2682852.
[7] Hung H, Jou Z Y, Huang S Y. Robust mislabel logistic regression without modeling mislabel probabilities[J]. Biometrics, 2018, 74(1): 145-154.DOI:10.1111/biom.12726.
[8] Tian Y, Sun M, Deng Z B, et al. A new fuzzy set and nonkernel SVM approach for mislabeled binary classification with applications[J]. IEEE Transactions on Fuzzy Systems, 2017, 25(6): 1536-1545.DOI:10.1109/TFUZZ.2017.2752138.
[9] Qian W M, Li Y M. Parameter estimation in linear regression models for longitudinal contaminated data[J]. Applied Mathematics: A Journal of Chinese Universities, 2005, 20(1): 64-74.DOI:10.1007/s11766-005-0038-0.
[10] Komori O, Eguchi S, Ikeda S, et al. An asymmetric logistic regression model for ecological data[J]. Methods in Ecology and Evolution, 2016, 7(2): 249-260.DOI:10.1111/2041-210X.12473.
[11] Cox C. Location-scale cumulative odds models for ordinal data: a generalized non-linear model approach[J]. Statistics in Medicine, 1995, 14(11): 1191-1203.DOI:10.1002/sim.4780141105.
[12] Fujisawa H, Eguchi S. Robust parameter estimation with a small bias against heavy contamination[J]. Journal of Multivariate Analysis, 2008, 99(9): 2053-2081.DOI:10.1016/j.jmva.2008.02.004.
[13] Mollah M N H, Eguchi S, Minami M. Robust prewhitening for ICA by minimizing β-divergence and its application to FastICA[J]. Neural Processing Letters, 2007, 25(2): 91-110.DOI:10.1007/s11063-006-9023-8.
[14] Smith S A, O’Meara B C. treePL: divergence time estimation using penalized likelihood for large phylogenies[J]. Bioinformatics, 2012, 28(20): 2689-2690.DOI:10.1093/bioinformatics/bts492.
[15] Zang Y G, Zhao Q, Zhang Q Z, et al. Inferring gene regulatory relationships with a high-dimensional robust approach[J]. Genetic Epidemiology, 2017, 41(5): 437-454.DOI:10.1002/gepi.22047.
[16] Kakita T, Hiraoka T, Oshika T. Influence of overnight orthokeratology on axial elongation in childhood myopia[J]. Investigative Ophthalmology & Visual Science, 2011, 52(5): 2170-2174.DOI:10.1167/iovs.10-5485.
[17] Hoyt C S, Stone R D, Fromer C, et al. Monocular axial myopia associated with neonatal eyelid closure in human infants[J]. American Journal of Ophthalmology, 1981, 91(2): 197-200.DOI:10.1016/0002-9394(81)90173-2.
[18] Li S M, Liu L R, Li S Y, et al. Design, methodology and baseline data of a school-based cohort study in Central China: the Anyang childhood eye study[J]. Ophthalmic Epidemiology, 2013, 20(6): 348-359.DOI:10.3109/09286586.2013.842596.
[19] Chang K Y, Chen C S, Hung Y P. Ordinal hyperplanes ranker with cost sensitivities for age estimation[C]//CVPR 2011. June 20-25, 2011, Colorado Springs, CO,USA. IEEE, 2011: 585-592.DOI:10.1109/CVPR.2011.5995437.

Robust ordinal mislabel logistic regression based on γ-divergence

PDF (PC)

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 11

Recommended Articles

Metrics

Comments

[1]	LIN Daquan, FAN Rui, ZHANG Liangfeng. Image adversarial attack algorithm based on high-dimensional feature [J]. Journal of University of Chinese Academy of Sciences, 2022, 39(3): 421-431.
[2]	GUO Meijun, REN Mingyang, LI Shiming, ZHANG Sanguo. Robust ordinal mislabel logistic regression based on γ-divergence [J]. Journal of University of Chinese Academy of Sciences, 2022, 39(3): 289-301.
[3]	WEI Yongfeng, XIANG Yibo. Imbalanced data credit scoring model based on Group-Lasso method [J]. Journal of University of Chinese Academy of Sciences, 2021, 38(2): 181-188.
[4]	DONG Yulin, GUO Xiao. Breakdown point of penalized logistic regression [J]. , 2020, 37(5): 582-592.
[5]	HAI Bao, LI Shiming, LIU Luoru, SHEN Liyong, ZHANG Sanguo, LI Siyuan, LI He, KANG Mengtian, SUN Yunyun, MENG Bo, ZHANG Qingzhao. Juvenile myopia study using modern variable selection methods [J]. , 2015, 32(6): 728-734.
[6]	CHEN Su, LUO Tie-Jian, XU Yan-Xiang. Robust analysis of trust-based recommendation algorithms [J]. , 2011, 28(2): 253-261.
[7]	ZHAO Chao. Brief Report Parameter estimation for Muskingum routing model based on robust algorithm [J]. , 2010, 27(4): 556-562.
[8]	DING Fei, YIN Hong-Xia. Improved classification model via MPEC [J]. , 2009, 26(5): 599-608.
[9]	GU Jin, GUO Li, ZHENG Dong-Fei. A robust speech authentication algorithm based on perceptual characteristics [J]. , 2009, 26(4): 474-482.
[10]	ZHAO Chao, HONG Hua-sheng, ZHANG Luo-ping. Robust recursive algorithm for real-time co-correction model [J]. Journal of University of Chinese Academy of Sciences, 2008, 25(5): 665-670.
[11]	WANG Shu-Quan, ZHAO Guang-Heng. Study of a Fuzzy Logic Controller for Satellite Maneuver Control [J]. , 2006, 23(1): 111-117.