Survival analysis using Mahalanobis distance in Kernels of the Beran estimator

Intelligent Systems and Technologies, Artificial Intelligence
Authors:
Abstract:

Survival analysis is critical for modeling time-to-event data across medicine, engineering, and economics. The Beran estimator serves as an efficient nonparametric tool for estimating conditional survival functions under censoring. However, the conventional Beran estimator relies on the Euclidean distance for kernel weighting, a metric that fails to account for heterogeneous scales and correlations among covariates. This limitation can result in suboptimal weighting when features exhibit multicollinearity or varying measurement units. To address this, we propose the M-Beran estimator, a generalized formulation that incorporates the Mahalanobis distance into the kernel smoothing scheme. This modification ensures scale invariance and leverages the underlying correlation structure of the feature space, transforming the kernel into an elliptically symmetric form. We evaluate the proposed method through numerical experiments on real-world survival datasets. Results demonstrate that the M-Beran estimator outperforms the conventional Euclidean-distance-based Beran estimator, offering improved predictive accuracy.

Funding:

The research is funded by the Ministry of Science and Higher Education of the Russian Federation as part of state assignments “Development and research of machine learning models for solving fundamental problems of artificial intelligence for the fuel and energy complex” (topic FSEG-2024-0027).

  • References

    1. Cox D.R. Analysis of survival data. London: Chapman and Hall/CRC, 2018.

    2. Hosmer D.W., Lemeshow S., May S. Applied Survival Analysis: Regression Modeling of Time to Event Data. New Jersey: John Wiley & Sons, 2008. DOI: 10.1002/9780470258019

    3. Tattar P., Vaman H.J. Survival Analysis. NY: Chapman and Hall/CRC, 2022. DOI: 10.1201/97810-03306979

    4. Wang P., Li Y., Reddy C.K. Machine Learning for Survival Analysis: A Survey. ACM Computing Surveys (CSUR), 2019, Vol. 51, No. 6, Art. no. 110. DOI: 10.1145/3214306

    5. Beran R. Nonparametric regression with randomly censored survival data, 1981.

    6. Cox D.R. Regression models and life-tables. Journal of the Royal Statistical Society: Series B (Methodo-logical), 1972, Vol. 34, No. 2. Pp. 187–220. DOI: 10.1111/j.2517-6161.1972.tb00899.x

    7. Berrendero J.R., Bueno-Larraz B., Cuevas A. On Mahalanobis Distance in Functional Settings. Jour-nal of Machine Learning Research, 2020, Vol. 21, Pp. 1–33.

    8. Dabrowska D.M. Non-Parametric Regression with Censored Survival Time Data. Scandinavian Jour-nal of Statistics, 1987, Vol. 14, No. 3, Pp. 181–197.

    9. Dabrowska D.M. Uniform Consistency of the Kernel Conditional Kaplan–Meier Estimate. The Annals of Statistics, 1989, Vol. 17, No. 3, Pp. 1157–1167.

    10. Ma Q., Zeng L., Tu S., Xu L. Kernel Mean Matching with Mahalanobis Distance for Causal Inference of Time-to-event Outcome. 2022 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), 2022, Pp. 509–514. DOI: 10.1109/BIBM55620.2022.9995021

    11. Baghfalaki T., Ganjali M., Berridge D. Robust joint modeling of longitudinal measurements and time to event data using normal/independent distributions: a Bayesian approach. Biometrical Journal, 2013, Vol. 55, No. 6, Pp. 844–865. DOI: 10.1002/bimj.201200272

    12. Baghfalaki T., Ganjali M., Hashemi R. Bayesian joint modeling of longitudinal measurements and time-to-event data using robust distributions. Journal of Biopharmaceutical Statistics, 2014, Vol. 24, No. 4, Pp. 834–855. DOI: 10.1080/10543406.2014.903657

    13. Liu M., Legault V., Fülöp T., Côté A.-M., Gravel D., Blanchet F.G., Leung D.L., Lee S.J., Nakaza-to Y., Cohen A.A. Prediction of mortality in hemodialysis patients using moving multivariate distance. Frontiers in Physiology, 2021, Vol. 12, Art. no. 612494. DOI: 10.3389/fphys.2021.612494

    14. Roblin E., Cournède P.-H., Michiels S. Evaluation of machine-learning models to measure individualized treatment effects from randomized clinical trial data with time-to-event outcomes. arXiv:2506.12277, 2025. DOI: 10.48550/arXiv.2506.12277

    15. Maas C.C.H.M., Kent D.M., Hughes M.C., Dekker R., Lingsma H.F., van Klaveren D. Performance metrics for models designed to predict treatment effect. BMC Medical Research Methodology, 2023, Vol. 23, Art. no. 165. DOI: 10.1186/s12874-023-01974-w

    16. De Maesschalck R., Jouan-Rimbaud D., Massart D.L. The Mahalanobis distance. Chemometrics and Intelligent Laboratory Systems, 2000, Vol. 50, No. 1, Pp. 1–18. DOI: 10.1016/S0169-7439(99)00047-7

    17. Anthony H., Kamnitsas K. On the use of Mahalanobis distance for out-of-distribution detection with neural networks for medical imaging. Uncertainty for Safe Utilization of Machine Learning in Medical Imaging (UNSURE 2023), 2023, Vol. 14291, Pp. 136–146. DOI: 10.1007/978-3-031-44336-7_14

    18. Cabana E., Lillo R.E., Laniado H. Multivariate outlier detection based on a robust Mahalanobis distance with shrinkage estimators. Statistical Papers, 2021, Vol. 62, Pp. 1583–1609. DOI: 10.1007/s00362-019-01148-1

    19. Colombo P., Dadalto E., Staerman G., Noiry N., Piantanida P. Beyond Mahalanobis distance for tex-tual OOD detection. Advances in Neural Information Processing Systems, 2022, Vol. 35, P. 17744–17759.

    20. Podolskiy A., Lipin D., Bout A., Artemova E., Piontkovskaya I. Revisiting Mahalanobis distance for transformer-based out-of-domain detection. Proceedings of the 35th AAAI Conference on Artificial Intelligence, 2021, Vol. 35, No. 35, Pp. 13675–13682.

    21. Brown P.O., Chiang M.C., Guo S., Jin Y., Leung C.K., Murray E.L., Pazdor A.G.M., Cuzzocrea A. Mahalanobis distance based k-means clustering. Big Data Analytics and Knowledge Discovery, 2022, Vol. 13-428, Pp. 256–262. DOI: 10.1007/978-3-031-12670-3_23

    22. Nielsen S., Abdullaev L., Teo R., Nguyen T.M. Elliptical attention. 38th Conference in Neural Informa-tion Processing Systems (NeurIPS), 2024, Pp. 1–42.

    23. Wiegrebe S., Kopper P., Sonabend R., Bischl B., Bender A. Deep learning for survival analysis: a review. Artificial Intelligence Review, 2024, Vol. 57, Art. no. 65. DOI: 10.1007/s10462-023-10681-3

    24. Kaplan E.L., Meier P. Nonparametric Estimation from Incomplete Observations. Journal of the Ame-rican Statistical Association, 1958, Vol. 53, No. 282, P. 457–481. DOI: 10.2307/2281868

    25. Van der Maaten L., Hinton G. Visualizing data using t-SNE. Journal of Machine Learning Research, 2008, Vol. 9, No. 86, P. 2579–2605.

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License
Previous articleNext article