Entropy-Based Goodness-of-Fit Testing for Multivariate Models

This post highlights our recent Scientific Reports article on entropy-based goodness-of-fit testing for multivariate distributions, with a focus on information-theoretic evaluation beyond classical metrics.

Published in Mathematics and Statistics

Like

Share this post

Choose a social network to share with, or copy the URL to share elsewhere

This is a representation of how your post may appear on social media. The actual post will vary between social networks

In this work, we develop goodness-of-fit testing procedures grounded in Tsallis entropy, targeting multivariate exponential-power (generalized Gaussian) and q-Gaussian distributions. The proposed framework compares closed-form entropy expressions under the null hypothesis with non-parametric k-nearest-neighbor estimators, enabling flexible and distribution-sensitive model assessment.

We establish key theoretical properties, including consistency and mean-square convergence of the estimator, and discuss an asymptotic normality regime as the entropy parameter approaches the Shannon limit. Since analytical null distributions are often intractable, critical values are calibrated using parametric bootstrap techniques, ensuring reliable inference across dimensions and parameter settings.

Extensive Monte Carlo experiments demonstrate the empirical size, power, and computational efficiency of the proposed tests. The results highlight the advantages of entropy-based evaluation in capturing subtle distributional discrepancies that may be overlooked by traditional goodness-of-fit approaches. An applied example further illustrates practical calibration and sensitivity considerations.

đź”— Article link: https://www.nature.com/articles/s41598-025-08110-2

Follow the Topic

Statistics and Computing
Mathematics and Computing > Statistics > Statistics and Computing
Probability and Statistics in Computer Science
Mathematics and Computing > Computer Science > Mathematics of Computing > Probability and Statistics in Computer Science
Machine Learning
Mathematics and Computing > Statistics > Statistics and Computing > Machine Learning

Related Collections

With Collections, you can get published faster and increase your visibility.

Cancer Prevention and Control

This cross-journal collection will consider submissions of research Articles and Registered Reports that advance the science and practice of cancer prevention, including strategies to reduce cancer risk and improve early detection.

Publishing Model: Hybrid

Deadline: Feb 19, 2027

Healthy Aging

This collection welcomes submissions based on studying preclinical models, as well as population-wide and clinical studies. Studies that advance our understanding of mechanisms behind healthy aging are also welcomed. Clinical research of interest will include epidemiological studies, observational studies, longitudinal cohort studies, systematic reviews and clinical trials.

Publishing Model: Open Access

Deadline: Dec 31, 2026