Prior-Posterior Derived-Predictive Consistency Checks for Post-Estimation Calculated Quantities of Interest (QOI-Check)

Salvato in:
Dettagli Bibliografici
Pubblicato in:arXiv.org (Dec 20, 2024), p. n/a
Autore principale: Sennhenn-Reulen, Holger
Pubblicazione:
Cornell University Library, arXiv.org
Soggetti:
Accesso online:Citation/Abstract
Full text outside of ProQuest
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!

MARC

LEADER 00000nab a2200000uu 4500
001 3148683737
003 UK-CbPIL
022 |a 2331-8422 
035 |a 3148683737 
045 0 |b d20241220 
100 1 |a Sennhenn-Reulen, Holger 
245 1 |a Prior-Posterior Derived-Predictive Consistency Checks for Post-Estimation Calculated Quantities of Interest (QOI-Check) 
260 |b Cornell University Library, arXiv.org  |c Dec 20, 2024 
513 |a Working Paper 
520 3 |a With flexible modeling software - such as the probabilistic programming language Stan - growing in popularity, quantities of interest (QOIs) calculated post-estimation are increasingly desired and customly implemented, both by statistical software developers and applied scientists. Examples of QOI include the marginal expectation of a multilevel model with a non-linear link function, or an ANOVA decomposition of a bivariate regression spline. For this, the QOI-Check is introduced, a systematic approach to ensure proper calibration and correct interpretation of QOIs. It contributes to Bayesian Workflow, and aims to improve the interpretability and trust in post-estimation conclusions based on QOIs. The QOI-Check builds upon Simulation Based Calibration (SBC), and the Holdout Predictive Check (HPC). SBC verifies computational reliability of Bayesian inference algorithms by consistency check of posterior with prior when the posterior is estimated on prior-predicted data, while HPC ensures robust inference by assessing consistency of model predictions with holdout data. SBC and HPC are combined in QOI-Checking for validating post-estimation QOI calculation and interpretation in the context of a (hypothetical) population definition underlying the QOI. 
653 |a Calibration 
653 |a Software 
653 |a Algorithms 
653 |a Bayesian analysis 
653 |a Variance analysis 
653 |a Statistical analysis 
653 |a Predictions 
653 |a Regression models 
653 |a Statistical inference 
653 |a Bivariate analysis 
653 |a Software development 
653 |a Programming languages 
653 |a Workflow 
773 0 |t arXiv.org  |g (Dec 20, 2024), p. n/a 
786 0 |d ProQuest  |t Engineering Database 
856 4 1 |3 Citation/Abstract  |u https://www.proquest.com/docview/3148683737/abstract/embedded/ZKJTFFSVAI7CB62C?source=fedsrch 
856 4 0 |3 Full text outside of ProQuest  |u http://arxiv.org/abs/2412.15809