Simulating sample predictions from test data
Using a test portion of the data that is set aside, this is an algorithm that can be used to simulate sample predictions of the rest of the sample. This can be used to build a distribution of the Bayesian Specification Test.
- Use Bayes Rule with the training data to get
- Draw n realizations of from
- Use these n values to simulate sample data from the likelihood function - simulate samples the same size as the rest of the data
- use the bayesian specification test of the simulated samples - this forms the test distribution
- Compare to the specification test of the rest of the sample data to see if the model makes sense
References
@lancaster2004 - Chapter 2