Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Basic model assumptions and sampler tests #2

Open
brandonwillard opened this issue May 30, 2020 · 3 comments
Open

Basic model assumptions and sampler tests #2

brandonwillard opened this issue May 30, 2020 · 3 comments
Assignees

Comments

@brandonwillard
Copy link
Contributor

brandonwillard commented May 30, 2020

We need to create some toy/example series and build tests around them. See the examples here for reference.

@brandonwillard
Copy link
Contributor Author

FYI: I've created some toy model tests in a PR here.

@brandonwillard brandonwillard changed the title Create sampler tests Basic model assumptions and sampler tests Jun 11, 2020
@brandonwillard
Copy link
Contributor Author

Here's a Gist that walks through the act of simulating and estimating the Poisson-Zero HMM model using the code in the .org file.

In general, we need to

  • investigate different series lengths in order to make sure that performance doesn't degrade too much as the number of observations increases,
  • make sure that estimation is consistent (statistically and performance-wise) for different ranges of parameter values (e.g. transition probabilities, Poisson rates)
  • make sure that some basic posterior estimators (e.g. sample means and variances) are consistent with the simulated "true" values,
  • perform all of the above under the FFBS and transition-matrix samplers (both independently and together),
  • make sure that our samples will also work well in combination with other samplers (e.g. NUTS to estimate the Poisson rate)

@brandonwillard brandonwillard transferred this issue from another repository Jun 16, 2020
@brandonwillard
Copy link
Contributor Author

Now that we have a Python package set up, the results of this work should be additions to the unit tests in tests/.

@brandonwillard brandonwillard linked a pull request Jun 30, 2020 that will close this issue
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants