Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Determining the number of burn-in steps #77

Open
tgrkim91 opened this issue Dec 19, 2024 · 0 comments
Open

Determining the number of burn-in steps #77

tgrkim91 opened this issue Dec 19, 2024 · 0 comments

Comments

@tgrkim91
Copy link

Hello CausalImpact team,

Thank you for this great package! I have some questions regarding how burn-in (or warm-up) steps is handled in this original implementation.

From my understanding, this package adaptively determines the burn-in by analyzing the log-likelihood trajectory, using the following process:

  • Compute the log-likelihood for each sample.
  • Consider the last fraction of samples (e.g., the final 10%) and find a high quantile (e.g., the 90th percentile) of log-likelihood in this tail portion.
  • Identify the earliest point in the chain where the log-likelihood exceeds this quantile, and drop all samples before this point.

This adaptive approach can, in some cases, lead to dropping the first 90% of samples, depending on the log-likelihood trajectory. I have a few questions about this:

  1. Could you confirm if my understanding of the burn-in behavior in the R implementation is correct? If not, I’d appreciate any corrections or clarifications.
  2. I’m curious about the logic of looking at the last fraction of samples to determine the burn-in threshold. Wouldn’t it make more sense to use the first fraction (e.g., the first 20%) to determine the threshold? This might prevent discarding a large proportion of samples and ensure the point estimates and credible intervals are based on a sufficiently large set of samples.

Thank you for your time and for considering these questions. I look forward to hearing your insights!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant