Hi Growthbook team! I'm running into a data collection issue with our experiment that started on 08/05. Issue: Secondary metric (Activation Rate) appears to only be collecting data from 08/12 onwards. However, the primary metric (Appointment Booked) are correctly showing data from 08/05 start date. Our Activation Rate is based on bookings done, and the denominator already reflects users who have booked appointments. Given this dependency, it's puzzling why data collection would start 7 days later than the primary booking metric. I do see that the Activation Rate metric is showing a flag: "analysis or metric setting do not match current version." Questions: What could cause a secondary metric to have a different data collection start date than the primary metrics in the same experiment? Since the Activation Rate depends on the same booking events that are showing data from 08/05, how could the data collection timing be so different? Is this a configuration issue on my end, or something else I should check? Any guidance on resolving this would be greatly appreciated! Thanks!

Hi Alexandra, sorry for the wait. I'm a data scientist at GrowthBook (different Luke S!). We recently had a bug where data were not getting updated in certain cases, and we addressed this bug at the beginning of the month. Can you please pull latest version of GrowthBook and try again? Thanks, Luke

@steep-dog-1694 thank you for your response! I am quite new to Growthbook, what would be the steps to pull the latest version? Thanks again!

Are you self hosted?

Hey @steep-dog-1694 we're not self-hosted. I did a refresh but this seems like an issue with the specific view since the data is there if we group by First Exposure

Hi Bruno, When did you add Activation Rate? If you added Activation Rate mid experiment, then we won't have historical results for that metric. Thanks, Luke

You mean as a metric into the experiment right? That makes sense I guess you're pulling data regularly and storing the historic values and not calculating them all at using a query?

Right, we store historical results and use those for time series, we do not recalculate them. Was Activation Rate added mid experiment?