Hello I noticed there are missing rows for the percent chang

Question

Hello I noticed there are missing rows for the percent change p values when I export the results from an experiment dashboard see screenshot I m wondering if the missing values are a bug or just not reported because the numbers are so small which seems odd compared to some of the other pvalues listed e g 1 08407061105709E 10 The issue only occurs when I export the results to a csv file they appear just fine on the dashboard < wide jordan 14758> < ambitious apartment 58735>

helpful-application-7107 · Answer

Hmm I can t seem to recreate this bug myself Could you share a quick screen shot of the p value column from the results table

helpful-application-7107 · Answer

Thanks for reporting it btw

orange-magician-36994 · Answer

Of course The p values for the missing rows still appear as p lt 001 I was worried maybe p lt 001 was defaulting for missing values but the csv contains p values for metric 5

helpful-application-7107 · Answer

You know it could be typescript actually rendering these values as 0 when we check if the pValue exists at all in our snapshot

helpful-application-7107 · Answer

I think your hunch is right

orange-magician-36994 · Answer

Oh boy Glad I caught it then

orange-magician-36994 · Answer

Is there a reason the p values wouldn t be calculating

helpful-application-7107 · Answer

Oh

helpful-application-7107 · Answer

no i mean the pvalues are fine in the UI

helpful-application-7107 · Answer

it s just that when we process the data from your snapshot for the CSV we are inappropriately treating 0 as missing and TypeScript thinks some really tiny number even smaller than 1e 10 is actually 0

helpful-application-7107 · Answer

I can land a fix but there s a decent change that the values end up being actually 0 in your CSV becauase we ve lost the precision to render some tiny number e g 1e 39 or something

orange-magician-36994 · Answer

That s good to know I don t think it ll affect us if the numbers are truly that small

helpful-application-7107 · Answer

It won t You can see from the UI that the confidence intervals are very far from 0 in those rows so the p values will be super tiny

helpful-application-7107 · Answer

We probably won t land a fix until later in the week but just know the results in the UI are unaffected by this bug and All of your missing pvalues here are very close to 0 lt 1e 10 at least

orange-magician-36994 · Answer

Not a problem thank you so much for clarifying