Ask HN: Are your code benchmarks statistically valid?

by DenisMon 4/25/2025, 8:30 PMwith 3 comments

It appears that some benchmarking tools provide average or percentile values but no information about statistical validity of the result. What did you observe or do in your career?

by Magma7404on 4/25/2025, 8:37 PM

I haven't got a clue since I have never used any benchmark tool in my whole life. Could you tell us in which professional context you would use that kind of tool?