Data engineering to find domains pointing to certain CNAMEs

by onnimonnion 3/6/2025, 1:19 PMwith 1 comments

by bcrlon 3/7/2025, 2:26 AM

There are times when data should be a JSON, and there are times when it really shouldn't be. 165GB of compressed JSON is simply insane. More than 53 bytes to record a timestamp with 11 digits behind the decimal point of the second?!?!? I'm lucky if my DNS query latency is below 40ms, and couldn't imagine a single case where that degree of precision is relevant. Someone missed taking a basic statistics course. Just... wow. I hope someone from Merklemap sees this and reforms their bloated ways.

I wonder how many dollars of cloud storage they're burning on this waste?