Ask HN: What is the biggest size of a SQLite database you have worked with?

by iio7on 8/16/2024, 4:37 AMwith 2 comments

by tazuon 8/16/2024, 8:39 PM

Personally, 10GB. It's a database of all "person pages" on English Wikipedia with some extracted text (infobox and sections) compressed using sqlite-zstd[1]. About 350k rows.

(I know this is "small" compared to what SQLite can handle, but it's the biggest I've worked with. Most of my SQLite databases are under 500MB).

[1]: https://github.com/phiresky/sqlite-zstd

by jtarchieon 8/19/2024, 8:44 PM

Currently 55GB, for read-only work at the moment. Using full text search, rtree, JSON, and indexes.