On: I almost failed to search a 37 GB text file in und...

[winrid]

Clickhouse is not in memory.

[gkbrk → winrid]

ClickHouse has a table engine for keeping data in memory. Can be accessed like this

create table tableName (.....) Engine = Memory();

[zX41ZdbW → gkbrk]

But it's not necessary to keep data in Memory, because MergeTree works perfectly.

Here is a slide deck showing why MergeTree is faster than in-memory tables: https://presentations.clickhouse.com/meetup53/optimizations/

[ww520 → zX41ZdbW]

The comparison is done with the in-memory table doing full scan while MergeTree using an index. Kind of meaningless comparison.

[ilyt → zX41ZdbW]

Soooo did they just implement in memory store worse ?

[winrid → ilyt]

It's a database