COLUMNAR CACHE IN HYBRID TRANSACTIONAL/ANALYTICAL PROCESSING (HTAP) WORKLOADS

Organization Name

snowflake inc.

Inventor(s)

Mihir Dharamshi of Redmond WA (US)

Cristian Diaconu of Kirkland WA (US)

Chen Luo of San Mateo CA (US)

Andrew Mccormick of San Francisco CA (US)

Corbin Mceihanney of San Mateo CA (US)

Joshua Slocum of Austin TX (US)

Wumengjian Zhu of Cupertino CA (US)

COLUMNAR CACHE IN HYBRID TRANSACTIONAL/ANALYTICAL PROCESSING (HTAP) WORKLOADS

This abstract first appeared for US patent application 20250068640 titled 'COLUMNAR CACHE IN HYBRID TRANSACTIONAL/ANALYTICAL PROCESSING (HTAP) WORKLOADS

Original Abstract Submitted

the subject technology receives, by an execution node, blob metadata from a key-value store, the blob metadata including information related to a set of blob files. the subject technology determines, by the execution node using the blob metadata, whether a copy of each of the set of blob files is stored in a local cache of the execution node. the subject technology transforms at least one blob file, retrieved from a blob store, to a second file in a column file format, the at least one blob file being in a first format that is different than the column file format, the transforming comprising at least converting a particular snapshot file from the at least one blob file to a particular set of rowsets and writing the set of rowsets into the second file in the column file format. the subject technology stores the second file in the local cache.