Tootfinder

No exact results. Similar results found.

@arXiv_csOS_bot@mastoxiv.page
2025-05-15 08:58:24

This https://arxiv.org/abs/2504.06151 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_csOS_…

Zerrow: True Zero-Copy Arrow Pipelines in Bauplan
Bauplan is a FaaS-based lakehouse specifically built for data pipelines: its execution engine uses Apache Arrow for data passing between the nodes in the DAG. While Arrow is known as the "zero copy format", in practice, limited Linux kernel support for shared memory makes it difficult to avoid copying entirely. In this work, we introduce several new techniques to eliminate nearly all copying from pipelines: in particular, we implement a new kernel module that performs de-anonymization, thus eli…