The universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics.

Apache Arrow defines a language-independent columnar memory format for flat and hierarchical data, organized for efficient analytic operations on modern hardware like CPUs and GPUs. The Arrow memory format also supports zero-copy reads for lightning-fast data access without serialization overhead.

• Apache Arrow @ GitHub.
• arrow-rs @ GitHub.

Related contents:

• Fast columnar JSON decoding with arrow-rs @ arroyo.
• I spent 6 hours learning Apache Arrow: Overview @ Data Engineer Things's Medium.

ONNX is an open format built to represent machine learning models. ONNX defines a common set of operators - the building blocks of machine learning and deep learning models - and a common file format to enable AI developers to use models with a variety of frameworks, tools, runtimes, and compilers.

FLIF is a novel lossless image format which outperforms PNG, lossless WebP, lossless BPG, lossless JPEG2000, and lossless JPEG XR in terms of compression ratio.

FLIF is a novel lossless image format which outperforms PNG, lossless WebP, lossless BPG and lossless JPEG2000 in terms of compression ratio.