Fast and efficient content-defined chunking for data deduplication. Java implementation of FastCDC as library.
-
Updated
Sep 21, 2023 - Java
Fast and efficient content-defined chunking for data deduplication. Java implementation of FastCDC as library.
A virtual filesystem for Crystal: unify directories and archives into a single tree with compression, encryption, and chunked storage.
Fast content-defined chunking in Go.
Streaming Content-Defined Chunking (CDC) using FastCDC algorithm with modernized API, support sync and async I/O. Prioritizes correctness, determinism, and composability. Flexible async backend support such as Tokio, async-std, and smol ect.
Content-addressed delivery for game updates, assets, and engine packs — smaller downloads, persistent cache reuse, and byte-identical reconstruction.
A memory-safe, Rust-based version control system that uses a private blockchain to ensure absolute data sovereignty and an immutable audit trail. Optimized for large binary assets with FastCDC, it offers granular file-level permissions for mission-critical corporate environments.
Smart Storage for Your Builds
Fast, encrypted, deduplicating backup tool written in Rust.
Find (partial content) duplicate files.
Print FastCDC rolling hash chunks and checksums.
A high-performance FastCDC 2020 implementation written in Python + Cython
A FUSE-based filesystem implementing content-defined chunking and deduplication in Rust.
Parallel implementation of DumbVersion's patch format, now with ZSTD
Professional-grade 3D asset manager built in Rust. Bypasses physical I/O limits via FastCDC deduplication. Reclaim 60% storage.
Sparse-delta, verified transfer and migration of LLM model weights between machines
Add a description, image, and links to the fastcdc topic page so that developers can more easily learn about it.
To associate your repository with the fastcdc topic, visit your repo's landing page and select "manage topics."