Skip to content

andrestubbe/FastCompress

Repository files navigation

FastCompress — Ultra-Fast Native Compression for Java [v0.1.0]

A high-performance native compression and hashing module for the FastJava ecosystem. Optimized for raw throughput and SIMD-accelerated algorithms.

Status Java Platform License: MIT


FastCompress delivers elite compression performance by leveraging native SIMD instructions and optimized memory handling. Built for high-throughput data pipelines, real-time telemetry, and agentic state management.

// Quick Start — SIMD Hashing
byte[] data = ...; 
long hash = FastCompress.hash64(data); // 15 GB/s throughput

Table of Contents


Key Features

  • ⚡ SIMD Accelerated — LZ4 and xxHash paths tuned for AVX2/AVX-512.
  • 🔍 Change Detection — Sub-millisecond hashing for visual diffing.
  • 🚀 Zero-Copy — Direct memory access via JNI critical sections.
  • 📦 Minimal Footprint — Designed for low-latency agentic substrate.

📊 Performance (v0.1.0 Alpha)

Measured on Modern x64 Hardware.

Operation Standard Java FastCompress Native Speedup
Hashing (1GB) ~500 ms (CRC32) ~65 ms (xxHash64) 7.7x
Compression (1GB) ~2200 ms (GZIP) ~240 ms (LZ4) 9.1x

Note

Read the full performance manifest in PHILOSOPHIE.md.


API Quick Reference

Method Description Documentation
hash64(data) High-speed xxHash64 checksum. Reference →
compressLZ4(...) Fastest block compression. Reference →
compressZstd(...) High-efficiency compression. Reference →

Installation

Maven (JitPack)

<dependencies>
    <dependency>
        <groupId>com.github.andrestubbe</groupId>
        <artifactId>fastcompress</artifactId>
        <version>v0.1.0</version>
    </dependency>
    <dependency>
        <groupId>com.github.andrestubbe</groupId>
        <artifactId>fastcore</artifactId>
        <version>v0.1.0</version>
    </dependency>
</dependencies>

Hero Demos

See the examples/ directory for high-speed races:


Documentation


License

MIT License — See LICENSE file for details.


Part of the FastJava EcosystemMaking the JVM faster.

Made with ⚡ by Andre Stubbe

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors