fast-axolotl Rust + Python High-performance Rust extension for Axolotl LLM fine-tuning. 77× faster Parquet streaming, parallel dedup, no OOM.
A drop-in Rust acceleration shim for the Axolotl fine-tuning toolkit. Import it before Axolotl and four data-pipeline hot paths (streaming readers, parallel SHA-256 dedup, token packing, batch padding) swap to Rust — 77× on Parquet streaming.
Install
$ pip install fast-axolotlFrequently asked questions
What is fast-axolotl?
fast-axolotl is High-performance Rust extension for Axolotl LLM fine-tuning. 77× faster Parquet streaming, parallel dedup, no OOM. It is part of the Neul Labs open-source portfolio (36 MIT-licensed projects for AI agent infrastructure). A drop-in Rust acceleration shim for the Axolotl fine-tuning toolkit. Import it before Axolotl and four data-pipeline hot paths (streaming readers, parallel SHA-256 dedup, token packing, batch padding) swap to Rust — 77× on Parquet streaming.
How do I install fast-axolotl?
Install with: `pip install fast-axolotl`. fast-axolotl is MIT licensed and ships prebuilt binaries where applicable.
What language is fast-axolotl written in?
fast-axolotl is written in Rust + Python.
Is fast-axolotl open source?
Yes. fast-axolotl is MIT licensed and publicly available at https://github.com/neul-labs/fast-axolotl. All 36 Neul Labs projects are MIT licensed.