fast-axolotl
Rust + Python High-performance Rust extension for Axolotl LLM fine-tuning. 77× faster Parquet streaming, parallel dedup, no OOM.
A drop-in Rust acceleration shim for the Axolotl fine-tuning toolkit. Import it before Axolotl and four data-pipeline hot paths (streaming readers, parallel SHA-256 dedup, token packing, batch padding) swap to Rust — 77× on Parquet streaming.
Install
$ pip install fast-axolotlFrequently asked questions
What is fast-axolotl?
fast-axolotl is an entry in the Neul Labs project catalogue. High-performance Rust extension for Axolotl LLM fine-tuning. 77× faster Parquet streaming, parallel dedup, no OOM. A drop-in Rust acceleration shim for the Axolotl fine-tuning toolkit. Import it before Axolotl and four data-pipeline hot paths (streaming readers, parallel SHA-256 dedup, token packing, batch padding) swap to Rust — 77× on Parquet streaming. Current source, licence, release and documentation status should be verified at the linked project surfaces.
How do I install fast-axolotl?
The catalogue records this install command: `pip install fast-axolotl`. Verify the linked repository, package, supported version and current instructions before use.
What language is fast-axolotl written in?
fast-axolotl is written in Rust + Python.
Is fast-axolotl open source?
Source is linked at https://github.com/neul-labs/fast-axolotl. Inspect the repository licence and release metadata for the exact version; Neul Labs does not apply one blanket licence claim to the whole catalogue.