# llama.cpp v0.9.0 adds FP8 E4M3 quantization, Mistral Large 4 and Chatterbox TTS

Canonical: https://theagenticweekly.com/news/llama-cpp-v0-9-0-fp8-mistral-large-4 · Evidence: Reported · First seen: 2026-11-04 13:17 UTC · Source published: 2026-11-04 13:08 UTC · Brief published: 2026-11-04 14:02 UTC · Updated: 2026-11-04 14:02 UTC · Author: Agentic Weekly

> llama.cpp v0.9.0, released November 4, 2026, adds an OCP FP8 E4M3 quantization type, support for four new architectures (Clover, Limite, Metis-1.6 and Mistral Large 4), Chatterbox TTS and Nemotron 3.5 Transcribe, and updates its ggml library to v0.29.0.

Models in this brief: [Clover-35B-A3B-Preview](https://theagenticweekly.com/models/clover-35b-a3b-preview), [Nemotron 3.5 Transcribe](https://theagenticweekly.com/models/nemotron-3-5-transcribe), [Mistral Large 4](https://theagenticweekly.com/models/mistral-large-4)

## What changed

- Quantization: a new OCP FP8 E4M3 tensor type (saturating mode) with conversion helpers and a new file type, exposed in llama.h as LLAMA_FTYPE_MOSTLY_F8_E4M3.
- A new flash_attn_ext_rows op makes the unified KV cache efficient for multi-sequence inference; the release notes say it restores non-unified KV prefill performance.
- Four new architectures: the Clover-35B-A3B-Preview diffusion model (AR mode), Limite 1B, Metis-1.6 (Praxis ~2.9B and Logos ~10.2B, hybrid Mamba-2 and attention) and Mistral Large 4.
- Audio: Chatterbox TTS support, Nemotron 3.5 Transcribe for offline transcription in 40 languages with speaker attribution, and predefined Pocket TTS voices; the server's GET /props now lists a model's predefined voices.
- The bundled ggml library moves to v0.29.0, which adds initial multi-node tensor parallelism over NCCL plus backend work across CPU, CUDA, SYCL, Metal, Vulkan, OpenCL and Hexagon.
- Gemma 4 E2B and E4B get graph optimizations the notes describe as massive prefill gains, and the web UI adds MCP group checkboxes in its tools settings.

## Who should care

Anyone serving several sequences at once from one llama.cpp server should look at the unified KV change, and anyone who wants FP8 weights in GGUF form now has a file type for it. People who want to run Mistral Large 4, Chatterbox TTS or Nemotron 3.5 Transcribe locally get first support in this release. Embedders calling llama.h or mtmd.h directly should read the API changes list, which adds new enums and voice functions. If you only run small chat models through a wrapper such as Ollama, nothing here needs action until your wrapper picks up the new version.

## In the source's words

> "This release adds OCP FP8 E4M3 quantization support"
> (llama.cpp v0.9.0 release notes, https://github.com/ggml-org/llama.cpp/releases/tag/v0.9.0)

> "Four new architectures are supported (Clover, Limite, Metis-1.6 and Mistral Large 4)"
> (llama.cpp v0.9.0 release notes, https://github.com/ggml-org/llama.cpp/releases/tag/v0.9.0)

## What we have not verified

- We did not run this release, so we cannot confirm the prefill gains or multi-sequence speedups the notes describe; no figures are given for them.
- FP8 E4M3 model quality and memory savings compared with existing GGUF quant types are not stated in the release notes.
- Which hardware backends accelerate the new FP8 type end to end is not spelled out in the llama.cpp notes.

## Timeline

- Source published: 2026-11-04 13:08 UTC
- First seen by our watcher: 2026-11-04 13:17 UTC (via GitHub releases: ggml-org/llama.cpp)
- Brief published: 2026-11-04 14:02 UTC

## Sources

- [llama.cpp v0.9.0 release notes (GitHub)](https://github.com/ggml-org/llama.cpp/releases/tag/v0.9.0) (primary source) (fetched 2026-11-04)
- [ggml v0.29.0 release notes (GitHub)](https://github.com/ggml-org/ggml/releases/tag/v0.29.0) (fetched 2026-11-04)

## Related

- [Clover-35B-A3B-Preview: specs, price and alternatives](https://theagenticweekly.com/models/clover-35b-a3b-preview)
- [Nemotron 3.5 Transcribe: specs, price and alternatives](https://theagenticweekly.com/models/nemotron-3-5-transcribe)
- [Mistral Large 4: specs, price and alternatives](https://theagenticweekly.com/models/mistral-large-4)
- [llama.cpp: verdict and setup guide](https://theagenticweekly.com/tools/llama-cpp)
- [Ollama vs llama.cpp](https://theagenticweekly.com/compare/ollama-vs-llama-cpp)
- [All news briefs](https://theagenticweekly.com/news)
- [This week's releases](https://theagenticweekly.com/this-week)
- [New AI models this week](https://theagenticweekly.com/models/this-week)

## How to cite

Agentic Weekly, "llama.cpp v0.9.0 adds FP8 E4M3 quantization, Mistral Large 4 and Chatterbox TTS", published 2026-11-04 14:02 UTC, https://theagenticweekly.com/news/llama-cpp-v0-9-0-fp8-mistral-large-4