llamafile

What's Changed

Summary:

• Added support for vulkan dylibs
• Added windows build scripts -> we now have cuda, rocm, vulkan both as .so and as .dll libraries
• Updated llama.cpp submodule to 5e9c63546 -> we now have llama.cpp support for new models (e.g. gemma-4, bonsai, Qwen3.6) and functionalities (e.g. llama.cpp internal tools for agents)

Details:

• Fix README_0.10.0 by @aittalam in https://github.com/mozilla-ai/llamafile/pull/918
• Add support for vulkan dylibs by @aittalam in https://github.com/mozilla-ai/llamafile/pull/892
• Add tinyblasStrsmBatched kernel by @aittalam in https://github.com/mozilla-ai/llamafile/pull/923
• Fix: GGUF Q5_1 quant crashes llamafile on aarch64 cpu by @aittalam in https://github.com/mozilla-ai/llamafile/pull/928
• fix broken link 'feel free to choose' -> example llamafiles by @bquast in https://github.com/mozilla-ai/llamafile/pull/927
• Fix block-size assumption by @aittalam in https://github.com/mozilla-ai/llamafile/pull/935
• Add windows build scripts for CUDA by @aittalam in https://github.com/mozilla-ai/llamafile/pull/924
• Fix whisperfile documentation link in README by @martin0258 in https://github.com/mozilla-ai/llamafile/pull/939
• Update llama.cpp submodule to 5e9c63546 by @aittalam in https://github.com/mozilla-ai/llamafile/pull/941
• Migrate docs from MkDocs/GitHub Pages to GitBook by @angpt in https://github.com/mozilla-ai/llamafile/pull/946
• Win build improvements by @aittalam in https://github.com/mozilla-ai/llamafile/pull/940
• Fix cuda: /lib/x86_64-linux-gnu/libstdc++.so.6: version GLIBCXX_3.4.32' not found` by @aittalam in https://github.com/mozilla-ai/llamafile/pull/948
• Docs Updates by @angpt in https://github.com/mozilla-ai/llamafile/pull/949
• New release version: update version.h and docs by @aittalam in https://github.com/mozilla-ai/llamafile/pull/952

New Contributors

• @bquast made their first contribution in https://github.com/mozilla-ai/llamafile/pull/927
• @martin0258 made their first contribution in https://github.com/mozilla-ai/llamafile/pull/939
• @angpt made their first contribution in https://github.com/mozilla-ai/llamafile/pull/946

Full Changelog: https://github.com/mozilla-ai/llamafile/compare/0.10.0...0.10.1