LLM inference library written in Rust with mistral.rs

Here's an LLM inference library written in Rust. It's not just for that one family of models - like how llama.cpp has grown beyond Llama, mistral.rs has grown beyond Mistral. …

Read more here: External Link