LLM inference library written in Rust with mistral.rs

📅 October 19, 2024 ⏱️ 1 min read

"Here's an LLM inference library written in Rust. It's not just for that one family of models - like how llama.cpp has grown beyond Llama, mistral.rs has grown beyond Mistral. …" # Description used for search engine.