A tool that can be used to measure the sequential performance of any OpenAI-compatible LLM API - coder543/llm-speed-benchmark
Read more here: External Link
A tool that can be used to measure the sequential performance of any OpenAI-compatible LLM API - coder543/llm-speed-benchmark
Read more here: External Link