A tool that can be used to measure the sequential performance of any OpenAI-compatible LLM API - coder543/llm-speed-benchmark

Read more here: External Link