Streaming and longer context lengths for LLMs on Workers AI

"Cloudflare Workers AI Streaming is a new platform from Cloudflare that enables developers to create and deploy machine learning models in the browser. The platform makes use of WebAssembly (WASM), a low-level language that can be deployed onto a web page for execution, and TensorFlow.js, which provides access to all the necessary libraries and tools needed for machine learning development. The platform also includes a set of APIs that allow developers to integrate their model into any existing web page or application without needing to write any additional code.