Meta Llama 3 available on Cloudflare Workers AI
Apr 18, 2024Michelle Chen, Davina Zamanzadeh, Isaac Rehg, Nikhil Kothari
Summary
This post announces the availability of Meta Llama 3 8B on Cloudflare Workers AI. It details the model's performance, tokenizer (tiktoken-based, 128k vocabulary), and architecture (grouped-query attention). It also provides a code example for running inference with Llama 3 via the Workers AI platform and mentions upcoming releases of other Meta AI tools.
More from the Artificial Intelligence Integration & Impact trail
- Introducing Clef-omni with full multimodality, plus a faster Clef and a cheaper Clef-flash
- Introducing Web Search API via AI Gateway
- Introducing Clef: our open-source decision models, and new RL fine-tuning platform
- One year later: Sovereign AI and the fight for choice
- AI Search is now generally available