Meta Llama 3 available on Cloudflare Workers AI

What this post added

This post announces the availability of Meta's Llama 3 8B instruction-tuned model on Cloudflare Workers AI. It details the technical aspects of Llama 3's architecture, including its increased training tokens, larger context windows (with current support for 2.8k and planned support for 8k), and its efficient tiktoken-based tokenizer with a 128k vocabulary. It also highlights the use of grouped-query attention (GQA) for inference efficiency and byte-pair encoding (BPE) for tokenization. The post provides a code example demonstrating how to run inference with Llama 3 on Workers AI and mentions upcoming support for other Meta AI offerings like Llama Guard 2, Code Shield, and CyberSec Eval 2.