Cloudflare

Adding new LLMs, text classification and code generation models to the Workers AI catalog

Feb 6, 2024Michelle Chen, Logan Grasby
Adding new LLMs, text classification and code generation models to the Workers AI catalog
SummaryAI, from the source post

This post announces the addition of eight new models to the Workers AI catalog: six text generation models (@hf/thebloke/llama-2-13b-chat-awq, @hf/thebloke/zephyr-7b-beta-awq, @hf/thebloke/mistral-7b-instruct-v0.1-awq, @hf/thebloke/openhermes-2.5-mistral-7b-awq, @hf/thebloke/neural-chat-7b-v3-1-awq, @hf/thebloke/llamaguard-7b-awq) and two code generation models (@hf/thebloke/deepseek-coder-6.7b-base-awq, @hf/thebloke/deepseek-coder-6.7b-instruct-awq). It highlights the performance advantages of DeepSeek Coder and OpenHermes-2.5-Mistral-7B, explains Activation-aware Weight Quantization (AWQ) for memory efficiency, and introduces LlamaGuard for prompt and response safety classification with a code example. The post emphasizes the ease of use of Workers AI for developers.

More from the Artificial Intelligence Integration & Impact trail