Language Model Deployment and Fine-tuning
Jet-setting with Llama 2 + Grammars

Jet-setting with Llama 2 + Grammars

10/9/2023

What this post added

Introduced and demonstrated the use of Llama 2 models with built-in grammar support for constrained text generation, specifically for information extraction tasks. Showcased how to use JSON schemas to guide LLM output into structured formats, providing a practical example of parsing flight confirmation emails into a JSON object using Replicate's JavaScript client library and a grammar-enabled Llama 2 model.

Read the original post ↗