Language Model Deployment and Fine-tuning
Run Code Llama 70B with an API

Run Code Llama 70B with an API

1/30/2024

What this post added

This post introduces the availability of Code Llama 70B on Replicate, detailing its three variants (Base, Python, Instruct) and providing concrete code examples for running it via API using JavaScript, Python, and cURL. It specifies the model version hash (`a279116fe47a0f65701a8817188601e2fe8f4b9e04a518789655ea7b995851bf`) and demonstrates how to set API tokens and construct prediction requests with relevant input parameters for code generation.

Read the original post ↗