Introducing DocChat: GPT-4 Level Conversational QA Trained In a Few Hours - Cerebras

Cerebras DocChat models (Llama3-DocChat and Dragon-DocChat) are released for document-based conversational QA. Llama3-DocChat was trained in hours on a single Cerebras System, and Dragon-DocChat was fine-tuned in minutes. The training process incorporated synthetic data generation to handle unanswerable questions, Chain of Thought reasoning for arithmetic tasks, and instruction tuning for entity extraction. The models, training recipes, and datasets are open-sourced.