ChatQA

NVIDIA has introduced the ChatQA model, which is said to perform against Biao GPT-4, using efficient training methods such as two-stage instruction tuning and improved context retrieval. ChatQA is a set of conversational question-and-answer (QA) models that can achieve GPT-4 level accuracy. Specifically, the development team proposes a two-stage instruction tuning approach that significantly improves zero-sample conversational QA results for large language models (LLMs). To handle retrieval in conversational QA, a dense retriever is fine-tuned on a multi-round QA dataset, which provides the same level of accuracy as using state-of-the-art query rewriting ...