LLM Hallucination Index RAG SpecialModel Insights
meta-llama-3-70b-instruct
Details
Developer
Meta
License
Llama 3
Model parameters
70b
Supported context length
8k
Price for prompt token
$0.9/Million tokens
Price for response token
$0.9/Million tokens
Model Performance Across Task-Types
Chainpoll Score
Short Context
0.95
Model Insights Across Task-Types
Digging deeper, here’s a look how meta-llama-3-70b-instruct performed across specific datasets
Short Context RAG
Performance Summary
| Tasks | Task insight | Cost insight | Dataset | Context adherence | Avg response length |
|---|---|---|---|---|---|
| Short context RAG | The model demonstrates exceptional reasoning and comprehension skills, excelling at short context RAG. It shows good mathematical proficiency, as evidenced by its performance on DROP and ConvFinQA benchmarks. It comes out as one of the best open source models. | Cheapest open source model with best in class performance. We highly recommend it. | Drop | 0.94 | 263 |
| Hotpot | 0.94 | 263 | |||
| MS Marco | 0.95 | 263 | |||
| ConvFinQA | 0.97 | 263 |