LLM Hallucination Index RAG SpecialModel Insights
gemini-1.0-pro
Details
Developer
License
NA (private model)
Model parameters
NA (private model)
Supported context length
32k
Price for prompt token
$0.5/Million tokens
Price for response token
$1.5/Million tokens
Model Performance Across Task-Types
Chainpoll Score
Short Context
0.84
Model Insights Across Task-Types
Digging deeper, here’s a look how gemini-1.0-pro performed across specific datasets
Short Context RAG
Performance Summary
| Tasks | Task insight | Cost insight | Dataset | Context adherence | Avg response length |
|---|---|---|---|---|---|
| Short context RAG | The model demonstrates below average reasoning and comprehension skills at short context RAG. It shows just passing mathematical proficiency, as evidenced by its performance on DROP and ConvFinQA benchmarks. | It is costly model for the performance it offers. We recomend using 6x cheaper Gemini Flash. | Drop | 0.78 | 62 |
| Hotpot | 0.76 | 62 | |||
| MS Marco | 0.91 | 62 | |||
| ConvFinQA | 0.89 | 62 |