GPT-3.5-turbo-1106

Everyone's favorite model from OpenAI released in November 2023.

Model

GPT-3.5-turbo-1106

Details

Developer

OpenAI

License

Private

Model parameters

Roumered to be 20B

Pretraining tokens

Release date

November 2023

Supported context length

16k

Price for prompt tokens*

$1/Million tokens

Price for response tokens*

$2/Million tokens

*Note: Data based on 11/14/2023

Model Performance Across Task-Types

Here's how GPT-3.5-turbo-1106 performed across all three task types

Metric

ChainPoll Score

QA without RAG

0.74

QA with RAG

0.74

Long form text generation

0.82

Model Info Across Task-Types

Digging deeper, here’s a look how GPT-3.5-turbo-1106 performed across specific datasets

Tasks	Insights	Dataset Name	Dataset Performance
QA without RAG	The model performs well which show less bias and good factual knowledge.	Truthful QA	0.61
QA without RAG		Trivia QA	0.86
QA with RAG	The model excels at this task which demonstrates great reasoning and comprehension skills. It struggles a bit on mathematical skills as it scores relatively low on DROP compared to other dataset.	MS Marco	0.9
		Hotpot QA	0.67
		Drop	0.57
		Narrative QA	0.82
Long form text generation	The model excels at this task which demonstrates great ability to generate long text without factual errors.	Open Assistant	0.82

💰 Cost insights

The model offers a great balance of cost and performance. It is 30x cheaper compared to GPT4 and 2x costlier compared to Llama 70b variant. OpenAI provides generous rate limits for production application.

LLMHALLUCINATIONINDEXLLM