Generative AI

Table of contents

Large Language Models (LLMs)

Models

| Model | Layers | Total Params | Active Params Per Token | Total Experts | Active Experts Per Token | Context Length | | | ------------ | ---------- | ---------------- | --------------------------- | ----------------- | ---------------------------- | ------------------ | --- | | gpt-oss-120b | 36 | 117B | 5.1B | 128 | 4 | 128k | | | gpt-oss-20b | 24 | 21B | 3.6B | 32 | 4 | 128k | |

Proprietary

Open-weights

Prompting

Evaluation and Benchmarks

LLM benchmark results:

Other overviews of LLM benchmarks:

Summarization:

Question answering / explaining concepts / trivia questions:

Multiple choice: