Model ID
cai-llama-3-1-8b-slim
Llama 3.1 8B Slim by CompactifAI
Model Overview
Section titled “Model Overview”Base Architecture
Llama-3.1-8B-Instruct
Model ID (Reasoning)
cai-llama-3-1-8b-slim-r
Base Architecture
Llama-3.1-8B-Instruct
Compressed Model Specifications
Section titled “Compressed Model Specifications”| Specification | Value |
|---|---|
| API ID | cai-llama-3-1-8b-slim |
| API ID (Reasoning) | cai-llama-3-1-8b-slim-r |
| Original Architecture | Llama-3.1-8B-Instruct |
| Parameter Count | 3.2B |
Benchmark Highlights
Section titled “Benchmark Highlights”| Benchmark | Compressed |
|---|---|
| Mmlu | 0.575 |
| Boolq | 0.826 |
| Hellaswag | 0.605 |
| Triviaqa (rc.wikipedia.nocontext subset) | 0.41 |
| Gsm8k | 0.785 |
| Perplexity (Wiki) | 18.59 |