WizardLM 2 8x22B

Name: WizardLM 2 8x22B
Rating: 3.5 (1 reviews)
Author: Microsoft

Open Source

By MicrosoftReleased 2024-04-1564K context141B (39B active) parameters

Open Source

Benchmark Scores

70.9/100

MMLU75.5

HumanEval74

Math58

Reasoning73.5

Coding73.5

About WizardLM 2 8x22B

WizardLM 2 8x22B is Microsoft's instruction-tuned variant of Mixtral 8x22B. At launch it was competitive with GPT-4 on some benchmarks, though newer models have since surpassed it.

Strengths

+Good instruction following
+Competitive at launch
+Open weights

Weaknesses

-Superseded by newer models
-Based on older Mixtral
-Less maintained

Pricing

Per 1M tokens

Input$0.60

Output$0.60

Quick Facts

Context Window: 64K
Parameters: 141B (39B active)
Release Date: 2024-04-15
Category: Open Source

Compare Models

See how WizardLM 2 8x22B stacks up against other models