Models

GLM-5.2 Benchmarks: Scores, Sources and Caveats

Checked 2026-10-31

Loading poll...

GLM-5.2, Z.ai's June 2026 flagship, scores 62.1 on SWE-bench Pro, 81.0 on Terminal Bench 2.1 with Terminus-2 (82.7 with the best harness), 46.2 on DeepSWE and 91.2 on GPQA-Diamond, all reported by Z.ai on its own model card. The weights are MIT-licensed with a 1M context. GLM-5.3 has since replaced it as the flagship. Checked 31 October 2026.

Where these numbers come from

Every figure on this page is vendor-reported. The main source is the GLM-5.2 model card on Hugging Face, published 16 June 2026. Where we quote a later number we name the card: the GLM-5.3 card, DeepSeek's V4 Pro card or Moonshot's Kimi K3 card, each of which lists GLM-5.2 as a competitor. We have not reproduced any score, and we did not find an independent leaderboard covering all of these tests.

The card's closed-model columns carry the same caveat. Z.ai marks results with an asterisk where they come from the full set of a benchmark rather than a text-only subset, and it chose which settings to run for rivals.

The full table from Z.ai's GLM-5.2 card

Reasoning

Benchmark

GLM-5.2

GLM-5.1

Qwen3.7-Max

MiniMax M3

DeepSeek-V4-Pro

Claude Opus 4.8

GPT-5.5

Gemini 3.1 Pro

HLE

40.5

31

41.4

37

37.7

49.8*

41.4*

45

HLE (with tools)

54.7

52.3

53.5

not reported

48.2

57.9*

52.2*

51.4*

CritPt

20.9

4.6

13.4

3.7

12.9

20.9

27.1

17.7

AIME 2026

99.2

95.3

97

not reported

94.6

95.7

98.3

98.2

HMMT Nov 2025

94.4

94

95

84.4

94.4

96.5

96.5

94.8

HMMT Feb 2026

92.5

82.6

97.1

84.4

95.2

96.7

96.7

87.3

IMOAnswerBench

91.0

83.8

90

not reported

89.8

83.5

not reported

81

GPQA-Diamond

91.2

86.2

90

93

90.1

93.6

93.6

94.3

Coding

Benchmark

GLM-5.2

GLM-5.1

Qwen3.7-Max

MiniMax M3

DeepSeek-V4-Pro

Claude Opus 4.8

GPT-5.5

Gemini 3.1 Pro

SWE-bench Pro

62.1

58.4

60.6

59

55.4

69.2

58.6

54.2

NL2Repo

48.9

42.7

47.2

42.1

35.5

69.7

50.7

33.4

DeepSWE

46.2

18

18

20

8

58

70

10

ProgramBench

63.7

50.9

not reported

not reported

47.8

71.9

70.8

39.5

Terminal Bench 2.1 (Terminus-2)

81.0

63.5

75

65

64

85

84

74

Terminal Bench 2.1 (best reported harness)

82.7

69

not reported

not reported

not reported

78.9

83.4

70.7

FrontierSWE (dominance)

74.4

30.5

not reported

not reported

29.0

75.1

72.6

39.6

PostTrainBench

34.3

20.1

not reported

not reported

not reported

37.2

28.4

21.6

SWE-Marathon

13.0

1.0

not reported

not reported

not reported

26.0

12.0

4.0

Agentic

Benchmark

GLM-5.2

GLM-5.1

Qwen3.7-Max

MiniMax M3

DeepSeek-V4-Pro

Claude Opus 4.8

GPT-5.5

Gemini 3.1 Pro

MCP-Atlas (public set)

76.8

71.8

76.4

74.2

73.6

77.8

75.3

69.2

Tool-Decathlon

48.2

40.7

not reported

not reported

52.8

59.9

55.6

48.8

How to read the table

The jump from 5.1 to 5.2 is large. DeepSWE moved from 18 to 46.2, Terminal Bench 2.1 with Terminus-2 from 63.5 to 81.0, and FrontierSWE from 30.5 to 74.4. Those are the rows where Z.ai's long-horizon training should show, and they do.

GLM-5.2 led the open models on those rows at the time. On the card's own columns, it beats DeepSeek-V4-Pro and Qwen3.7-Max on SWE-bench Pro, NL2Repo, DeepSWE and Terminal Bench. It trails Claude Opus 4.8 on SWE-bench Pro (62.1 against 69.2), NL2Repo (48.9 against 69.7) and DeepSWE (46.2 against 58). On math it is close to or ahead of the closed models: AIME 2026 at 99.2 beats the 98.3 listed for GPT-5.5.

It is behind on tool-heavy tasks. On Tool-Decathlon GLM-5.2 is 48.2 against 52.8 for DeepSeek-V4-Pro and 59.9 for Opus 4.8.

Open-weights-only rivals are mixed. On GPQA-Diamond, MiniMax M3 is listed at 93 against GLM-5.2's 91.2, and on HMMT Feb 2026 Qwen3.7-Max is at 97.1 against 92.5.

How the tests were run

The card's footnotes are the part worth reading, because settings change scores. A summary of the stated conditions:

Test

Stated conditions

HLE and other reasoning tasks

temperature 1.0, top_p 0.95, max generation 163,840 tokens; text-only subset by default

SWE-bench Pro

OpenHands, a tailored instruction prompt, temperature 1, top_p 1, 32K max new tokens, 400K context

NL2Repo

temperature 1.0, 48K max new tokens, 400K context, rule-based and LLM-based checks against cheating such as unauthorised pip or curl

DeepSWE

Official pier framework, mini-swe-agent harness, 2-hour timeout, 400K context, isolated container with 2 CPUs and 8 GB RAM, no internet

ProgramBench

Claude Code 2.1.156, 200 instances, 64K max tokens, up to 2,000 turns, max reasoning effort, 400K context, 4 CPUs and 8 GB RAM, no internet

Terminal Bench 2.1 (Terminus-2)

JSON parser, 4-hour timeout, 48K max new tokens, 256K context, 4 CPUs and 8 GB RAM

Terminal Bench 2.1 (Claude Code)

Claude Code 2.1.167, 131,072 max new tokens via a proxy that bypasses the CLI's 64K cap

MCP-Atlas

Think mode, 500-task public subset, 10-minute timeout, Gemini-3.0-Pro as judge

Tool-Decathlon

Official evaluation service, 128K max tokens

FrontierSWE, PostTrainBench, SWE-Marathon

Run by outside groups (Proximal, PostTrainBench, Abundant AI) at 1M context, max effort and 128K max output

Two things stand out. First, the 400K context windows on several coding tests are well under the 1M the model supports, so the card's coding numbers do not test the full window. Second, three of the rows (FrontierSWE, PostTrainBench and SWE-Marathon) were run by outside groups, which is closer to an independent result than the rest, although Z.ai still reports them.

How the numbers moved later

Scores for the same model change between cards because benchmarks update and harnesses differ. Comparing GLM-5.2's figures across three later cards shows how soft they are.

Benchmark

GLM-5.2 card (June)

GLM-5.3 card (August)

Notes

Terminal Bench 2.1

81.0 (Terminus-2), 82.7 (best)

81.0

The later card prints the Terminus-2 figure

DeepSWE

46.2

46.2 (v1.1)

Stable

NL2Repo

48.9

48.9

Stable

HLE with tools

54.7

54.7

Stable

ProgramBench

63.7

9.5 ("almost solved" reading)

Different metric; the Kimi K3 card also prints 63.7

FrontierSWE

74.4 (as of 16 June)

67.5 (as of 14 August)

Leaderboard moved

SWE-Marathon

13.0

19.4 (v1.1)

Benchmark version changed

PostTrainBench

34.3

31.7

Rerun

DeepSeek's V4-Pro card also lists GLM-5.2, giving 81.0 on Terminal Bench 2.1, 46.2 on DeepSWE and 54.7 on HLE with tools, which match. Its NL2Repo figure for GLM-5.2 is 48.9, matching again. The rows that moved are the ones with live leaderboards or revised metrics. For decisions, use the stable rows and do not mix rows from different dates.

What GLM-5.2 is, besides a score

The card describes GLM-5.2 as "our latest flagship model for long-horizon tasks", the first GLM with what Z.ai calls a solid 1M-token context. Other documented features:

  • Flexible thinking effort. Multiple levels to trade latency for quality.
  • IndexShare. A technique that reuses the same indexer across every four sparse-attention layers, which Z.ai says cuts per-token compute 2.9 times at 1M context.
  • Better multi-token prediction. Z.ai says the speculative decoding acceptance length improved by up to 20 percent.
  • MIT licence. "No regional limits", in Z.ai's phrase.

It is a text-only model, as is GLM-5.3, which shares its base. Its weights are about 753 billion parameters, so it needs a multi-GPU server. The serving versions listed on the card were SGLang 0.5.13.post1 or later, vLLM 0.23.0 or later, Transformers, KTransformers and Unsloth, plus Ascend NPU frameworks.

What Z.ai's developer docs add

Z.ai's GLM-5.2 documentation page repeats the card's headline numbers and adds claims in prose. It says GLM-5.2 is the strongest open-source model on standard coding benchmarks and, on Terminal-Bench 2.1, lands "within a few points of Claude Opus 4.8" at 81.0 against 85.0. It says that on FrontierSWE, PostTrainBench and SWE-Marathon the model is the highest-ranked open-source one, trailing Opus 4.8 by about one percent on FrontierSWE, and ahead of GPT-5.5 and Opus 4.7 on several tests.

One detail does not line up. The docs page gives GLM-5.1's Terminal-Bench 2.1 score as 62.0, while the model card's table shows 63.5. A 1.5-point difference between two pages from the same maker is small, and probably reflects an update to one of them, but it is a reminder to cite the page and date with any score. The docs also pitch practical examples: a level-based mini game, reproducing a research paper as runnable PyTorch, and a code-to-video loop using Remotion. Those are demonstrations, not measurements.

The gap to closed models, in points

Subtracting within the GLM-5.2 card gives a plain picture of where the model stood in June against the closed models Z.ai chose to list. These are our subtractions of vendor figures.

Benchmark

GLM-5.2

Best closed model in the card

Gap

SWE-bench Pro

62.1

69.2 (Opus 4.8)

7.1 behind

NL2Repo

48.9

69.7 (Opus 4.8)

20.8 behind

DeepSWE

46.2

70 (GPT-5.5)

23.8 behind

Terminal Bench 2.1 (Terminus-2)

81.0

85 (Opus 4.8)

4.0 behind

Terminal Bench 2.1 (best harness)

82.7

83.4 (GPT-5.5)

0.7 behind

FrontierSWE

74.4

75.1 (Opus 4.8)

0.7 behind

MCP-Atlas

76.8

77.8 (Opus 4.8)

1.0 behind

AIME 2026

99.2

98.3 (GPT-5.5)

0.9 ahead

IMOAnswerBench

91.0

83.5 (Opus 4.8)

7.5 ahead

The pattern is consistent. GLM-5.2 was close or ahead on math and on long-horizon and terminal tasks, and well behind on repository-scale tests such as NL2Repo and DeepSWE. If your work is single-repository feature building, the repository rows matter most to you. If your work is long autonomous terminal sessions, the terminal and FrontierSWE rows matter more.

A test plan that does not need benchmarks

If you are deciding whether GLM-5.2 or its successor suits your work, a day of testing says more than any table.

  1. Choose 15 to 20 real tasks from your own history. Include some that failed before: flaky tests, an awkward refactor, a bug with a long trace.
  2. Run each task through the same agent with GLM-5.3 and one other candidate, at the same effort level. GLM models default to max effort unless you set it, so state the level on both sides.
  3. Record pass or fail, wall-clock time, output tokens and cost per task. Cost per passed task is the figure to compare.
  4. Repeat each task at least twice. Agent runs vary.
  5. Keep a closed model as a baseline if your policy allows it.

You can run this through Z.ai's API or the Coding Plan with an agent such as Claude Code, OpenCode or Cline. The cost side is simple arithmetic from the prices above: at $1.40 and $4.40 per million tokens, a run of 3 million input and 300,000 output tokens costs $5.52 before cache discounts.

Prices and access today

GLM-5.2 is still on Z.ai's API at $1.40 input and $4.40 output per million tokens, with cached input at $0.26, the same as GLM-5.3. On the Coding Plan, requests for GLM-5.2 are routed to GLM-5.3. The weights stay on Hugging Face under MIT, so self-hosting a frozen GLM-5.2 remains possible for anyone who needs a fixed model.

See GLM models for the current lineup, the Coding Plan and the GLM-5.3 scores, and best open source LLM for coding for the cross-lab view.

Should anyone still pick GLM-5.2?

Situation

Answer

Starting a new project on Z.ai

Use GLM-5.3 at the same API price

Self-hosting and already running 5.2

Keep it until you have tested 5.3 on your tasks

Needing a pinned, never-changing model

5.2 weights under MIT are fine for that

Comparing older benchmark results

Use the 5.2 card, and note the harness and date

Needing images

Neither; use GLM-5.3-Flash

Checklist for reading any GLM benchmark claim

  1. Find the harness. Claude Code, OpenHands, Terminus-2 and mini-swe-agent give different numbers on the same model.
  2. Find the effort level. GLM models default to max when unspecified.
  3. Find the context length used. Several coding tests ran at 400K, not 1M.
  4. Check who ran it. Maker-run, outside-run and leaderboard results are different grades of evidence.
  5. Check the benchmark version and date. Terminal Bench 2.1, 3.0 and 4.0 are different tests.
  6. Rerun a sample on your own repository before you trust it.

Our take

GLM-5.2's card is a good example of a well-documented vendor table: full footnotes, stated harnesses and a few results from outside groups. It also shows why we call these figures a shortlist. The same model scores 63.7 or 9.5 on ProgramBench depending on which metric a card prints. The practical advice is simple: read GLM-5.2's scores as a snapshot of June 2026, move to GLM-5.3 for new work, and always rerun two or three candidates on your own tasks. For other families see DeepSeek, Kimi and Qwen.

Product names are used descriptively. We are not affiliated with Z.ai.

Questions

What is GLM-5.2's SWE-bench Pro score?

Z.ai's model card reports 62.1 for GLM-5.2 on SWE-bench Pro, run with OpenHands at a 400K context window. That is vendor-reported.

What is GLM-5.2's Terminal Bench 2.1 score?

81.0 with the Terminus-2 framework and 82.7 for the best reported harness, according to Z.ai's card.

Is GLM-5.2 open source?

Its weights are MIT-licensed on Hugging Face, with a 1M-token context window.

Has GLM-5.2 been replaced?

GLM-5.3 followed on 25 August 2026 using the same base with new post-training. On Z.ai's Coding Plan, requests for GLM-5.2 are routed to GLM-5.3.

Loading poll...

Sources

  1. huggingface.co/zai-org/GLM-5.2
  2. huggingface.co/zai-org/GLM-5.3
  3. huggingface.co/deepseek-ai/DeepSeek-V4-Pro-0813
  4. huggingface.co/moonshotai/Kimi-K3
  5. docs.z.ai/guides/llm/glm-5.2
  6. docs.z.ai/guides/overview/pricing

Part of the Wbcom Designs family

The all-in-one WordPress community stack

Also ours: wbcomdesigns.comvapvarun.combrndle.com