GLM-5.3-Flash-BF16
GLM-5.3-Flash-BF16
z.ai 发布 GLM-5.3-Flash,为 GLM-5 系列首个原生多模态模型,总参数量 320B,激活参数 18B。该模型在 benchmark 和真实负载上优于 GLM-5.2,价格为其十分之一,编程和 agentic benchmark 接近 Claude Opus 4.8。其采用稀疏与线性注意力混合架构及 Manifold-Constrained Hyper-Connections (mHC),基于 30T token 多模态语料训练,支持 SGLang、vLLM、TokenSpeed、KTransformers 本地部署。
GLM-5.3-Flash-BF16
简介
我们推出 GLM-5.3-Flash,这是 GLM-5 系列中首个原生多模态模型。该模型总参数量为 320B,激活参数量仅为 18B,在 benchmark 和真实工作负载上的表现均优于 GLM-5.2,而价格仅为后者的十分之一,同时在编程和 agentic benchmark 上接近 Claude Opus 4.8。
GLM-5.3-Flash 基于新训练的基座模型,其架构和训练方案围绕能力与效率进行了重新设计。我们在 GLM 系列中首次引入了结合稀疏注意力和线性注意力的混合架构,在保持精确长上下文能力的同时,大幅降低了长上下文推理成本。该模型还采用了 Manifold-Constrained Hyper-Connections (mHC) 以进一步提升扩展效率。结合我们最新的 30T token 多模态预训练语料,这些改进使 GLM-5.3-Flash 能够以更少的计算量提供更强的智能。

本地部署 GLM-5.3-Flash
GLM-5.3-Flash 支持使用以下框架进行部署。欢迎尝试:
- SGLang — 参见 cookbook
- vLLM — 参见 recipes
- TokenSpeed — 参见 此处
- KTransformers — 参见 教程
脚注
- HLE w/ tools (完整集):我们使用
temperature=1.0和top_p=0.95的采样参数进行评估,最大生成长度为163,840个 token。评估在最大上下文长度为300,000个 token 的条件下进行,并采用上下文管理策略。我们使用 GPT-5.6-luna (medium) 作为评判模型。 - NL2Repo:我们在 1M 上下文下,以 temperature=1.0、top_p=1.0 和 max_new_tokens=64k 评估了 NL2Repo。为防止作弊,我们使用基于规则和基于 LLM 的判断来阻止恶意行为(例如,未经授权的 pip 或 curl 操作)。
- DeepSWE:我们使用 mini-swe-agent harness 运行 DeepSWE,参数为
temperature=0.95、top_p=1.0、timeout=6h和 400K 上下文。 - Terminal-Bench 2.1:我们在 Claude Code 2.1.207 中评估,参数为 temperature=1.0、top_p=1、max_new_tokens=65536,超时时间为 6 小时。
- Agent's Last Exam:
- Toolathlon Verified:我们通过官方评估服务获得所有结果,并报告 3 次独立运行的平均 pass@1。
- AutomationBench:我们在 AutomationBench v1.0.6 上进行评估,该版本包含了 PR #13 中引入的
null类型处理问题的修复。 - GDPval-AA v2:模型由 Artificial Analysis 评估。
- BabyVision:我们使用 temperature=1.0、top_p=0.95 和最大上下文长度 164K token。我们将输入图像的短边调整为至少 1.5K 像素,与其他基线保持一致。
引用
如果您觉得 GLM-5.3-Flash 对您的研究有用,请引用我们的技术报告:
@misc{glm5team2026glm5vibecodingagentic,
title={GLM-5: from Vibe Coding to Agentic Engineering},
author={GLM-5-Team and : and Aohan Zeng and Xin Lv and Zhenyu Hou and Zhengxiao Du and Qinkai Zheng and Bin Chen and Da Yin and Chendi Ge and Chenghua Huang and Chengxing Xie and Chenzheng Zhu and Congfeng Yin and Cunxiang Wang and Gengzheng Pan and Hao Zeng and Haoke Zhang and Haoran Wang and Huilong Chen and Jiajie Zhang and Jian Jiao and Jiaqi Guo and Jingsen Wang and Jingzhao Du and Jinzhu Wu and Kedong Wang and Lei Li and Lin Fan and Lucen Zhong and Mingdao Liu and Mingming Zhao and Pengfan Du and Qian Dong and Rui Lu and Shuang-Li and Shulin Cao and Song Liu and Ting Jiang and Xiaodong Chen and Xiaohan Zhang and Xuancheng Huang and Xuezhen Dong and Yabo Xu and Yao Wei and Yifan An and Yilin Niu and Yitong Zhu and Yuanhao Wen and Yukuo Cen and Yushi Bai and Zhongpei Qiao and Zihan Wang and Zikang Wang and Zilin Zhu and Ziqiang Liu and Zixuan Li and Bojie Wang and Bosi Wen and Can Huang and Changpeng Cai and Chao Yu and Chen Li and Chengwei Hu and Chenhui Zhang and Dan Zhang and Daoyan Lin and Dayong Yang and Di Wang and Ding Ai and Erle Zhu and Fangzhou Yi and Feiyu Chen and Guohong Wen and Hailong Sun and Haisha Zhao and Haiyi Hu and Hanchen Zhang and Hanrui Liu and Hanyu Zhang and Hao Peng and Hao Tai and Haobo Zhang and He Liu and Hongwei Wang and Hongxi Yan and Hongyu Ge and Huan Liu and Huanpeng Chu and Jia'ni Zhao and Jiachen Wang and Jiajing Zhao and Jiamin Ren and Jiapeng Wang and Jiaxin Zhang and Jiayi Gui and Jiayue Zhao and Jijie Li and Jing An and Jing Li and Jingwei Yuan and Jinhua Du and Jinxin Liu and Junkai Zhi and Junwen Duan and Kaiyue Zhou and Kangjian Wei and Ke Wang and Keyun Luo and Laiqiang Zhang and Leigang Sha and Liang Xu and Lindong Wu and Lintao Ding and Lu Chen and Minghao Li and Nianyi Lin and Pan Ta and Qiang Zou and Rongjun Song and Ruiqi Yang and Shangqing Tu and Shangtong Yang and Shaoxiang Wu and Shengyan Zhang and Shijie Li and Shuang Li and Shuyi Fan and Wei Qin and Wei Tian and Weining Zhang and Wenbo Yu and Wenjie Liang and Xiang Kuang and Xiangmeng Cheng and Xiangyang Li and Xiaoquan Yan and Xiaowei Hu and Xiaoying Ling and Xing Fan and Xingye Xia and Xinyuan Zhang and Xinze Zhang and Xirui Pan and Xu Zou and Xunkai Zhang and Yadi Liu and Yandong Wu and Yanfu Li and Yidong Wang and Yifan Zhu and Yijun Tan and Yilin Zhou and Yiming Pan and Ying Zhang and Yinpei Su and Yipeng Geng and Yong Yan and Yonglin Tan and Yuean Bi and Yuhan Shen and Yuhao Yang and Yujiang Li and Yunan Liu and Yunqing Wang and Yuntao Li and Yurong Wu and Yutao Zhang and Yuxi Duan and Yuxuan Zhang and Zezhen Liu and Zhengtao Jiang and Zhenhe Yan and Zheyu Zhang and Zhixiang Wei and Zhuo Chen and Zhuoer Feng and Zijun Yao and Ziwei Chai and Ziyuan Wang and Zuzhou Zhang and Bin Xu and Minlie Huang and Hongning Wang and Juanzi Li and Yuxiao Dong and Jie Tang},
year={2026},
eprint={2602.15763},
archivePrefix={arXiv},
primaryClass={cs.LG},
url={https://arxiv.org/abs/2602.15763},
}