Built independently by an author, for readers. Read the story and support ChapterPal

keyword

high-resolution training

High-resolution training is a machine learning technique in which vision and multimodal models are trained or fine-tuned on visual data at elevated or dynamic pixel resolutions rather than low, fixed dimensions. In multimodal architectures and computer vision models, this approach allows neural networks to preserve and interpret fine-grained visual details, such as small text, dense diagrams, intricate textures, and localized spatial relationships. To manage the increased computational and memory demands of processing larger image inputs, high-resolution training is frequently implemented using dynamic image tiling, patch decomposition, or progressive training schedules where resolution is scaled up in later optimization stages. By exposing models to high-fidelity visual inputs, this process significantly improves performance on fine visual reasoning tasks, including optical character recognition, document parsing, visual grounding, and detailed scene comprehension.

1 item

Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling

Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling

Zhe Chen, Weiyun Wang, Yue Cao, Yang-Zhou Liu, Zhangwei Gao, Erfei Cui, Jinguo Zhu, Shenglong Ye, Hao Tian, Zhaoyang Liu, Lixin Gu, Xue-Hui Wang, Qing-Yun Li, Yi-Ming Ren, Zixuan Chen, Jia-Peng Luo, Jiahao Wang, Tan Jiang, Bo Wang, Conghui He, Botian Shi, Xingcheng Zhang, Han Lv, Yi Wang, Wenqi Shao, Pei Chu, Zhongying Tu, Tong He, Zhiyong Wu, Hui Deng, Jiaye Ge, Kaiming Chen, Min Dou, Lewei Lu, Xizhou Zhu, Tong Lu, Da-Hu Lin, Yunfeng Qiao, Jifeng Dai, Wenhai Wang

OrganizationsFudan UniversityNanjing UniversitySenseTimeShanghai Artificial Intelligence LaboratoryShanghai Jiao Tong UniversityThe Chinese University of Hong KongTsinghua University

Why you should read this

Introduces InternVL 2.5, an open-source multimodal model series that rivals proprietary systems like GPT-4o and becomes the first open-source model to exceed 70% on the MMMU benchmark through model, data, and test-time scaling strategies.

We introduce InternVL 2.5, an advanced multimodal large language model (MLLM) series that builds upon InternVL 2.0, maintaining its core model architecture while introducing significant enhancements in training and testing strategies as well as data quality. In this work, we delve into the relationship between model scaling and performance, systematically exploring the performance trends in vision encoders, language models, dataset sizes, and test-time configurations. Through extensive evaluations on a wide range of benchmarks, including multi-discipline reasoning, document understanding, multi-image / video understanding, real-world comprehension, multimodal hallucination detection, visual grounding, multilingual capabilities, and pure language processing, InternVL 2.5 exhibits competitive performance, rivaling leading commercial models such as GPT-4o and Claude-3.5-Sonnet. Notably, our model is the first open-source MLLMs to surpass 70% on the MMMU benchmark, achieving a 3.7-point improvement through Chain-of-Thought (CoT) reasoning and showcasing strong potential for test-time scaling. We hope this model contributes to the open-source community by setting new standards for developing and applying multimodal AI systems. HuggingFace demo see this https URL

Added

2026-09-24