360° Image Perception with MLLMs:
A Comprehensive Benchmark and
a Training-Free Method

1 Department of System Information Sciences
Graduate School of Information Sciences, Tohoku University, Japan
2 RIKEN Center for AIP
{tran,quang,farrosalferro,kjliu,okatani}@vision.is.tohoku.ac.jp
ECCV 2026

Abstract

Multimodal Large Language Models (MLLMs) have shown impressive abilities in understanding and reasoning over conventional images. However, their perception of 360° images remains largely underexplored. Unlike conventional images, 360° images capture the entire surrounding environment, enabling holistic spatial reasoning but introducing challenges such as geometric distortion and complex spatial relations. To comprehensively assess MLLMs' capabilities to perceive 360° images, we introduce 360Bench, a Visual Question Answering (VQA) benchmark featuring 7K-resolution 360° images, seven representative (sub)tasks with annotations carefully curated by human annotators. Using 360Bench, we systematically evaluate seven MLLMs and six enhancement methods, revealing their shortcomings in 360° image perception. To address these challenges, we propose Free360, a training-free scene-graph-based framework for high-resolution 360° VQA. Free360 decomposes the reasoning process into modular steps, applies adaptive spherical image transformations to 360° images tailored to each step, and seamlessly integrates the resulting information into a unified graph representation for answer generation. Experiments show that Free360 consistently improves its base MLLM and provides a strong training-free solution for 360° VQA tasks.

BibTeX

@article{360BenchFree360,
  title={360° Image Perception with MLLMs: A Comprehensive Benchmark and a Training-Free Method},
  author={Huyen. T. T. Tran, Van-Quang Nguyen, Farros Alferro, Kang-Jun Liu, and Takayuki Okatani},
  journal={ECCV},
  year={2026}
}

References

  1. Insta360: Professional 360 VR Camera. https://www.insta360.com/product/insta360-pro2. Accessed: 2025-06-20.
  2. hapePHOTOGRAPHIX: 360° Image. https://www.flickr.com/photos/hapephotographix/. Credit: hapePHOTOGRAPHIX (https://www.hapephotographix.com). Accessed: 2025-07-08.
  3. NOIRLab: 360 Panorama. https://noirlab.edu/public/images/archive/category/360pano/. Accessed: 2025-06-20.