AerialDojo-200K: A Large-Scale Benchmark Suite for Open-World Aerial Object-Goal Search

Tongtong Feng1, Xin Wang1*, Haoran Hou1, Ren Wang1, Weiran Wang2, Shaokai Zhu3, Ziqi Jia1, Hao Wang1,
Yu-Wei Zhan4, Zongyuan Wu1, Jinghao Cui1, Wenwu Zhu1*

1Tsinghua University2University College Dublin3Peking University4Zhejiang University of Technology

Overview

Overview of AerialDojo-200K

Open-world aerial object-goal search is a foundational yet challenging task, requiring aerial agents to autonomously explore large-scale, unstructured three-dimensional environments and reach target objects specified by semantic descriptions or reference images, rather than following route-specific instructions. However, research in this task remains at a nascent stage and relies on small, environment-specific benchmarks with heterogeneous action spaces and data formats. These limitations hinder large-scale training and cross-benchmark evaluation, constraining the scalability and generalizability of aerial agents. To address this problem, we propose AerialDojo-200K:

  • Large-Scale

    AerialDojo-200K comprises 42 scenes across four scene families and 21 scene types, and 205,732 task instances spanning SemanticOGS and ImageOGS under Base, Standard, and Long-Horizon settings. AerialDojo-200K offers 3× as many scenes and 18.7× as many task instances as the largest prior benchmark for aerial object-goal search.

  • High-Quality

    AerialDojo-200K provides extensive manual annotations of 109 landmarks, 2,099 objects, and 2,099 object anchors, completed by 12 annotators over two months. AerialDojo-200K includes collision-free reference trajectories totaling 4,115.313 km of unique routes and 63,177 groups of multi-view recordings, recorded exclusively for training.

  • Unified Evaluation

    AerialDojo-200K unifies data formats, action spaces, and evaluation protocols, with 21 in-distribution and 21 out-of-distribution scenes. AerialDojo-200K evaluates nine multimodal large language models, revealing substantial challenges in reliable open-world aerial search.

Standard Operating Procedure

Standard operating procedure for constructing AerialDojo-200K.

Dataset Statistics

Simulator statistics
Task statistics

Task Composition

Task instances by family and setting

Train / Test Split

Training and test task instances in ID and OOD scenes

Mean Trajectory Length

Mean reference trajectory length by scene family

Unified Benchmark

Evaluation Framework

Unified benchmark framework

Sensors

Four onboard RGB-D cameras: front, left, right, and down

Action Space

Eight action types for four degrees of freedom
Prompt for AerialDojo-200K

Leaderboard

Base tasks · 3 m success radius

Download CSV ↓

Simulator

EarthquakeID · 0
EarthquakeOOD · 1
ExplosionID · 0
ExplosionOOD · 1
FloodID · 0
FloodOOD · 1
BridgeID · 0
BridgeOOD · 1
HarborID · 0
HarborOOD · 1
Rail corridorID · 0
Rail corridorOOD · 1
CoastID · 0
CoastOOD · 1
DesertID · 0
DesertOOD · 1
ForestID · 0
ForestOOD · 1
IslandID · 0
IslandOOD · 1
MountainID · 0
MountainOOD · 1
SnowfieldID · 0
SnowfieldOOD · 1
AlleyID · 0
AlleyOOD · 1
CommunityID · 0
CommunityOOD · 1
Construction siteID · 0
Construction siteOOD · 1
FactoryID · 0
FactoryOOD · 1
MallID · 0
MallOOD · 1
NeighborhoodID · 0
NeighborhoodOOD · 1
Amusement parkID · 0
Amusement parkOOD · 1
Parking lotID · 0
Parking lotOOD · 1
StadiumID · 0
StadiumOOD · 1

Citation

BibTeX

Download .bib
@misc{feng2026aerialdojo,
  title   = {AerialDojo-200K: A Large-Scale Benchmark Suite for Open-World Aerial Object-Goal Search},
  author  = {Feng, Tongtong and Wang, Xin and Hou, Haoran and Wang, Ren and
            Wang, Weiran and Zhu, Shaokai and Jia, Ziqi and Wang, Hao and
            Zhan, Yu-Wei and Wu, Zongyuan and Cui, Jinghao and Zhu, Wenwu},
  year    = {2026}
}