All projects
Multi-Agent Reinforcement LearningUC Berkeley MIDS Capstone · Simulation & MARL/2026

OmniSearch

A simulation platform for testing coordinated drone and ground-robot swarms in wildfire search-and-rescue.

The browser trajectory viewer — 4 UAVs, 3 UGVs, 10 survivors on 1 km² of real Malibu Creek terrain.

Wildfire search-and-rescue teams cannot afford to discover coordination failures in the field. OmniSearch pairs a physically scaled wildfire simulator with heterogeneous multi-agent RL so drone + ground-robot deployments can be designed, stress-tested, and tuned before anyone flies.

80%
Mission success
vs. 72% ant-colony and 68% lawnmower, 100 seeds each
10.1 min
Time to confirm a survivor
down from 11.8 min — roughly 10% faster
90%
Comms loss tolerated
policies stay functional under near-total dropout
~$200k
Cost avoided
per multi-day ground search that never has to happen

The problem

Wildfires claim hundreds of lives every year, and the link between air and ground assets falls apart exactly when conditions get worst — smoke, heat, terrain, and radio dropout all peak at the same moment.

Existing simulators do not model realistic terrain, fire dynamics, and rescue mission parameters together. That pushes robotics companies into expensive field trials, where a coordination failure is not a failed test run — it is a life at risk.

The simulator

OmniSearch is a 2.5D mission simulator built on VMAS. Robots move continuously in the plane; fire, smoke, land cover, elevation, slope, fuel, and inspection confidence live on raster layers; UAV altitude is tracked as an above-ground scalar with a terrain-following controller.

Terrain comes from cached USGS elevation and OpenStreetMap features, and every quantity is expressed in physical units — meters, meters per second, minutes — so results map onto real hardware envelopes instead of arbitrary grid steps.

It is deliberately not a digital twin. The goal is to preserve the mission-relevant structure of wildfire SAR while staying fast enough to actually train on.

Learned coordination

UAVs scout from above; UGVs traverse terrain to confirm on the ground. The research question is whether a learned policy can manage that handoff better than a strong hand-written strategy.

Training uses HAPPO, where each agent type learns its own policy with sequential trust-region updates rather than sharing one homogeneous network. Aerial agents optimize for coverage and detection probability; ground agents optimize for reachability and confirmation. MAPPO and IPPO are kept as controlled comparisons.

Perception during training is a probabilistic detection model — the chance a survivor at a given location would be seen, conditioned on altitude, camera footprint, range, land cover, smoke, and fire. The same probability drives both survivor scouting and the confidence map, so a policy is rewarded for real expected information gain rather than for touching new cells.

Baselines are not strawmen: lawnmower, ant-colony, highest-confidence targeting, and random walk, each with a matched planner-aware ground controller.

What we found

Learned heterogeneous coordination beat every scripted baseline — 80% full-confirmation success against 72% for ant-colony and 68% for lawnmower over 100 held-out seeds, with survivors confirmed roughly 10% faster.

The more interesting result was robustness. The scripted baselines lose ~14 points of success the moment communication becomes unreliable at all; the trained policy holds near its ceiling through 70% dropout and only degrades at 90%. Each role had learned behavior that stays coherent without a live picture of its teammates.

The learned advantage is in the handoff, not in raw coverage — lawnmower achieves 100% area coverage and still loses, because covering ground is not the same as getting a ground robot to the right person in time.

Perception, validated on real imagery

The detection stack was trained on synthetic composites and then evaluated against real datasets rather than only its own validation split — HERIDAL aerial SAR imagery, HIT-UAV thermal, and ground-level footage from Malibu.

On HERIDAL the fine-tuned detector reaches 0.86 recall at 0.50 precision, and the small-target breakdown is reported honestly by pixel bucket: survivors under 8 px are where recall falls off, which is exactly the regime that sets a usable flight altitude.

Ethics and scope

The reward function treats all survivors equally, with no demographic weighting. The detection model recognizes presence only — it does not identify or track individuals, and it is trained on synthetic imagery.

OmniSearch is advisory. Incident commanders retain decision authority; the platform's job is to make failure modes visible in simulation, not to direct a live response.

Watch a mission run

A full episode replayed in the 3D viewer — blue quadrotors sweeping 1 km² of Malibu Creek terrain while ground robots route between survivors and the fire front advances from the ridge. Ring colors mark each survivor's detection state; flight paths trail behind each agent.
Mission success under communication dropout

Full-confirmation success rate, 100 held-out seeds per point. 4 UAVs · 3 UGVs · 1 km² Malibu Creek terrain.

40%50%60%70%80%90%0%30%50%70%90%communication dropout
HAPPO (learned)
Ant colony
Lawnmower

Evaluation setup

Search area
1 km² of real terrain (Malibu Creek)
Fleet
4 UAVs · 3 UGVs · 5–10 survivors
Raster grid
256 × 256 (≈3.9 m cells)
Episode
900 steps @ 2 s = 30 min simulated
Evaluation
100 held-out seeds per configuration
Perception
RGB + thermal stack, altitude-conditioned

System architecture

Real terrain feeds a 12,600-line MARL simulator; rollouts are scored through a calibrated perception model.

Data sources

USGS 3DEP
  • elevation
  • slope
  • altitude
OpenStreetMap
  • roads
  • water
  • buildings
LANDFIRE
  • fuel model
  • canopy cover

Simulation platform — VMAS WildfireSearchScenario

Simulation core
  • Cellular-automata fire + smoke
  • 6 land-cover types
  • 128² / 256² grid
  • 1 km², calibrated m/s, 2 s step
  • 3–4 UAVs (10 m/s, 20–50 m AGL)
  • 2–3 UGVs (1.6 m/s, terrain cost)
Coordination (MARL)
  • HAPPO (HARL) — primary
  • BC warm-start + RL fine-tune
  • DAgger imitation learning
  • MAPPO / IPPO (BenchMARL)
  • 6 hand-coded baselines
  • Centralized critic, dec. execution
Perception model
  • Probabilistic detection proxy
  • Altitude-dependent footprint
  • Smoke attenuation (Beer–Lambert)
  • RGB + thermal fusion
  • Per-agent comms dropout (0–80%)
  • Decoy false-positive landmarks

Evaluation & output

6 mission metrics
  • recall
  • verification time
  • FP trips
  • hazard
  • travel cost
  • DRR
Experiment harness
  • 3 algos × 4 dropouts × N seeds
  • Mann–Whitney U
  • 510-run EDA
Three.js 3D viewer
  • trajectory replay
  • per-agent comms
  • strategy comparison

Stack

PythonPyTorchVMASHARL / HAPPOBenchMARLMAPPOIPPODAggerYOLOv8OpenCVUSGS 3DEPOpenStreetMapLANDFIREThree.js

Team

  • Ann-Kathrin Schuetz
  • Jefferson-Stanley Jules
  • Oleksii Lavrenin