SplatsThe evolution of media, in brief
RSS

Where the light fails, optical flow still beats the foundation models

Two rows of underwater reef photographs, each showing a raw teal-cast frame, a SeaSplat restoration and NemoSplat's restoration, in which the water's colour cast lifts and pink and orange coral becomes visible

Figure: Guo et al., HKUST / Beijing Institute of Technology · Research

Wen Jiang

Wen Jiang

Aug 26, 2026, 9:10 AM ET-Research

On Monday, a group led from Shanghai AI Laboratory posted AquaFlow, a streaming Gaussian splatting SLAM system for underwater video. The same day, a group at HKUST posted NemoSplat, a feed-forward 4D splatting model for the same setting. The two papers share a diagnosis, disagree completely about the cure, and independently arrive at the same uncomfortable result buried in their comparison tables.

Why it matters: Almost everything interesting in reconstruction over the past two years has been downstream of 3D vision foundation models — VGGT and its descendants, which estimate camera poses and dense geometry from uncalibrated images and made pose-free capture practical. They were trained on terrestrial imagery.

Water breaks the assumption underneath them. Light attenuates with distance and does so differently per wavelength, and suspended particles scatter it back into the camera. The result is that feature matching degrades exactly as range increases, and standard 3D Gaussian splatting — which assumes a clear medium — absorbs the attenuation into the colour of the primitives themselves, warping geometry to fit an optical effect.

Both papers name this. AquaFlow puts it as the clear-medium assumption breaking down; NemoSplat puts it as optical attenuation fatally corrupting feature aggregation. It is the same sentence written twice.

Two answers: AquaFlow takes the retraining route. Its authors assembled 224,273 image pairs from five public underwater datasets and fine-tuned a 3D vision foundation model on them, then built a streaming SLAM pipeline on top: medium-guided incremental Gaussian initialisation, and a hybrid representation pairing distance-conditioned neural Gaussians with an explicit physical model of underwater image formation. Training the geometry backbone took 16 RTX 4090s for 30 epochs.

NemoSplat takes the scaling route. It is a 1.22-billion-parameter feed-forward model that reconstructs directly from uncalibrated marine video in a single pass, with two purpose-built heads: a Promptable Dynamic Disentangler that isolates transient objects — fish, mostly — using learned dynamic probabilities plus optional text prompts, and a Media-Aware Gaussian Predictor that estimates water parameters jointly with Gaussian attributes. It was trained on a new dataset of 256 sequences and 155,000 frames, annotated for dynamics via a human-refined SAM3 and SAHI pipeline.

The papers do not benchmark against each other, and each declares state of the art on an evaluation set it assembled itself. This is not misconduct — they went up the same day — but it does mean the two headline claims are not commensurable, and nobody should read them as ranked.

By the numbers:

  • AquaFlow evaluates on 62 trajectories: 25 from public benchmarks, 37 from in-the-wild web video. It reports 34.53 dB on FLSea Canyons against 29.33 for WaterSplat-SLAM, and 36.31 dB on UW-Stereo-VI.
  • It loses on SeaThru-NeRF — 24.83 dB against the offline UW-GS at 25.79 — and says why: those scenes contain about twenty images each, and offline methods overfit small benchmarks. Naming your own losing column is not common.
  • NemoSplat reports 21.58 dB, 0.68 SSIM and 0.26 LPIPS averaged over 14 real aquatic sequences, against 19.22 / 0.60 / 0.42 for AnySplat — a 2.36 dB margin and a 36.6% relative LPIPS reduction against WildGS-SLAM.
  • On its synthetic set NemoSplat averages 1.88 m absolute trajectory error, ahead of VGGT at 2.12 m and StreamVGGT at 2.06 m. One competing feed-forward method, YoNoSplat, simply ran out of memory on the deep-water sequences.
  • The cost of AquaFlow's quality is primitives. On Canyons it renders 610,500 Gaussians where WaterSplat-SLAM uses 13,800 — a factor of 44 — and its throughput is 1.08 frames per second. "Streaming" here means incremental and online, not real time.

Yes, but: Now the tables neither paper leads with. In AquaFlow's localisation results, DROID-SLAM — optical flow, no underwater adaptation, no foundation model — records 0.069 m of trajectory error on the S-UW scenes against AquaFlow's 0.211, and beats it again on RedSea at 0.737 against 0.958. Two of six datasets go to the method that knows nothing about water.

NemoSplat's version is starker. On the Deepsea sequences it posts 4.85 m of trajectory error; Droid-W posts 0.78 and WildGS-SLAM 0.81. That is a sixfold gap, on the hardest scenes in its own benchmark.

To their credit, the NemoSplat authors go and explain it rather than leaving it in a table. In light-deprived water, they write, the pre-trained image encoders of feed-forward architectures fail to extract reliable semantic features, while optical-flow methods can still capitalise on raw inter-frame pixel variation. They also note the inverse: on the Coral sequences, with large inter-frame motion and wide fields of view, optical flow loses its pixel associations and the learned priors win.

That is a clean statement of a real boundary. A learned encoder needs something recognisable in the frame. Optical flow needs only that the frame changed. When the water takes away the first and leaves the second, the older method is the better one.

The big picture: The field has spent two years treating pose-free foundation models as strictly dominant — a component you drop in and stop worrying about. Two independent groups, working the same week on the same medium, have now published evidence that the dominance is conditional on the scene containing enough light to have semantics in it.

For underwater work specifically that is a scheduling problem rather than a research one: shallow reef surveys and deep-water inspection are different regimes and probably want different trackers. The more general point is that the failure was legible only because both papers ran the old baselines and printed the results. Drop DROID from the comparison table, as a paper reasonably might in 2026, and the boundary disappears.

Go deeper:

  • AquaFlow: A Monocular Gaussian Splatting SLAM for Underwater Streaming Reconstruction
  • NemoSplat: Feed-Forward 4D Gaussian Splatting for Media-Aware Underwater Reconstruction
  • NemoSplat project page
⟵ Back to the brief

More stories

The Tanks and Temples Truck scene — a pale blue vintage flatbed pickup parked on a pavement — rendered sharply inside the Splat.js browser interface, with a readout showing 579,748 splats and a Train button in the toolbar

Arrival.Space gave away the browser version of what it sells

Just now

A soft, hazy Gaussian splat render of San Francisco seen from Telegraph Hill, with Coit Tower rising in the centre of the frame and the downtown skyline behind it

The framework under deck.gl just shipped a Gaussian splat renderer

3 hours ago

A grid comparing a reconstructed electric fan at t = -0.5, 0, 0.5, 1.0 and 3.0. The upper row, from conventional dynamic splatting, is marked unavailable at negative time and shows a smeared, collapsing fan at t = 3.0. The lower row, from LagrangeGS, renders the fan cleanly at every timestep with orange arcs marking particle velocity, and adds a physics-editing column

These dynamic splats run backwards, and the round trip loses 1.3%

10 hours ago

Three grayscale novel views of the International Space Station's Kibō module — a stowage corridor, an airlock hatch and a crew workstation — above their corresponding rainbow-coloured depth maps

A free-flyer rebuilt the ISS interior from photos it took five years ago

Yesterday

splats

Short daily briefs on the evolution of media — gaussian splats, volumetric video, dome theaters, headsets, and the research underneath.

Newsroom

  • Latest
  • All stories
  • RSS feed
© 2026 Splats · Terms · Privacy