One-Step Volumetric PIV via Gaussian Splatting and Photometric Warping

Summary

Differentiable pipeline for calibration, particle-density reconstruction, and Eulerian velocity estimation from multi-camera particle images.

One-Step Volumetric PIV via Gaussian Splatting and Photometric Warping
One-Step Volumetric PIV via Gaussian Splatting and Photometric Warping

Overview

This project develops an end-to-end differentiable formulation for volumetric PIV that jointly estimates camera mapping refinements, a continuous 3D particle-density field, and an Eulerian velocity field. The particle density is represented as a sum of Gaussian kernels that can be rendered analytically to each camera view using Gaussian splatting.

The objective combines image-reprojection losses with a short-time advection consistency term implemented through photometric warping in 3D. The formulation includes an optical blur model through learned screen-space covariance terms and can incorporate calibration images without explicit feature correspondences.

Collaborators

PSL Partners

Eli Lilly

Scientific Machine Learning & AI for Engineering

Join Prof. Bilionis’ Substack community for deep dives into uncertainty quantification, AI-driven simulations, and the latest laboratory updates.

Ilias Bilionis