GizStack
View .mdOpen in ChatGPTOpen in Claude

gizai/models/resplat/experiment

ReSplat worlds improved past the published model, kept for reuse and not in the catalog's path (gizai/models/resplat/family makes plain worlds). Measured on a room video (24 frames, 4 runs, held-out frames between them): each run fitted to its frames (fitted, 100 steps) gives 25.9 dB against 24.6; drawing a view from several runs (drawn) keeps that and leaves no hole or dark smear where the nearest run saw nothing.

gizlang
import * as Experiment from "gizai/models/resplat/experiment";

Functions

fitted

gizlang
function fitted(world: World, pictures: Tensor, views: Vec<View>, steps: i64, progress: (step: i64, total: i64) => bool = (step: i64, total: i64): bool => true): World

Each run of world fitted (gizai/render/fit, steps steps a run) to those of the pictures ([v, 3, H, W]) of views that it was made of, its cameras with it. The runs are not merged: runs of neighboring frames each make the surfaces they share, and their copies do not quite agree, so all of them drawn together lose to each run alone (17.9 dB against 24.6; 20.0 when each Gaussian stays only in the run with the nearest camera). progress hears each step of all the runs and may stop the fit.

Effects: fail, read, write, console, io, alloc.

order

gizlang
function order(world: World, view: View): Vec<i64>

The world's runs by how near they are to view, nearest first (World.nearest's score).

Effects: fail, read, write, alloc.

drawn

gizlang
function drawn(world: World, view: View, width: i64, height: i64, runs: i64 = 3): Tensor

The picture of the world seen from view ([height width, 3], as drawing gives it): its nearest run, where that run leaves the picture open the next runs behind it (up to runs), and what stays open filled from the colors around it (pullPush). A run fills only where a quarter or more of the background shows, fully from three quarters: a run is a little open at its edges and in thin parts, where the next run's copy of the same surface blurs it (0.2 dB).

Effects: fail, read, write, console, io, alloc.