gizai/models/resplat/family
ReSplat in the catalog as a 3D model of a place: a video that moves through it (or around it) to a world of 3D Gaussians. Pi3X poses the video's frames in one pass; ReSplat makes Gaussians of runs of neighboring frames (gizai/models/resplat/model's World), written as one PLY file.
import * as Family from "gizai/models/resplat/family";Types
Choices
type Choices = { frames: i64; each: i64; steps: i64; group: i64; stride: i64; }How a world is made of a video: the frames taken (spread over it), Pi3X's pixels a frame at most, ReSplat's rounds
of refinement, and its runs (views a run, a new run every stride views).
frames:i64each:i64steps:i64group:i64stride:i64
Posed
type Posed = { pictures: Tensor; views: Vec<ReSplat.View>; }Frames of a video at ReSplat's size ([n, 3, H, W], 0 to 1, on the model's GPU) and their views.
pictures:_gizlang_lib_ai__tensor__storage.Tensor<f32>views:Vec<M56.View>
Functions
family
function family(): FamilyReSplat's entry in the catalog, a 3D model of a place.
Effects: fail, alloc.
choices
function choices(): ChoicesThe choices a world is made with by default.
worldOfVideo
function worldOfVideo(m: ReSplat.Model, poser: Pi3.Model, ask: ObjectAsk, progress: (stage: string, step: i64, total: i64) => bool, c: Choices = choices()): ReSplat.World throws stringThe world of the video ask.video (c; ask.steps, when not 0, the rounds of refinement).
Effects: fail, read, write, console, io, alloc.
posed
function posed(m: ReSplat.Model, poser: Pi3.Model, path: string, frames: i64, each: i64, progress: (stage: string, step: i64, total: i64) => bool): Posed throws stringframes frames spread over the video at path, posed by Pi3X in one pass (at most each pixels a frame) and
aligned to the middle one, as ReSplat's own pipeline does.
Effects: fail, read, write, console, io, alloc.