GizStack
View .mdOpen in ChatGPTOpen in Claude

gizai/models/resplat/family

ReSplat in the catalog as a 3D model of a place: a video that moves through it (or around it) to a world of 3D Gaussians. Pi3X poses the video's frames in one pass; ReSplat makes Gaussians of runs of neighboring frames (gizai/models/resplat/model's World), written as one PLY file.

gizlang
import * as Family from "gizai/models/resplat/family";

Types

Choices

gizlang
type Choices = { frames: i64; each: i64; steps: i64; group: i64; stride: i64; }

How a world is made of a video: the frames taken (spread over it), Pi3X's pixels a frame at most, ReSplat's rounds of refinement, and its runs (views a run, a new run every stride views).

  • frames: i64
  • each: i64
  • steps: i64
  • group: i64
  • stride: i64

Posed

gizlang
type Posed = { pictures: Tensor; views: Vec<ReSplat.View>; }

Frames of a video at ReSplat's size ([n, 3, H, W], 0 to 1, on the model's GPU) and their views.

  • pictures: _gizlang_lib_ai__tensor__storage.Tensor<f32>
  • views: Vec<M56.View>

Functions

family

gizlang
function family(): Family

ReSplat's entry in the catalog, a 3D model of a place.

Effects: fail, alloc.

choices

gizlang
function choices(): Choices

The choices a world is made with by default.

worldOfVideo

gizlang
function worldOfVideo(m: ReSplat.Model, poser: Pi3.Model, ask: ObjectAsk, progress: (stage: string, step: i64, total: i64) => bool, c: Choices = choices()): ReSplat.World throws string

The world of the video ask.video (c; ask.steps, when not 0, the rounds of refinement).

Effects: fail, read, write, console, io, alloc.

posed

gizlang
function posed(m: ReSplat.Model, poser: Pi3.Model, path: string, frames: i64, each: i64, progress: (stage: string, step: i64, total: i64) => bool): Posed throws string

frames frames spread over the video at path, posed by Pi3X in one pass (at most each pixels a frame) and aligned to the middle one, as ReSplat's own pipeline does.

Effects: fail, read, write, console, io, alloc.