GizStackGizStack
View .mdOpen in ChatGPTOpen in Claude

gizai/tasks/motion

a person's motion from words, by NVIDIA's ARDY (gizai/models/ardy/model) with its LLM2Vec text encoder (gizai/models/ardy/text): many people move in one batch, two seconds a window, each window after the motion so far, so a game changes a person's words or goals as it plays. A motion is a take of SOMA's 30 joints (gizlang/motion) that moves onto any humanoid (gizlang/retarget).

gizlang
import * as Motion from "gizai/tasks/motion";

Types

Mover

gizlang
type Mover = { ardy: Ardy.Ardy; text: Text.Text; }

ARDY and its text encoder on one GPU.

  • ardy: M79.Ardy
  • text: M80.Text

Functions

mover

gizlang
function mover(hub: Hub.Hub, gpu: Gpu): Mover throws string

ARDY and its text encoder from hub (downloaded and converted once) on gpu.

Effects: fail, read, write, console, io, alloc.

Methods

Mover.people

gizlang
function Mover.people(self: mut Mover, prompts: Vec<string>): Ardy.People throws string

People who move as prompts say, one each, facing +z at the origin.

Effects: fail, read, write, console, io, alloc.

Mover.takes

gizlang
function Mover.takes(self: mut Mover, prompts: Vec<string>, seconds: f64, seed: u64, paces: Vec<f64> = []): Vec<Take> throws string

A take of each of prompts, seconds long (whole windows of two seconds, cut to it), from seed: named as its words, played whole. A person with a pace (paces: meters a second, 0 or none: none) is led straight ahead, as a game leads one on a path: its goals are where that pace takes it each PATH frames.

Effects: fail, read, write, console, io, alloc.