2 Commits

Include renames

Author	SHA1	Message	Date
adminandClaude Opus 5.5	d48f174caf	Play videos on sprites, converted on the server with clips (#402) ... A video becomes an asset like a sound: uploaded once, converted to one format by a worker of its own, cut into clips in its tab, and worn by a sprite through its Texture row. Only Chrome is a target, without alpha. - Server: POST ?r=videos queues the upload under the hash of its bytes, so the MP4's name is known at once. The worker (VideoWorker over VideoFormat) writes H.264/AAC, yuv420p, constant frame rate, a keyframe every 15 frames, at most 1920x1080, with a poster and the details beside it. A failed job says why and is tried again on the next upload. - An upload may be up to 2 GB. It is streamed from the request to disk and hashed there, so php-fpm holds none of it in memory. The other routes keep their 256 MB. - The worker runs in the container game-maker-video on stein2, a compose project of its own (tools/video/), and in CI beside the PHP server. The CI image has ffmpeg for it. - Model: asset type video with size, length, frame rate and sound, and clips like a sound's. The clip helpers and commands serve both. - A sprite's Texture row offers videos and clips after the pictures. resolvePicture names a playing video by a key, and the texture library hands it to a VideoLibrary with one player per key. - The editor shows a placed video as a quiet preview. Play starts it over at its clip's start and lets it be heard through the master bus, a pause holds it, Esc makes it quiet again. - Video tab: the picture, a ruler, the clip strip and a track on the Sound tab's time axis. A drag spans a clip, a handle moves an edge, Play plays the picked clip. - The picker shows a video on its way with its progress and adopts an upload from it once it is ready. Dropping a video file does the same. Decided on my own: - Two sprites wearing the same clip share one player and show the same picture. Control per instance belongs to the follow-up with nodes. - A video plays in real time, the game's time scale does not slow it. - The container may use 3 of the 4 cores of stein2. Findings: - The first real upload (279 MB) got 413: the API's own ceiling of 256 MB for every request, not nginx or the Brandmauer. - Chrome has no picture of a video that never played, and a Pixi VideoSource drawn before the first frame stays empty for good. The texture is made in the first frame callback (openVideo). - A player nobody asks for in 2 s is let go. The inspector's PREVIEW asked only on an edit, so with the sprite not on screen its texture was destroyed under it and the batcher threw on every frame. The preview now redraws every frame while it shows a video, like a Time shader. A let-go texture keeps an empty source instead of none. - VideoSource.load() reloads the element and cuts off an earlier play(). Playing starts after loadeddata. Tests: - PHP videos.test.php: 68 checks, with the real ffmpeg - 300 MB upload through Brandmauer and nginx: 201 in 21 s, php-fpm at 13.7 MB RSS at most - Unit videos.test.ts: 20 tests - e2e 66 (stein2, atx was off): ALL PASSED, 18 checks; e2e 04 with the new asset count green - Gate (atx): 294 files, 4520 tests. serialize.test.ts used video as its example of an unknown type and now uses a made-up one. - Counter-checks: a keyframe gap of 30 fails the PHP check, a key that keeps the video's end fails 2 unit tests, a clip without its end fails "plays only its stretch" in e2e 66 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>	2026-10-11 12:12:39 +02:00
adminandClaude Opus 5.5	42a3759d9d	Cut a sound into named clips, as a texture into frames (#357) ... A sound could only be cut to one stretch, set on the asset itself. To play two parts of one file, the file had to be imported twice. Now a sound is always the whole file, and its clips are the stretches of it, each with a name and a cut of its own. - A clip is { id, name, props } on SoundAsset.clips. Its id shares the generator with asset ids, so a sound field holds a sound or a clip, as a texture field holds a texture or a frame. - props are the cut: start, end, the fades and their curves, reverse. Volume, loop, sound FX and bus stay on the sound for all its clips. The cut rows left the sound's schema for CLIP_ROWS. - findSound resolves either id. Play sound, the Sample of an instrument, a Reverb impulse, song items, the scheduler and the test sound of the Sound FX tab all go through it. - Every sound field offers each sound followed by its clips, "Kick", "Kick / Clip 1". A clip that is gone reads as "<id>?". - The Sound tab has a strip under the ruler with the clips as bands. A drag there makes a clip, a click picks one, beside the bands the sound. Only the picked clip has handles. Reverse, fades and curves in the header work on it and are greyed out without one. - Whole file is gone from the header, as the user asked. - Picking a clip is a selection of its own, like a frame. The inspector shows its name, its cut rows and Delete clip. Delete takes it away without asking, as with a frame. Ctrl+Z brings it back. - Copies get fresh clip ids: Duplicate, Embed a copy, a song duplicated with its takes, and the copy a split or paste makes of an embedded take. An item on a clip plays the same clip of its copy. - A double-click on a song item playing a clip opens its sound with the clip picked. The Sound row of an item on an embedded take offers the take and its clips, which no list shows. - A new take stays the whole sound. Clips are made by hand, as the user decided. - No migration in the code, as the user decided. The one project with cut sounds was changed over by hand. Deviation from the issue: deleting a used clip does not warn. A frame does not warn either, and the issue had promised "like a frame". Tests: - Unit sound-clips (new): 11 green, 7 counter-checks each red - Unit sounds, embedded: adjusted to clips, green - e2e 34 (melektaus-atx): ALL PASSED, 90 checks (3 new, 12 rewritten) - Counter-check in the browser: clips left out of the sound fields, the picker check fails - Gate (melektaus-atx): CHECK EXIT 0, 271 files, 4194 tests Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>	2026-10-08 20:18:47 +02:00