Files
feuerwerk/tools/e2e/index.mjs
T
adminandClaude Opus 5.5 e191dc4b2e
game-maker / gate (push) Successful in 4m14s
game-maker / suite (push) Successful in 17m7s
Record the game view from a behavior into a video asset (#405)
A game can now film itself. A behavior starts and stops a take, and
the editor turns it into a video asset with the run's picture and the
sound the player hears. The exported game hands the file over as a
download, since there is no project to keep it in.

- New action nodes `Start recording` (Name, Resolution, FPS) and
  `Stop recording`. An empty name becomes `Recording <timestamp>`.
- Resolution is `Game view`, `720p` or `1080p`. For the fixed sizes
  the height is set and the width follows the camera.
- The picture is the camera only, without hints, overlays or the
  letterbox. It is drawn into a render texture of the target size,
  so a smaller window still gives full 1080p.
- `PictureReader` reads the texture back through pixel buffers with
  a fence. The editor never waits on the GPU, and a frame with all
  three buffers busy is dropped and counted.
- Nothing of the take reaches the visible canvas. A first version
  drew tiles into it and copied them out, and with the low-latency
  canvas that midway state flickered on screen.
- The sound is tapped behind the master limiter in the FX worklet
  and encoded as Opus.
- H.264 is chosen when the browser has it, VP9 otherwise. A small
  own Matroska writer packs both tracks, no new dependency. It names
  the frame rate and BT.709 so ffmpeg keeps both.
- A second `Start recording` is ignored with a warning in the log.
  A take goes on through `Load scene` and a restart, pauses with the
  editor and is saved when the run ends. It stops at 2 GB.
- The editor uploads the take on the existing video route and makes
  the asset once the run is over. The video tab gets a Download
  button for the converted MP4.
- `downloadBlob` in `src/ui` replaces the song editor's own copy.

Findings:
- `On start` runs before the game screen knows the world. A take
  therefore fixes its size on the first frame that has a camera.
- Without a frame rate in the file, ffmpeg turned 30 fps into 59.94.
- The worker's poster JPEG is off in colour for every upload (red
  255 comes out as 229, BT.601). Not touched here.

Tests:
- Unit recording + matroska: 21 green, plus the node catalog cases.
  The Matroska test reads the file back with its own EBML reader.
- e2e 67 (new) on melektaus-atx: ALL PASSED. 1080p30 from a
  1280x800 window gives a 1920x1080 MP4 with sound and no dropped
  frame. Every 4th pixel is checked, a green quarter catches an
  upside-down picture. A take ended by Esc is saved with the
  timestamp name.
- e2e 60j: the exported game downloads an `.mkv` with EBML magic.
- The flicker is gone on the user's machine without `?vsync`.
- Gate on melektaus-atx: CHECK EXIT 0, 299 files, 4586 tests.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 21:11:05 +02:00

143 lines
4.2 KiB
JavaScript

/**
* The e2e steps in the order they run. Each step is `async (t) => {}` over the harness
* toolbox; later steps rely on the scene state earlier ones leave behind (names given in
* the parenting step, the container created in the container step, …).
*/
import { hierarchy } from './01-hierarchy.mjs';
import { inspector } from './02-inspector.mjs';
import { play } from './03-play.mjs';
import { assets } from './04-assets.mjs';
import { drawing } from './05-drawing.mjs';
import { graph } from './06-graph.mjs';
import { parenting } from './07-parenting.mjs';
import { colliders } from './08-colliders.mjs';
import { containers } from './09-containers.mjs';
import { textAndEnabled } from './10-text-and-enabled.mjs';
import { menus } from './11-menus.mjs';
import { textures } from './12-textures.mjs';
import { frames } from './13-frames.mjs';
import { overflow } from './14-overflow.mjs';
import { aspect } from './15-aspect.mjs';
import { containerTab } from './16-container.mjs';
import { editorRun } from './17-editor-run.mjs';
import { pause } from './18-pause.mjs';
import { nestedBehavior } from './19-nested-behavior.mjs';
import { keyRepeat } from './20-key-repeat.mjs';
import { listTab } from './21-list.mjs';
import { structVariable } from './22-struct.mjs';
import { variableNodes } from './23-variable-nodes.mjs';
import { propertyNodes } from './24-property-nodes.mjs';
import { animation } from './25-animation.mjs';
import { stateMachine } from './26-state-machine.mjs';
import { consolePanel } from './27-console.mjs';
import { shader } from './28-shader.mjs';
import { transform } from './29-transform.mjs';
import { font } from './30-font.mjs';
import { particles } from './31-particles.mjs';
import { scope } from './32-scope.mjs';
import { renderOnChange } from './33-render-on-change.mjs';
import { sound } from './34-sound.mjs';
import { loadScene } from './35-load-scene.mjs';
import { graphGroups } from './36-graph-groups.mjs';
import { nineSlice } from './37-nine-slice.mjs';
import { plugins } from './38-plugins.mjs';
import { tile } from './39-tile.mjs';
import { tilemap } from './40-tilemap.mjs';
import { physics } from './41-physics.mjs';
import { shapes } from './42-shapes.mjs';
import { queries } from './43-queries.mjs';
import { documents } from './44-documents.mjs';
import { login } from './45-login.mjs';
import { topbar } from './46-topbar.mjs';
import { vectorArt } from './47-vectorart.mjs';
import { pixelArt } from './48-pixelart.mjs';
import { users } from './49-users.mjs';
import { snapshots } from './50-snapshots.mjs';
import { clipboard } from './51-clipboard.mjs';
import { hierarchyGroups } from './52-hierarchy-groups.mjs';
import { curves } from './53-curves.mjs';
import { structTypes } from './54-struct-types.mjs';
import { typedLists } from './55-typed-lists.mjs';
import { privateVariables } from './56-private-variables.mjs';
import { objectReferences } from './57-object-references.mjs';
import { clipAreas } from './58-clip-areas.mjs';
import { whilePlaying } from './59-while-playing.mjs';
import { release } from './60-release.mjs';
import { fullscreen } from './61-fullscreen.mjs';
import { devicePixels } from './62-device-pixels.mjs';
import { renderLayers } from './63-render-layers.mjs';
import { pattern } from './64-pattern.mjs';
import { song } from './65-song.mjs';
import { video } from './66-video.mjs';
import { recording } from './67-recording.mjs';
export const STEPS = [
hierarchy,
inspector,
play,
assets,
drawing,
graph,
parenting,
colliders,
containers,
textAndEnabled,
menus,
textures,
frames,
overflow,
aspect,
containerTab,
editorRun,
pause,
nestedBehavior,
keyRepeat,
listTab,
structVariable,
variableNodes,
propertyNodes,
animation,
stateMachine,
consolePanel,
shader,
transform,
font,
particles,
scope,
renderOnChange,
sound,
loadScene,
graphGroups,
nineSlice,
plugins,
tile,
tilemap,
physics,
shapes,
queries,
documents,
login,
topbar,
vectorArt,
pixelArt,
users,
snapshots,
clipboard,
hierarchyGroups,
curves,
structTypes,
typedLists,
privateVariables,
objectReferences,
clipAreas,
whilePlaying,
release,
fullscreen,
devicePixels,
renderLayers,
pattern,
song,
video,
recording,
];