Files
fresnel-fourier/phase6_iter4_implementation.md
T
marfrit 42b9ec333a iter4 Phase 6: 4 commits landed (Z+A+B+C), ffmpeg-vaapi VP9 decode PASS
Fork at marfrit/libva-multiplanar tip beaa914:
- Z (7f8fa93) device-path auto-detect via media controller topology;
  walk /dev/media*, MEDIA_IOC_DEVICE_INFO match, MEDIA_IOC_G_TOPOLOGY
  -> MEDIA_INTF_T_V4L_VIDEO -> resolve via /sys/dev/char.
  LIBVA_V4L2_REQUEST_NO_AUTODETECT=1 escape hatch.
- A (16b3973) src/config.c VP9 enumeration + dispatch + entrypoints.
- B (406d08e) NEW src/vp9.c (~750 LOC: VPX rac + inv_map_table +
  uncompressed-header partial parser + compressed-header parser +
  vp9_set_controls) + src/vp9.h + meson.build + context.h
  (persistent vp9_lf state for Phase 5 C2) + surface.h
  (params.vp9 union extension).
- C (beaa914) src/picture.c VP9 dispatcher + 2 buffer-type cases.

NO Commit D — buffer.c allow-list already permissive for VP9's 3
buffer types (Picture, Slice, SliceData; all in iter3 baseline).

Phase 5 amendments all in code: C1 no-XOR direct, C2 persistent
vp9_lf with VP9 spec defaults, C3 out_reference_mode parameter,
C4 NO_AUTODETECT escape, S4 uv_mode memcpy omitted.

Plan amendment to Commit Z section in phase4_iter4_plan.md
documents the canonical media-topology approach (replacing the
original /dev/video* walk).

Verification empirically on fresnel:
- Criterion 1: vainfo enumerates VAProfileVP9Profile0 alongside
  H.264 + HEVC under auto-detect rkvdec.
- Criterion 2 (implicit via successful ffmpeg run).
- Criterion 3: ffmpeg-vaapi VP9 5-frame decode exit 0 at
  0.307x speed, no ioctl errors.
- Criterion 4: deferred to Phase 7 verification.
- Criterion 5: rkvdec codecs work without env override; hantro
  (MPEG-2/VP8) still need env override per iter4-B1 backlog.

Open iter4 backlog: B1 (multi-decoder dispatch refactor),
B2 (mpv-vaapi Could-not-create-device — ffmpeg-vaapi works fine
through same backend, mpv does not), Q6 (per-segment ALT_Q
mapping for non-BBB), COLOR_RANGE (VAAPI gap).

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-10 06:55:45 +00:00

6.2 KiB

Iteration 4 — Phase 6 (implementation)

Commits Z + A + B + C landed against fork tip e1aca9c (iter3 close). All built clean on fresnel linux-fresnel-fourier 7.0-1 (libva 1.23, ninja-1.13.2, gcc 15.2.1). No fix-forward Commit D needed — buffer.c allow-list was already permissive for the 3 VAAPI buffer types VP9 uses.

Commits

SHA Files LOC Summary
7f8fa93 src/request.c +152 / -4 Commit Z — device-path auto-detect via media controller topology. Walk /dev/media*, MEDIA_IOC_DEVICE_INFO → driver match, MEDIA_IOC_G_TOPOLOGYMEDIA_INTF_T_V4L_VIDEO interface → resolve major:minor via /sys/dev/char/<M>:<N> symlink. Canonical v4l2-request discovery; not enumeration-order dependent. LIBVA_V4L2_REQUEST_NO_AUTODETECT=1 escape hatch for legacy callers.
16b3973 src/config.c +15 Commit A — VP9 enumeration + dispatch + entrypoints (3 sites).
406d08e src/vp9.c (new), src/vp9.h (new), src/meson.build, src/context.h, src/surface.h +810 / -2 Commit B — VP9 backend: 12 contract clauses, VPX range coder, inv_map_table, uncompressed-header partial parser, compressed-header parser, persistent vp9_lf state in object_context. Phase 5 C1+C2+C3 amendments + S4 baked in. Compile-time _Static_assert on struct sizes 168/2040.
beaa914 src/picture.c +19 Commit C — VP9 dispatcher + 2 buffer-type cases (Picture, Slice). No RequestBeginPicture reset (VP9 has no iqmatrix_set-style flag).

Total: 4 commits, 996 LOC delta, 7 files (2 new + 5 modified). No Commit D.

Verification on fresnel

Substrate

Linux fresnel 7.0.0-fresnel-fourier #1 SMP PREEMPT
/usr/lib/dri/v4l2_request_drv_video.so SHA256
  f2ff65982a777b64f3392fa6be13b934d969068a1309d24364d99708462c04ee

Criterion 1 — vainfo enumerates VAProfileVP9Profile0

$ LIBVA_DRIVER_NAME=v4l2_request vainfo
v4l2-request: auto-selected codec device: /dev/video1 + /dev/media0
vainfo: VA-API version: 1.23 (libva 2.22.0)
vainfo: Driver version: v4l2-request
vainfo: Supported profile and entrypoints
      VAProfileH264Main               :	VAEntrypointVLD
      VAProfileH264High               :	VAEntrypointVLD
      VAProfileH264ConstrainedBaseline:	VAEntrypointVLD
      VAProfileH264MultiviewHigh      :	VAEntrypointVLD
      VAProfileH264StereoHigh         :	VAEntrypointVLD
      VAProfileHEVCMain               :	VAEntrypointVLD
      VAProfileVP9Profile0            :	VAEntrypointVLD       ← NEW

Auto-detect (no env override) successfully picked rkvdec via media topology graph. PASS.

Criterion 2 — vaCreateConfig SUCCESS

Implicit in successful ffmpeg-vaapi run below. PASS.

Criterion 3 — ffmpeg-vaapi VP9 decode exit 0

$ LIBVA_DRIVER_NAME=v4l2_request ffmpeg -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 \
    -i ~/fourier-test/bbb_720p10s_vp9.webm -frames:v 5 -f null -
v4l2-request: cap_pool_init: 24 slots ready (v4l2_index=0..23, 1 plane(s) per slot)
[...]
frame=    5 fps=0.0 q=-0.0 Lsize=N/A time=00:00:00.20 bitrate=N/A speed=0.307x

5 frames decoded at 0.307x speed. Zero kernel ioctl errors. cap_pool_init successful. PASS.

Criterion 4 — HW=SW byte-identical (deferred to Phase 7)

Phase 7 will run mpv VP9 capture vs the Phase 3 SW reference PNGs and compare hashes. mpv's vaapi-init path needs investigation (iter4-B2 — does not currently engage HW even with LIBVA_DRIVER_NAME set, while ffmpeg-vaapi does). Workaround for criterion 4: use ffmpeg-vaapi-hwdownload path to PNG instead of mpv-vaapi-copy, OR use the iter3-style transitive proof (kernel-direct == backend-payload).

Criterion 5 — 4-codec regression block

H.264 + HEVC (rkvdec via auto-detect): Commit Z restored device-path baseline. Profiles enumerate cleanly without env override.

MPEG-2 + VP8 (hantro): require LIBVA_V4L2_REQUEST_VIDEO_PATH=/dev/video3 LIBVA_V4L2_REQUEST_MEDIA_PATH=/dev/media1 env override (Phase 5 C4 known scope limitation; iter4-B1 backlog).

Engagement-status verification deferred to Phase 7.

Phase 5 amendments status (post-Phase 6)

ID Amendment Implementation status
C1 frame.interpolation_filter = picture->mcomp_filter_type (no XOR) vp9.c::vp9_set_controls line near "Phase 5 C1: NO XOR" comment
C2 Persistent vp9_lf state in object_context, init {1,0,-1,-1,0,0} on key/intra/error_res, parse-and-update only on lf_delta.update=1, always copy context.h struct vp9_lf; vp9.c::vp9_set_controls Clause 6 block
C3 vp9_fill_compressed_hdr takes uint8_t *out_reference_mode; allowcompinter derived from sign biases vp9.c::vp9_fill_compressed_hdr signature + caller derivation
C4 LIBVA_V4L2_REQUEST_NO_AUTODETECT=1 escape hatch request.c::VA_DRIVER_INIT_FUNC
S4 uv_mode memcpy omitted (rkvdec reads from kernel persistent table) vp9.c::vp9_fill_compressed_hdr ends without memcpy

Cross-cutting backlog updates

  • iter4-B1 (open) Walk-and-pick-first selects rkvdec on RK3399 (its media controller enumerates first); hantro codecs still need explicit env override. Multi-decoder dispatch refactor required.
  • iter4-B2 (open) mpv-vaapi Could not create device failure — appears to be in mpv's libva-DRM device-init path, not in our backend. ffmpeg-vaapi works fine through the same backend; mpv does not. Investigate in Phase 7 if criterion 4 verification needs a mpv path.
  • iter4-Q6 (open) Per-segment seg_param[s].luma_ac_quant_scale → kernel feature_data[s][ALT_Q] mapping is fundamentally lossy for non-BBB segmentation-enabled streams. BBB has segmentation disabled so dead code there.
  • iter4-COLOR_RANGE (open) VAAPI doesn't expose color_range; backend leaves V4L2_VP9_FRAME_FLAG_COLOR_RANGE_FULL_SWING clear (BT.709 limited). Wrong for full-range JPEG-encoded VP9.

Substrate state at Phase 6 close

  • Fork at iter4 Commit C tip beaa914 on noether + fresnel ~/src/libva-v4l2-request-fourier/ + /usr/lib/dri/v4l2_request_drv_video.so.
  • vainfo (auto-detect rkvdec) lists VAProfileVP9Profile0.
  • ffmpeg-vaapi VP9 decode: criterion 3 PASS empirically.
  • mpv-vaapi VP9 still SW-fallback (iter4-B2; not blocking criterion 3).
  • Kernel: linux-fresnel-fourier 7.0-1. Same as Phase 3.
  • Fork ready for Phase 7 verification (HW=SW + regression).