ralpha
/
ralpha-assets
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

FAB scoreboard: 8/231 — shots 1 (sunset) + 6 (MetaHuman) CLOSED via live critic 

End-to-end Phase-0 loop proven: smoke_*.py --emit-json -> harness adapt_smoke ->
CLOSED at critic_accepted (repo_rev 3f0bdec81). Both critic-ACCEPTED live.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
This commit is contained in:
jamestagg 2026-06-06 16:18:58 -07:00
parent 7dc3bf6725
commit 36146a2453
2 changed files with 124 additions and 124 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

130
Content/Ralpha/Demos/fab_scoreboard.json
View File

@ -1,8 +1,8 @@
{ {
"total": 269, "total": 269,
"closed": 6, "closed": 8,
"non_roadmap": 231, "non_roadmap": 231,
"completion_pct": 2.6, "completion_pct": 3.5,
"sections": { "sections": {
"Public Website Promises": { "Public Website Promises": {
"CLOSED": 0, "CLOSED": 0,
@ -59,8 +59,8 @@
"ROADMAP": 0 "ROADMAP": 0
}, },
"Min Video Set": { "Min Video Set": {
"CLOSED": 0, "CLOSED": 2,
"OPEN": 10, "OPEN": 8,
"BLOCKED": 0, "BLOCKED": 0,
"ROADMAP": 0 "ROADMAP": 0
} }
@ -78,7 +78,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "public_website_pro.text_photo_or_floor_plan_input", "id": "public_website_pro.text_photo_or_floor_plan_input",
@ -92,7 +92,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "public_website_pro.worlds_not_flat_video", "id": "public_website_pro.worlds_not_flat_video",
@ -106,7 +106,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "public_website_pro.reference_matching", "id": "public_website_pro.reference_matching",
@ -120,7 +120,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "public_website_pro.brain_replay", "id": "public_website_pro.brain_replay",
@ -134,7 +134,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "public_website_pro.honest_visible_failures", "id": "public_website_pro.honest_visible_failures",
@ -148,7 +148,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "public_website_pro.virtual_production", "id": "public_website_pro.virtual_production",
@ -162,7 +162,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "public_website_pro.game_prototyping", "id": "public_website_pro.game_prototyping",
@ -176,7 +176,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "public_website_pro.architectural_visualization", "id": "public_website_pro.architectural_visualization",
@ -190,7 +190,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "public_website_pro.training_and_simulation", "id": "public_website_pro.training_and_simulation",
@ -204,7 +204,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "public_website_pro.plugin_vs_full_system", "id": "public_website_pro.plugin_vs_full_system",
@ -218,7 +218,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "fab_listing_promis.any_ai_can_control_ue5_over_tcp_json_mcp", "id": "fab_listing_promis.any_ai_can_control_ue5_over_tcp_json_mcp",
@ -232,7 +232,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "fab_listing_promis.local_first_byo_llm", "id": "fab_listing_promis.local_first_byo_llm",
@ -246,7 +246,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "fab_listing_promis.describe_do_not_click", "id": "fab_listing_promis.describe_do_not_click",
@ -260,7 +260,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "fab_listing_promis.auto_iterate", "id": "fab_listing_promis.auto_iterate",
@ -274,7 +274,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "fab_listing_promis.deterministic_tools_replace_guesswork", "id": "fab_listing_promis.deterministic_tools_replace_guesswork",
@ -288,7 +288,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "fab_listing_promis.capability_contracts_validate_scene_shap", "id": "fab_listing_promis.capability_contracts_validate_scene_shap",
@ -302,7 +302,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "fab_listing_promis.full_undo_transactional_commands", "id": "fab_listing_promis.full_undo_transactional_commands",
@ -316,7 +316,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "fab_listing_promis.editor_and_packaged_game_runtime", "id": "fab_listing_promis.editor_and_packaged_game_runtime",
@ -330,7 +330,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "fab_listing_promis.sunset_beach_prompt_works_out_of_box", "id": "fab_listing_promis.sunset_beach_prompt_works_out_of_box",
@ -344,7 +344,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "fab_listing_promis.metahuman_prompt_works_out_of_box", "id": "fab_listing_promis.metahuman_prompt_works_out_of_box",
@ -358,7 +358,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "fab_listing_promis.crowd_prompt_works_out_of_box", "id": "fab_listing_promis.crowd_prompt_works_out_of_box",
@ -372,7 +372,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "fab_listing_promis.rainy_night_neon_prompt_works_out_of_box", "id": "fab_listing_promis.rainy_night_neon_prompt_works_out_of_box",
@ -386,7 +386,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "fab_listing_promis.movie_render_pipeline_output", "id": "fab_listing_promis.movie_render_pipeline_output",
@ -400,7 +400,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "fab_listing_promis.geospatial_cesium_support", "id": "fab_listing_promis.geospatial_cesium_support",
@ -414,7 +414,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "fab_listing_promis.characters_vehicles_weather_atmosphere_c", "id": "fab_listing_promis.characters_vehicles_weather_atmosphere_c",
@ -428,7 +428,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "public_demo_use_ca.product_tour", "id": "public_demo_use_ca.product_tour",
@ -442,7 +442,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "public_demo_use_ca.text_to_world", "id": "public_demo_use_ca.text_to_world",
@ -456,7 +456,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "public_demo_use_ca.characters", "id": "public_demo_use_ca.characters",
@ -470,7 +470,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "public_demo_use_ca.city_generation", "id": "public_demo_use_ca.city_generation",
@ -484,7 +484,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "public_demo_use_ca.floor_plan", "id": "public_demo_use_ca.floor_plan",
@ -498,7 +498,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "public_demo_use_ca.sdk_playground", "id": "public_demo_use_ca.sdk_playground",
@ -512,7 +512,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "public_demo_use_ca.spaghetti", "id": "public_demo_use_ca.spaghetti",
@ -526,7 +526,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "public_demo_use_ca.world", "id": "public_demo_use_ca.world",
@ -540,7 +540,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "public_demo_use_ca.time_lapse", "id": "public_demo_use_ca.time_lapse",
@ -554,7 +554,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "public_demo_use_ca.upscale_comparison", "id": "public_demo_use_ca.upscale_comparison",
@ -568,7 +568,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "public_demo_use_ca.collaboration", "id": "public_demo_use_ca.collaboration",
@ -582,7 +582,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "public_demo_use_ca.exposure_grading", "id": "public_demo_use_ca.exposure_grading",
@ -596,7 +596,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "public_demo_use_ca.tree_vegetation", "id": "public_demo_use_ca.tree_vegetation",
@ -610,7 +610,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "admin_foundation_o.proof_of_life", "id": "admin_foundation_o.proof_of_life",
@ -3886,7 +3886,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "admin_e2e_journeys.photo_3d_world", "id": "admin_e2e_journeys.photo_3d_world",
@ -3900,7 +3900,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "admin_e2e_journeys.text_scene", "id": "admin_e2e_journeys.text_scene",
@ -3914,7 +3914,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "admin_e2e_journeys.character_audition", "id": "admin_e2e_journeys.character_audition",
@ -3928,7 +3928,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "admin_e2e_journeys.sunset_timelapse", "id": "admin_e2e_journeys.sunset_timelapse",
@ -3942,7 +3942,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "admin_e2e_journeys.product_shot", "id": "admin_e2e_journeys.product_shot",
@ -3956,7 +3956,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "admin_e2e_journeys.architectural_viz", "id": "admin_e2e_journeys.architectural_viz",
@ -3970,7 +3970,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "admin_e2e_journeys.music_video", "id": "admin_e2e_journeys.music_video",
@ -3984,7 +3984,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "needs live lane run (brain decompose\u2192build\u2192critic)"
}, },
{ {
"id": "min_video_set.1_text_sunset_ocean_world", "id": "min_video_set.1_text_sunset_ocean_world",
@ -3996,9 +3996,9 @@
"proof_ref": null, "proof_ref": null,
"proof_artifact_schema": null, "proof_artifact_schema": null,
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "CLOSED",
"evidence": "", "evidence": "tests/reports/smoke_sunset_20260606_161555.json",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "sunset critic ACCEPTED @ 3f0bdec81"
}, },
{ {
"id": "min_video_set.2_reference_photo_matched_3d_scene", "id": "min_video_set.2_reference_photo_matched_3d_scene",
@ -4012,7 +4012,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "no smoke harness for this family yet (build smoke_<family>.py)"
}, },
{ {
"id": "min_video_set.3_real_world_location", "id": "min_video_set.3_real_world_location",
@ -4026,7 +4026,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "no smoke harness for this family yet (build smoke_<family>.py)"
}, },
{ {
"id": "min_video_set.4_rainy_neon_city", "id": "min_video_set.4_rainy_neon_city",
@ -4040,7 +4040,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "no smoke harness for this family yet (build smoke_<family>.py)"
}, },
{ {
"id": "min_video_set.5_interior_floor_plan", "id": "min_video_set.5_interior_floor_plan",
@ -4054,7 +4054,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "no smoke harness for this family yet (build smoke_<family>.py)"
}, },
{ {
"id": "min_video_set.6_character_metahuman", "id": "min_video_set.6_character_metahuman",
@ -4066,9 +4066,9 @@
"proof_ref": null, "proof_ref": null,
"proof_artifact_schema": null, "proof_artifact_schema": null,
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "CLOSED",
"evidence": "", "evidence": "tests/reports/smoke_metahuman_20260606_161555.json",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "metahuman critic ACCEPTED @ 3f0bdec81"
}, },
{ {
"id": "min_video_set.7_food_close_up", "id": "min_video_set.7_food_close_up",
@ -4082,7 +4082,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "no smoke harness for this family yet (build smoke_<family>.py)"
}, },
{ {
"id": "min_video_set.8_vehicle_action", "id": "min_video_set.8_vehicle_action",
@ -4096,7 +4096,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "no smoke harness for this family yet (build smoke_<family>.py)"
}, },
{ {
"id": "min_video_set.9_time_lapse_mrq_video", "id": "min_video_set.9_time_lapse_mrq_video",
@ -4110,7 +4110,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "no smoke harness for this family yet (build smoke_<family>.py)"
}, },
{ {
"id": "min_video_set.10_admin_dashboard_proof", "id": "min_video_set.10_admin_dashboard_proof",
@ -4124,7 +4124,7 @@
"evidence_path": null, "evidence_path": null,
"status": "OPEN", "status": "OPEN",
"evidence": "", "evidence": "",
"detail": "needs live proof run (smoke --emit-json / lane critic)" "detail": "no smoke harness for this family yet (build smoke_<family>.py)"
} }
] ]
} }

118
Content/Ralpha/Demos/fab_scoreboard.md
View File

@ -1,6 +1,6 @@
# FAB Completeness Scoreboard # FAB Completeness Scoreboard
**FAB-complete = 6 / 231 non-roadmap promises CLOSED → 2.6%** (total 269, roadmap 38) **FAB-complete = 8 / 231 non-roadmap promises CLOSED → 3.5%** (total 269, roadmap 38)
| Section | CLOSED | OPEN | BLOCKED | ROADMAP | | Section | CLOSED | OPEN | BLOCKED | ROADMAP |
|---|---:|---:|---:|---:| |---|---:|---:|---:|---:|
@ -13,50 +13,50 @@
| Planned Benchmark Families | 0 | 0 | 0 | 38 | | Planned Benchmark Families | 0 | 0 | 0 | 38 |
| Archetype Registry | 0 | 147 | 0 | 0 | | Archetype Registry | 0 | 147 | 0 | 0 |
| Admin E2E Journeys | 0 | 8 | 0 | 0 | | Admin E2E Journeys | 0 | 8 | 0 | 0 |
| Min Video Set | 0 | 10 | 0 | 0 | | Min Video Set | 2 | 8 | 0 | 0 |
## Per-promise ## Per-promise
| id | status | rubric | evidence | detail | | id | status | rubric | evidence | detail |
|---|---|---|---|---| |---|---|---|---|---|
| public_website_pro.describe_anything_watch_it_build | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | public_website_pro.describe_anything_watch_it_build | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| public_website_pro.text_photo_or_floor_plan_input | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | public_website_pro.text_photo_or_floor_plan_input | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| public_website_pro.worlds_not_flat_video | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | public_website_pro.worlds_not_flat_video | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| public_website_pro.reference_matching | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | public_website_pro.reference_matching | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| public_website_pro.brain_replay | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | public_website_pro.brain_replay | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| public_website_pro.honest_visible_failures | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | public_website_pro.honest_visible_failures | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| public_website_pro.virtual_production | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | public_website_pro.virtual_production | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| public_website_pro.game_prototyping | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | public_website_pro.game_prototyping | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| public_website_pro.architectural_visualization | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | public_website_pro.architectural_visualization | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| public_website_pro.training_and_simulation | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | public_website_pro.training_and_simulation | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| public_website_pro.plugin_vs_full_system | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | public_website_pro.plugin_vs_full_system | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| fab_listing_promis.any_ai_can_control_ue5_over_tcp_json_mcp | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | fab_listing_promis.any_ai_can_control_ue5_over_tcp_json_mcp | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| fab_listing_promis.local_first_byo_llm | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | fab_listing_promis.local_first_byo_llm | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| fab_listing_promis.describe_do_not_click | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | fab_listing_promis.describe_do_not_click | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| fab_listing_promis.auto_iterate | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | fab_listing_promis.auto_iterate | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| fab_listing_promis.deterministic_tools_replace_guesswork | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | fab_listing_promis.deterministic_tools_replace_guesswork | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| fab_listing_promis.capability_contracts_validate_scene_shap | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | fab_listing_promis.capability_contracts_validate_scene_shap | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| fab_listing_promis.full_undo_transactional_commands | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | fab_listing_promis.full_undo_transactional_commands | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| fab_listing_promis.editor_and_packaged_game_runtime | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | fab_listing_promis.editor_and_packaged_game_runtime | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| fab_listing_promis.sunset_beach_prompt_works_out_of_box | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | fab_listing_promis.sunset_beach_prompt_works_out_of_box | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| fab_listing_promis.metahuman_prompt_works_out_of_box | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | fab_listing_promis.metahuman_prompt_works_out_of_box | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| fab_listing_promis.crowd_prompt_works_out_of_box | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | fab_listing_promis.crowd_prompt_works_out_of_box | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| fab_listing_promis.rainy_night_neon_prompt_works_out_of_box | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | fab_listing_promis.rainy_night_neon_prompt_works_out_of_box | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| fab_listing_promis.movie_render_pipeline_output | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | fab_listing_promis.movie_render_pipeline_output | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| fab_listing_promis.geospatial_cesium_support | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | fab_listing_promis.geospatial_cesium_support | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| fab_listing_promis.characters_vehicles_weather_atmosphere_c | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | fab_listing_promis.characters_vehicles_weather_atmosphere_c | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| public_demo_use_ca.product_tour | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | public_demo_use_ca.product_tour | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| public_demo_use_ca.text_to_world | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | public_demo_use_ca.text_to_world | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| public_demo_use_ca.characters | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | public_demo_use_ca.characters | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| public_demo_use_ca.city_generation | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | public_demo_use_ca.city_generation | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| public_demo_use_ca.floor_plan | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | public_demo_use_ca.floor_plan | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| public_demo_use_ca.sdk_playground | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | public_demo_use_ca.sdk_playground | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| public_demo_use_ca.spaghetti | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | public_demo_use_ca.spaghetti | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| public_demo_use_ca.world | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | public_demo_use_ca.world | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| public_demo_use_ca.time_lapse | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | public_demo_use_ca.time_lapse | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| public_demo_use_ca.upscale_comparison | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | public_demo_use_ca.upscale_comparison | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| public_demo_use_ca.collaboration | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | public_demo_use_ca.collaboration | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| public_demo_use_ca.exposure_grading | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | public_demo_use_ca.exposure_grading | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| public_demo_use_ca.tree_vegetation | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | public_demo_use_ca.tree_vegetation | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| admin_foundation_o.proof_of_life | CLOSED | test_pass | tests/reports/harness_20260322_200633.json | pass, 18/18 tests | | admin_foundation_o.proof_of_life | CLOSED | test_pass | tests/reports/harness_20260322_200633.json | pass, 18/18 tests |
| admin_foundation_o.helper_unit_tests | CLOSED | test_pass | tests/reports/harness_20260322_200633.json | pass, 36/36 tests | | admin_foundation_o.helper_unit_tests | CLOSED | test_pass | tests/reports/harness_20260322_200633.json | pass, 36/36 tests |
| admin_foundation_o.frontend_unit_tests | OPEN | test_pass | | no harness layer report for this suite (needs run) | | admin_foundation_o.frontend_unit_tests | OPEN | test_pass | | no harness layer report for this suite (needs run) |
@ -269,21 +269,21 @@
| archetype_registry.sunset_over_water_vladimir_fedotov_nu2w_ | OPEN | archetype_solved | | no scored run in scoreboard | | archetype_registry.sunset_over_water_vladimir_fedotov_nu2w_ | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_zoltan_tasi_khd_fa43am | OPEN | archetype_solved | | no scored run in scoreboard | | archetype_registry.sunset_over_water_zoltan_tasi_khd_fa43am | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_zuzana_ruttkay_npovqal | OPEN | archetype_solved | | no scored run in scoreboard | | archetype_registry.sunset_over_water_zuzana_ruttkay_npovqal | OPEN | archetype_solved | | no scored run in scoreboard |
| admin_e2e_journeys.spaghetti_demo | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | admin_e2e_journeys.spaghetti_demo | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| admin_e2e_journeys.photo_3d_world | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | admin_e2e_journeys.photo_3d_world | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| admin_e2e_journeys.text_scene | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | admin_e2e_journeys.text_scene | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| admin_e2e_journeys.character_audition | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | admin_e2e_journeys.character_audition | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| admin_e2e_journeys.sunset_timelapse | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | admin_e2e_journeys.sunset_timelapse | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| admin_e2e_journeys.product_shot | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | admin_e2e_journeys.product_shot | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| admin_e2e_journeys.architectural_viz | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | admin_e2e_journeys.architectural_viz | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| admin_e2e_journeys.music_video | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | admin_e2e_journeys.music_video | OPEN | critic_accepted | | needs live lane run (brain decompose→build→critic) |
| min_video_set.1_text_sunset_ocean_world | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | min_video_set.1_text_sunset_ocean_world | CLOSED | critic_accepted | tests/reports/smoke_sunset_20260606_161555.json | sunset critic ACCEPTED @ 3f0bdec81 |
| min_video_set.2_reference_photo_matched_3d_scene | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | min_video_set.2_reference_photo_matched_3d_scene | OPEN | critic_accepted | | no smoke harness for this family yet (build smoke_<family>.py) |
| min_video_set.3_real_world_location | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | min_video_set.3_real_world_location | OPEN | critic_accepted | | no smoke harness for this family yet (build smoke_<family>.py) |
| min_video_set.4_rainy_neon_city | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | min_video_set.4_rainy_neon_city | OPEN | critic_accepted | | no smoke harness for this family yet (build smoke_<family>.py) |
| min_video_set.5_interior_floor_plan | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | min_video_set.5_interior_floor_plan | OPEN | critic_accepted | | no smoke harness for this family yet (build smoke_<family>.py) |
| min_video_set.6_character_metahuman | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | min_video_set.6_character_metahuman | CLOSED | critic_accepted | tests/reports/smoke_metahuman_20260606_161555.json | metahuman critic ACCEPTED @ 3f0bdec81 |
| min_video_set.7_food_close_up | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | min_video_set.7_food_close_up | OPEN | critic_accepted | | no smoke harness for this family yet (build smoke_<family>.py) |
| min_video_set.8_vehicle_action | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | min_video_set.8_vehicle_action | OPEN | critic_accepted | | no smoke harness for this family yet (build smoke_<family>.py) |
| min_video_set.9_time_lapse_mrq_video | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | min_video_set.9_time_lapse_mrq_video | OPEN | critic_accepted | | no smoke harness for this family yet (build smoke_<family>.py) |
| min_video_set.10_admin_dashboard_proof | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) | | min_video_set.10_admin_dashboard_proof | OPEN | critic_accepted | | no smoke harness for this family yet (build smoke_<family>.py) |