ralpha
/
ralpha-assets
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

FAB completeness scoreboard v1 (2.6% non-roadmap CLOSED, honest baseline) 

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
This commit is contained in:
jamestagg 2026-06-06 13:08:52 -07:00
parent 4a9444227b
commit 7dc3bf6725
2 changed files with 4419 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4130
Content/Ralpha/Demos/fab_scoreboard.json Normal file
View File

File diff suppressed because it is too large Load Diff

289
Content/Ralpha/Demos/fab_scoreboard.md Normal file
View File

@ -0,0 +1,289 @@
# FAB Completeness Scoreboard
**FAB-complete = 6 / 231 non-roadmap promises CLOSED → 2.6%** (total 269, roadmap 38)
| Section | CLOSED | OPEN | BLOCKED | ROADMAP |
|---|---:|---:|---:|---:|
| Public Website Promises | 0 | 11 | 0 | 0 |
| FAB Listing Promises | 0 | 15 | 0 | 0 |
| Public Demo Use Cases | 0 | 13 | 0 | 0 |
| Admin Foundation/Offline | 2 | 4 | 0 | 0 |
| Admin Live UE5/MCP | 0 | 14 | 0 | 0 |
| Active Admin Benchmarks | 4 | 3 | 0 | 0 |
| Planned Benchmark Families | 0 | 0 | 0 | 38 |
| Archetype Registry | 0 | 147 | 0 | 0 |
| Admin E2E Journeys | 0 | 8 | 0 | 0 |
| Min Video Set | 0 | 10 | 0 | 0 |
## Per-promise
| id | status | rubric | evidence | detail |
|---|---|---|---|---|
| public_website_pro.describe_anything_watch_it_build | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| public_website_pro.text_photo_or_floor_plan_input | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| public_website_pro.worlds_not_flat_video | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| public_website_pro.reference_matching | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| public_website_pro.brain_replay | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| public_website_pro.honest_visible_failures | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| public_website_pro.virtual_production | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| public_website_pro.game_prototyping | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| public_website_pro.architectural_visualization | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| public_website_pro.training_and_simulation | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| public_website_pro.plugin_vs_full_system | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| fab_listing_promis.any_ai_can_control_ue5_over_tcp_json_mcp | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| fab_listing_promis.local_first_byo_llm | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| fab_listing_promis.describe_do_not_click | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| fab_listing_promis.auto_iterate | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| fab_listing_promis.deterministic_tools_replace_guesswork | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| fab_listing_promis.capability_contracts_validate_scene_shap | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| fab_listing_promis.full_undo_transactional_commands | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| fab_listing_promis.editor_and_packaged_game_runtime | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| fab_listing_promis.sunset_beach_prompt_works_out_of_box | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| fab_listing_promis.metahuman_prompt_works_out_of_box | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| fab_listing_promis.crowd_prompt_works_out_of_box | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| fab_listing_promis.rainy_night_neon_prompt_works_out_of_box | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| fab_listing_promis.movie_render_pipeline_output | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| fab_listing_promis.geospatial_cesium_support | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| fab_listing_promis.characters_vehicles_weather_atmosphere_c | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| public_demo_use_ca.product_tour | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| public_demo_use_ca.text_to_world | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| public_demo_use_ca.characters | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| public_demo_use_ca.city_generation | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| public_demo_use_ca.floor_plan | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| public_demo_use_ca.sdk_playground | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| public_demo_use_ca.spaghetti | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| public_demo_use_ca.world | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| public_demo_use_ca.time_lapse | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| public_demo_use_ca.upscale_comparison | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| public_demo_use_ca.collaboration | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| public_demo_use_ca.exposure_grading | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| public_demo_use_ca.tree_vegetation | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| admin_foundation_o.proof_of_life | CLOSED | test_pass | tests/reports/harness_20260322_200633.json | pass, 18/18 tests |
| admin_foundation_o.helper_unit_tests | CLOSED | test_pass | tests/reports/harness_20260322_200633.json | pass, 36/36 tests |
| admin_foundation_o.frontend_unit_tests | OPEN | test_pass | | no harness layer report for this suite (needs run) |
| admin_foundation_o.backend_api_tests | OPEN | test_pass | | no harness layer report for this suite (needs run) |
| admin_foundation_o.face_extraction | OPEN | test_pass | | no harness layer report for this suite (needs run) |
| admin_foundation_o.tidal_rendering | OPEN | test_pass | | no harness layer report for this suite (needs run) |
| admin_live_ue5_mcp.mcp_connection | OPEN | test_pass | | no harness layer report for this suite (needs run) |
| admin_live_ue5_mcp.mcp_verification | OPEN | test_pass | tests/reports/harness_20260308_131742.json | suite status=fail |
| admin_live_ue5_mcp.p0_critical | OPEN | test_pass | | no harness layer report for this suite (needs run) |
| admin_live_ue5_mcp.p1_important | OPEN | test_pass | | no harness layer report for this suite (needs run) |
| admin_live_ue5_mcp.functional_verification | OPEN | test_pass | | no harness layer report for this suite (needs run) |
| admin_live_ue5_mcp.all_handlers | OPEN | test_pass | | no harness layer report for this suite (needs run) |
| admin_live_ue5_mcp.newly_enabled_handlers | OPEN | test_pass | | no harness layer report for this suite (needs run) |
| admin_live_ue5_mcp.camera_tests | OPEN | test_pass | | no harness layer report for this suite (needs run) |
| admin_live_ue5_mcp.asset_tests | OPEN | test_pass | | no harness layer report for this suite (needs run) |
| admin_live_ue5_mcp.error_handling | OPEN | test_pass | | no harness layer report for this suite (needs run) |
| admin_live_ue5_mcp.sunset_scenarios | OPEN | test_pass | | no harness layer report for this suite (needs run) |
| admin_live_ue5_mcp.visual_tests | OPEN | test_pass | | no harness layer report for this suite (needs run) |
| admin_live_ue5_mcp.pbr_matching | OPEN | test_pass | | no harness layer report for this suite (needs run) |
| admin_live_ue5_mcp.frontend_e2e | OPEN | test_pass | | no harness layer report for this suite (needs run) |
| active_admin_bench.level_a_where_in_the_world | OPEN | benchmark_pass | tests/reports/level_a_sydney_opera_house_20260326_115915.json | passed=False, score 0.0 < 50.0 |
| active_admin_bench.level_b_blade_runner_city | CLOSED | benchmark_pass | tests/reports/blade_runner_city_20260302_171835.json | passed, score 55.3 ≥ 30.0 |
| active_admin_bench.level_d_australian_outback | CLOSED | benchmark_pass | tests/reports/australian_outback_reconstruction_20260302_171945.json | passed, score 47.1 ≥ 30.0 |
| active_admin_bench.level_e_meerkat_reconstruction | CLOSED | benchmark_pass | tests/reports/meerkat_reverse_engineering_20260302_212504.json | passed, score 81.5 ≥ 20.0 |
| active_admin_bench.level_f_scifi_interior | CLOSED | benchmark_pass | tests/reports/scifi_interior_20260302_172054.json | passed, score 47.1 ≥ 30.0 |
| active_admin_bench.level_s_spaghetti_carbonara | OPEN | benchmark_pass | tests/reports/spaghetti_carbonara_20260302_172107.json | passed=False, score 0.0 < 25.0 |
| active_admin_bench.level_sunset_atmospheric_rendering | OPEN | benchmark_pass | | no report for level sunset |
| planned_benchmark_.environments_gymnast_performance | ROADMAP | n/a | | explicitly deferred (Planned Families) |
| planned_benchmark_.environments_medieval_castle | ROADMAP | n/a | | explicitly deferred (Planned Families) |
| planned_benchmark_.environments_japanese_temple | ROADMAP | n/a | | explicitly deferred (Planned Families) |
| planned_benchmark_.environments_underwater_reef | ROADMAP | n/a | | explicitly deferred (Planned Families) |
| planned_benchmark_.environments_arctic_tundra | ROADMAP | n/a | | explicitly deferred (Planned Families) |
| planned_benchmark_.environments_mars_colony | ROADMAP | n/a | | explicitly deferred (Planned Families) |
| planned_benchmark_.environments_venice_canal | ROADMAP | n/a | | explicitly deferred (Planned Families) |
| planned_benchmark_.environments_ancient_egypt | ROADMAP | n/a | | explicitly deferred (Planned Families) |
| planned_benchmark_.environments_nyc_times_square | ROADMAP | n/a | | explicitly deferred (Planned Families) |
| planned_benchmark_.environments_victorian_london | ROADMAP | n/a | | explicitly deferred (Planned Families) |
| planned_benchmark_.environments_caribbean_sunset | ROADMAP | n/a | | explicitly deferred (Planned Families) |
| planned_benchmark_.environments_haunted_mansion | ROADMAP | n/a | | explicitly deferred (Planned Families) |
| planned_benchmark_.environments_zen_garden | ROADMAP | n/a | | explicitly deferred (Planned Families) |
| planned_benchmark_.environments_volcanic_landscape | ROADMAP | n/a | | explicitly deferred (Planned Families) |
| planned_benchmark_.environments_abandoned_factory | ROADMAP | n/a | | explicitly deferred (Planned Families) |
| planned_benchmark_.characters_performance_boxing_match | ROADMAP | n/a | | explicitly deferred (Planned Families) |
| planned_benchmark_.characters_performance_ballet_performanc | ROADMAP | n/a | | explicitly deferred (Planned Families) |
| planned_benchmark_.characters_performance_concert_pianist | ROADMAP | n/a | | explicitly deferred (Planned Families) |
| planned_benchmark_.characters_performance_chef_master_class | ROADMAP | n/a | | explicitly deferred (Planned Families) |
| planned_benchmark_.characters_performance_surgeon_precision | ROADMAP | n/a | | explicitly deferred (Planned Families) |
| planned_benchmark_.characters_performance_rock_climbing | ROADMAP | n/a | | explicitly deferred (Planned Families) |
| planned_benchmark_.characters_performance_martial_arts_kata | ROADMAP | n/a | | explicitly deferred (Planned Families) |
| planned_benchmark_.characters_performance_painter_at_easel | ROADMAP | n/a | | explicitly deferred (Planned Families) |
| planned_benchmark_.vehicles_action_car_chase | ROADMAP | n/a | | explicitly deferred (Planned Families) |
| planned_benchmark_.vehicles_action_f1_pit_stop | ROADMAP | n/a | | explicitly deferred (Planned Families) |
| planned_benchmark_.vehicles_action_helicopter_landing | ROADMAP | n/a | | explicitly deferred (Planned Families) |
| planned_benchmark_.vehicles_action_motorcycle_canyon | ROADMAP | n/a | | explicitly deferred (Planned Families) |
| planned_benchmark_.vehicles_action_boat_race | ROADMAP | n/a | | explicitly deferred (Planned Families) |
| planned_benchmark_.nature_wildlife_horse_gallop | ROADMAP | n/a | | explicitly deferred (Planned Families) |
| planned_benchmark_.nature_wildlife_eagle_soaring | ROADMAP | n/a | | explicitly deferred (Planned Families) |
| planned_benchmark_.nature_wildlife_fish_school | ROADMAP | n/a | | explicitly deferred (Planned Families) |
| planned_benchmark_.nature_wildlife_wolf_pack | ROADMAP | n/a | | explicitly deferred (Planned Families) |
| planned_benchmark_.nature_wildlife_butterfly_garden | ROADMAP | n/a | | explicitly deferred (Planned Families) |
| planned_benchmark_.complex_scenes_wedding_reception | ROADMAP | n/a | | explicitly deferred (Planned Families) |
| planned_benchmark_.complex_scenes_stadium_crowd | ROADMAP | n/a | | explicitly deferred (Planned Families) |
| planned_benchmark_.complex_scenes_music_festival | ROADMAP | n/a | | explicitly deferred (Planned Families) |
| planned_benchmark_.complex_scenes_market_bazaar | ROADMAP | n/a | | explicitly deferred (Planned Families) |
| planned_benchmark_.complex_scenes_rush_hour_traffic | ROADMAP | n/a | | explicitly deferred (Planned Families) |
| archetype_registry.sunset_over_lake_oswego | OPEN | archetype_solved | scoreboard:sunset-lake | score 0.535 < 0.85 (scored != solved) |
| archetype_registry.clear_blue_sky_at_midday | OPEN | archetype_solved | scoreboard:clear-blue-midday | score 0.100 < 0.85 (scored != solved) |
| archetype_registry.sunrise_over_coast | OPEN | archetype_solved | scoreboard:sunrise-coastal | score 0.315 < 0.85 (scored != solved) |
| archetype_registry.overcast_sky_diffuse_light | OPEN | archetype_solved | scoreboard:overcast-diffuse | score 0.165 < 0.85 (scored != solved) |
| archetype_registry.golden_hour_on_landscape | OPEN | archetype_solved | scoreboard:golden-hour-landscape | score 0.289 < 0.85 (scored != solved) |
| archetype_registry.blue_hour_twilight | OPEN | archetype_solved | scoreboard:blue-hour-twilight | score 0.040 < 0.85 (scored != solved) |
| archetype_registry.starry_night_sky | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.cumulus_cloud_field | OPEN | archetype_solved | scoreboard:cumulus-field | score 0.050 < 0.85 (scored != solved) |
| archetype_registry.dramatic_storm_clouds | OPEN | archetype_solved | scoreboard:storm-clouds | score 0.277 < 0.85 (scored != solved) |
| archetype_registry.rain | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.snowfall_winter | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.fog_in_valley | OPEN | archetype_solved | scoreboard:fog-valley | score 0.314 < 0.85 (scored != solved) |
| archetype_registry.lightning_strike | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.rainbow | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.calm_lake_reflections | OPEN | archetype_solved | scoreboard:calm-lake | score 0.324 < 0.85 (scored != solved) |
| archetype_registry.aerial_beach | OPEN | archetype_solved | scoreboard:ocean-waves | score 0.332 < 0.85 (scored != solved) |
| archetype_registry.tropical_shallow_water | OPEN | archetype_solved | scoreboard:tropical-shallows | score 0.323 < 0.85 (scored != solved) |
| archetype_registry.waterfall | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.mountain_peaks | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.forest_dense_canopy | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.autumn_foliage | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.coastal_cliffs | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.arctic_ice_shelf | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.volcanic_landscape | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.african_savanna | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.city_skyline_at_dusk | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.city_night_neon | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.street_level_daytime | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.interior_with_natural_light | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.interior_artificial_light | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.portrait_studio_lighting | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.portrait_outdoor_natural_light | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.crowd_multiple_people | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.wildlife_animals | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.food_close_up_spaghetti | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.aerial_drone_view | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.macro_extreme_close_up | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.fire_explosion | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.dramatic_sunset_multi_system | OPEN | archetype_solved | scoreboard:sunset-dramatic | score 0.368 < 0.85 (scored != solved) |
| archetype_registry.bridge_silhouette_at_sunset | OPEN | archetype_solved | scoreboard:tappan-zee-sunset | score 0.335 < 0.85 (scored != solved) |
| archetype_registry.rain_city_night | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.blizzard_on_mountain | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.tropical_beach_at_noon | OPEN | archetype_solved | scoreboard:tropical-beach-noon | score 0.375 < 0.85 (scored != solved) |
| archetype_registry.mount_everest | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sahara_desert_dunes | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.grand_canyon | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.blue_marble_earth_from_space | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.bamboo_forest_arashiyama | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.south_pole_penguins | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.niagara_falls | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.great_barrier_reef_underwater | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.northern_lights_over_iceland | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.cherry_blossom_sakura | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.venice_canal | OPEN | archetype_solved | scoreboard:venetian-canal | score 0.321 < 0.85 (scored != solved) |
| archetype_registry.milky_way_over_desert | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.tornado_supercell | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.norwegian_fjord | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.cathedral_stained_glass | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.japanese_onsen | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.abandoned_industrial | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.modern_kitchen | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.pirate_ship_in_storm | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.ancient_rome_colosseum | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.alien_planet_titan | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.western_showdown | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.space_station_interior_iss | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.saturn_and_rings | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.moon_landing | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.santorini_blue_domes | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.hong_kong_density | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.favela_hillside | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.gothic_castle | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.salt_flat_mirror_uyuni | OPEN | archetype_solved | scoreboard:salt-flat-mirror | score 0.348 < 0.85 (scored != solved) |
| archetype_registry.redwood_forest | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.neon_tokyo_shibuya | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.burning_building | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.ballet_dancer | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.orchestra_concert | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.astronaut_eva_spacewalk | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.medieval_knight | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sushi_platter | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.street_food_night_market | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.formula_1_car | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sailing_yacht | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.steam_locomotive | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.city_skyline_at_night | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.campfire | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sandstorm | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.hurricane_eye | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.frozen_wave_iceland | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.river_rapids | OPEN | archetype_solved | scoreboard:river-rapids | score 0.040 < 0.85 (scored != solved) |
| archetype_registry.cave_cenote | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.rice_terraces_bali | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.meteor_crater | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.solar_eclipse | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.crepuscular_rays_god_rays | OPEN | archetype_solved | scoreboard:crepuscular-rays | score 0.506 < 0.85 (scored != solved) |
| archetype_registry.jurassic_jungle | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.frozen_waterfall | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.underground_river_cave | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.helicopter_over_city | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_venice_lagoon_italy | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_2002_08_westerland_sun | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_kitesurfer_at_sunset_w | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_sunset_kuta_bali_indon | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_adrian_balcan_tghotzgj | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_ahzza_fathima_97vhxc8d | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_alexander_akimenko_qzj | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_alexander_milano_bthou | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_ali_abdul_rahman_k0kox | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_alina_iustyna_hcya7nbu | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_ann_danilina_1a3xhwknx | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_canada_lake | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_cindy_del_valle_y_xzy0 | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_damien_dufour_qkwcazwr | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_dave_hoefler_tv_jtiaah | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_evan_bollag_ryf5ksvz3n | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_explore_with_joshua_a3 | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_gabriel_garcia_marengo | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_giuseppe_famiani_9g8sd | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_graphic_node_uakk7d3za | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_guillaume_bleyer_y18pv | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_igor_oliyarnik_wp8tnv9 | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_john_murphey_dxnnb18kk | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_josh_sorenson_avpmotpd | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_josh_sorenson_avpmotpd_2 | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_joshua_wilson_xyhfprrr | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_koji_futami_l8dldjy95u | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_krista_little_s1bodymf | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_lawless_capture_k60s_7 | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_linus_nylund_jp23z_da7 | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_malachi_brooks_e2cm7pj | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_matthew_feeney_hpgjeqp | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_megs_harrison_dq3b6rrn | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_mohamed_jamil_latrach_ | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_philip_graves_jviwbruk | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_raimond_klavins_wv4xvn | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_sebastien_gabriel_imlv | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_sifat_niloy_0oygagrbqs | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_stories_hrx5wxfyb64_un | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_tim_s_oy1ittyvxko_unsp | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_todd_jiang_qsfracvafi_ | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_todd_kent_phbplpltltq_ | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_valeriia_neganova_3lfn | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_virgil_cayasa_vaiuzsgw | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_vladimir_fedotov_nu2w_ | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_zoltan_tasi_khd_fa43am | OPEN | archetype_solved | | no scored run in scoreboard |
| archetype_registry.sunset_over_water_zuzana_ruttkay_npovqal | OPEN | archetype_solved | | no scored run in scoreboard |
| admin_e2e_journeys.spaghetti_demo | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| admin_e2e_journeys.photo_3d_world | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| admin_e2e_journeys.text_scene | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| admin_e2e_journeys.character_audition | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| admin_e2e_journeys.sunset_timelapse | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| admin_e2e_journeys.product_shot | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| admin_e2e_journeys.architectural_viz | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| admin_e2e_journeys.music_video | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| min_video_set.1_text_sunset_ocean_world | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| min_video_set.2_reference_photo_matched_3d_scene | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| min_video_set.3_real_world_location | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| min_video_set.4_rainy_neon_city | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| min_video_set.5_interior_floor_plan | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| min_video_set.6_character_metahuman | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| min_video_set.7_food_close_up | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| min_video_set.8_vehicle_action | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| min_video_set.9_time_lapse_mrq_video | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |
| min_video_set.10_admin_dashboard_proof | OPEN | critic_accepted | | needs live proof run (smoke --emit-json / lane critic) |