# Benchmark Reference Images Reference images for brain testing. Each scene has its own directory with: - `reference.jpg` — the target image (what we're trying to match) - `reference-low.jpg` — quick preview (optional) - `metadata.md` — scene characterisation, key elements, brain config - `breakdown.md` — detailed element segmentation (for complex scenes) ## Directory Structure ``` benchmark/ ├── references/ Source reference images (this directory) │ ├── sea/ │ │ ├── sunset-oswego/ ★ First test target (Lake Ontario sunset) │ │ └── ocean-horizon/ Aerial tropical beach, turquoise water │ ├── sky/ │ │ ├── sunset-dramatic/ Dramatic fiery sunset │ │ ├── tappan-zee-sunset/ Bridge at sunset (Hudson River) │ │ ├── golden-hour-clouds/ Warm-lit cloud formations │ │ ├── mojave-twilight/ Desert twilight (California) │ │ ├── san-diego-sunset/ Pacific coast sunset │ │ ├── fiery-silhouette/ City silhouette against fire sky │ │ ├── city-sunrise/ 6AM urban sunrise │ │ └── sunset-2007/ Classic sunset │ ├── urban/ │ │ ├── paris-eiffel/ ★ Golden hour Seine (27 elements) │ │ └── blade-runner/ Cyberpunk city, rain, neon, flying vehicles │ ├── food/ │ │ └── spaghetti/ Carbonara food photography │ ├── parks/ │ │ └── central-park/ NYC urban park (Cesium) │ ├── portrait/ │ │ ├── alysson/ Lab portrait, fluorescent lighting │ │ ├── jamest-seated/ Seated in armchair, warm tungsten │ │ ├── jamest-standing/ Standing by piano, elegant interior │ │ ├── joi-close/ BR2049 hologram close-up, neon purple │ │ ├── joi-wide/ BR2049 hologram wide, pink fog │ │ ├── dbrin-xian/ Museum portrait, terracotta warriors │ │ ├── portrait-2007/ Stage profile, dramatic spot lighting │ │ └── distracted-boyfriend/ Street group (3 people), shallow DoF │ ├── nature/ │ │ └── mountain/ Mountain valley, boreal forest, snow peaks │ ├── weather/ │ │ └── fog/ Churning ocean foam, turbulent water │ └── Hard/ │ └── lasergirls/ Neon LED portrait, two children, hex backdrop ├── lighting_presets/ 10 PBR lighting benchmark presets ├── outputs/ Generated iteration outputs (gitignored) └── scores/ Scoring results (gitignored) ``` ## Coverage Summary | Domain | Count | Scenes | |--------|-------|--------| | sky | 8 | sunset-2007, sunset-dramatic, tappan-zee-sunset, golden-hour-clouds, mojave-twilight, san-diego-sunset, fiery-silhouette, city-sunrise | | portrait | 8 | alysson, jamest-seated, jamest-standing, joi-close, joi-wide, dbrin-xian, portrait-2007, distracted-boyfriend | | sea | 2 | sunset-oswego, ocean-horizon | | urban | 2 | paris-eiffel, blade-runner | | food | 1 | spaghetti | | nature | 1 | mountain | | parks | 1 | central-park | | weather | 1 | fog | | Hard | 1 | lasergirls | | **Total** | **25** | **across 9 domains** | ## Priority Test Scenes | # | Scene | Domain | Difficulty | Notes | |---|-------|--------|------------|-------| | 1 | **sunset-oswego** | SKY + SEA | Medium | Our original test target | | 2 | **paris-eiffel** | GEO + SKY + WATER | Hard | Full Cesium + living replacement | | 3 | **central-park** | EARTH + SKY | Medium | Cesium + City Parks Pack | | 4 | **spaghetti** | FOOD | Medium | Indoor, food photography | | 5 | **mountain** | EARTH + SKY | Easy | Landscape + atmosphere | ## Adding a New Scene 1. Create a directory: `benchmark/references/{domain}/{scene-name}/` 2. Add `reference.jpg` (or `.png`) 3. Add `metadata.md` with scene characterisation and brain config 4. Optionally add `reference-low.jpg`, `reference.mask.png`, `breakdown.md` ## Storage Notes These are binary files. For the git repo, only small/compressed versions are tracked. Full-resolution originals can go in `ralpha-ue5` LFS repo if needed.