ralpha-assets/benchmark/references/README.md

Benchmark Reference Images

Reference images for brain testing. Each scene has its own directory with:

• reference.jpg — the target image (what we're trying to match)
• reference-low.jpg — quick preview (optional)
• metadata.md — scene characterisation, key elements, brain config
• breakdown.md — detailed element segmentation (for complex scenes)

Directory Structure

benchmark/
├── references/              Source reference images (this directory)
│   ├── sea/
│   │   ├── sunset-oswego/         ★ First test target (Lake Ontario sunset)
│   │   └── ocean-horizon/           Aerial tropical beach, turquoise water
│   ├── sky/
│   │   ├── sunset-dramatic/         Dramatic fiery sunset
│   │   ├── tappan-zee-sunset/       Bridge at sunset (Hudson River)
│   │   ├── golden-hour-clouds/      Warm-lit cloud formations
│   │   ├── mojave-twilight/         Desert twilight (California)
│   │   ├── san-diego-sunset/        Pacific coast sunset
│   │   ├── fiery-silhouette/        City silhouette against fire sky
│   │   ├── city-sunrise/            6AM urban sunrise
│   │   └── sunset-2007/             Classic sunset
│   ├── urban/
│   │   ├── paris-eiffel/          ★ Golden hour Seine (27 elements)
│   │   └── blade-runner/             Cyberpunk city, rain, neon, flying vehicles
│   ├── food/
│   │   └── spaghetti/                Carbonara food photography
│   ├── parks/
│   │   └── central-park/             NYC urban park (Cesium)
│   ├── portrait/
│   │   ├── alysson/                  Lab portrait, fluorescent lighting
│   │   ├── jamest-seated/            Seated in armchair, warm tungsten
│   │   ├── jamest-standing/          Standing by piano, elegant interior
│   │   ├── joi-close/               BR2049 hologram close-up, neon purple
│   │   ├── joi-wide/                BR2049 hologram wide, pink fog
│   │   ├── dbrin-xian/              Museum portrait, terracotta warriors
│   │   ├── portrait-2007/           Stage profile, dramatic spot lighting
│   │   └── distracted-boyfriend/     Street group (3 people), shallow DoF
│   ├── nature/
│   │   └── mountain/                 Mountain valley, boreal forest, snow peaks
│   ├── weather/
│   │   └── fog/                      Churning ocean foam, turbulent water
│   └── Hard/
│       └── lasergirls/               Neon LED portrait, two children, hex backdrop
├── lighting_presets/        10 PBR lighting benchmark presets
├── outputs/                 Generated iteration outputs (gitignored)
└── scores/                  Scoring results (gitignored)

Coverage Summary

Domain	Count	Scenes
sky	8	sunset-2007, sunset-dramatic, tappan-zee-sunset, golden-hour-clouds, mojave-twilight, san-diego-sunset, fiery-silhouette, city-sunrise
portrait	8	alysson, jamest-seated, jamest-standing, joi-close, joi-wide, dbrin-xian, portrait-2007, distracted-boyfriend
sea	2	sunset-oswego, ocean-horizon
urban	2	paris-eiffel, blade-runner
food	1	spaghetti
nature	1	mountain
parks	1	central-park
weather	1	fog
Hard	1	lasergirls
Total	25	across 9 domains

Priority Test Scenes

#	Scene	Domain	Difficulty	Notes
1	sunset-oswego	SKY + SEA	Medium	Our original test target
2	paris-eiffel	GEO + SKY + WATER	Hard	Full Cesium + living replacement
3	central-park	EARTH + SKY	Medium	Cesium + City Parks Pack
4	spaghetti	FOOD	Medium	Indoor, food photography
5	mountain	EARTH + SKY	Easy	Landscape + atmosphere

Adding a New Scene

1. Create a directory: benchmark/references/{domain}/{scene-name}/
2. Add reference.jpg (or .png)
3. Add metadata.md with scene characterisation and brain config
4. Optionally add reference-low.jpg, reference.mask.png, breakdown.md

Storage Notes

These are binary files. For the git repo, only small/compressed versions are tracked. Full-resolution originals can go in ralpha-ue5 LFS repo if needed.