Benchmark Reference Images
Reference images for brain testing. Each scene has its own directory with:
reference.jpg — the target image (what we're trying to match)
reference-low.jpg — quick preview (optional)
metadata.md — scene characterisation, key elements, brain config
breakdown.md — detailed element segmentation (for complex scenes)
Directory Structure
benchmark/
├── references/ Source reference images (this directory)
│ ├── sea/
│ │ ├── sunset-oswego/ ★ First test target (Lake Ontario sunset)
│ │ └── ocean-horizon/ Aerial tropical beach, turquoise water
│ ├── sky/
│ │ ├── sunset-dramatic/ Dramatic fiery sunset
│ │ ├── tappan-zee-sunset/ Bridge at sunset (Hudson River)
│ │ ├── golden-hour-clouds/ Warm-lit cloud formations
│ │ ├── mojave-twilight/ Desert twilight (California)
│ │ ├── san-diego-sunset/ Pacific coast sunset
│ │ ├── fiery-silhouette/ City silhouette against fire sky
│ │ ├── city-sunrise/ 6AM urban sunrise
│ │ └── sunset-2007/ Classic sunset
│ ├── urban/
│ │ ├── paris-eiffel/ ★ Golden hour Seine (27 elements)
│ │ └── blade-runner/ Cyberpunk city, rain, neon, flying vehicles
│ ├── food/
│ │ └── spaghetti/ Carbonara food photography
│ ├── parks/
│ │ └── central-park/ NYC urban park (Cesium)
│ ├── portrait/
│ │ ├── alysson/ Lab portrait, fluorescent lighting
│ │ ├── jamest-seated/ Seated in armchair, warm tungsten
│ │ ├── jamest-standing/ Standing by piano, elegant interior
│ │ ├── joi-close/ BR2049 hologram close-up, neon purple
│ │ ├── joi-wide/ BR2049 hologram wide, pink fog
│ │ ├── dbrin-xian/ Museum portrait, terracotta warriors
│ │ ├── portrait-2007/ Stage profile, dramatic spot lighting
│ │ └── distracted-boyfriend/ Street group (3 people), shallow DoF
│ ├── nature/
│ │ └── mountain/ Mountain valley, boreal forest, snow peaks
│ ├── weather/
│ │ └── fog/ Churning ocean foam, turbulent water
│ └── Hard/
│ └── lasergirls/ Neon LED portrait, two children, hex backdrop
├── lighting_presets/ 10 PBR lighting benchmark presets
├── outputs/ Generated iteration outputs (gitignored)
└── scores/ Scoring results (gitignored)
Coverage Summary
| Domain |
Count |
Scenes |
| sky |
8 |
sunset-2007, sunset-dramatic, tappan-zee-sunset, golden-hour-clouds, mojave-twilight, san-diego-sunset, fiery-silhouette, city-sunrise |
| portrait |
8 |
alysson, jamest-seated, jamest-standing, joi-close, joi-wide, dbrin-xian, portrait-2007, distracted-boyfriend |
| sea |
2 |
sunset-oswego, ocean-horizon |
| urban |
2 |
paris-eiffel, blade-runner |
| food |
1 |
spaghetti |
| nature |
1 |
mountain |
| parks |
1 |
central-park |
| weather |
1 |
fog |
| Hard |
1 |
lasergirls |
| Total |
25 |
across 9 domains |
Priority Test Scenes
| # |
Scene |
Domain |
Difficulty |
Notes |
| 1 |
sunset-oswego |
SKY + SEA |
Medium |
Our original test target |
| 2 |
paris-eiffel |
GEO + SKY + WATER |
Hard |
Full Cesium + living replacement |
| 3 |
central-park |
EARTH + SKY |
Medium |
Cesium + City Parks Pack |
| 4 |
spaghetti |
FOOD |
Medium |
Indoor, food photography |
| 5 |
mountain |
EARTH + SKY |
Easy |
Landscape + atmosphere |
Adding a New Scene
- Create a directory:
benchmark/references/{domain}/{scene-name}/
- Add
reference.jpg (or .png)
- Add
metadata.md with scene characterisation and brain config
- Optionally add
reference-low.jpg, reference.mask.png, breakdown.md
Storage Notes
These are binary files. For the git repo, only small/compressed versions are tracked.
Full-resolution originals can go in ralpha-ue5 LFS repo if needed.