89 lines
4.3 KiB
Markdown
89 lines
4.3 KiB
Markdown
# Benchmark Reference Images
|
|
|
|
Reference images for brain testing. Each scene has its own directory with:
|
|
- `reference.jpg` — the target image (what we're trying to match)
|
|
- `reference-low.jpg` — quick preview (optional)
|
|
- `metadata.md` — scene characterisation, key elements, brain config
|
|
- `breakdown.md` — detailed element segmentation (for complex scenes)
|
|
|
|
## Directory Structure
|
|
|
|
```
|
|
benchmark/
|
|
├── references/ Source reference images (this directory)
|
|
│ ├── sea/
|
|
│ │ ├── sunset-oswego/ ★ First test target (Lake Ontario sunset)
|
|
│ │ └── ocean-horizon/ Aerial tropical beach, turquoise water
|
|
│ ├── sky/
|
|
│ │ ├── sunset-dramatic/ Dramatic fiery sunset
|
|
│ │ ├── tappan-zee-sunset/ Bridge at sunset (Hudson River)
|
|
│ │ ├── golden-hour-clouds/ Warm-lit cloud formations
|
|
│ │ ├── mojave-twilight/ Desert twilight (California)
|
|
│ │ ├── san-diego-sunset/ Pacific coast sunset
|
|
│ │ ├── fiery-silhouette/ City silhouette against fire sky
|
|
│ │ ├── city-sunrise/ 6AM urban sunrise
|
|
│ │ └── sunset-2007/ Classic sunset
|
|
│ ├── urban/
|
|
│ │ ├── paris-eiffel/ ★ Golden hour Seine (27 elements)
|
|
│ │ └── blade-runner/ Cyberpunk city, rain, neon, flying vehicles
|
|
│ ├── food/
|
|
│ │ └── spaghetti/ Carbonara food photography
|
|
│ ├── parks/
|
|
│ │ └── central-park/ NYC urban park (Cesium)
|
|
│ ├── portrait/
|
|
│ │ ├── alysson/ Lab portrait, fluorescent lighting
|
|
│ │ ├── jamest-seated/ Seated in armchair, warm tungsten
|
|
│ │ ├── jamest-standing/ Standing by piano, elegant interior
|
|
│ │ ├── joi-close/ BR2049 hologram close-up, neon purple
|
|
│ │ ├── joi-wide/ BR2049 hologram wide, pink fog
|
|
│ │ ├── dbrin-xian/ Museum portrait, terracotta warriors
|
|
│ │ ├── portrait-2007/ Stage profile, dramatic spot lighting
|
|
│ │ └── distracted-boyfriend/ Street group (3 people), shallow DoF
|
|
│ ├── nature/
|
|
│ │ └── mountain/ Mountain valley, boreal forest, snow peaks
|
|
│ ├── weather/
|
|
│ │ └── fog/ Churning ocean foam, turbulent water
|
|
│ └── Hard/
|
|
│ └── lasergirls/ Neon LED portrait, two children, hex backdrop
|
|
├── lighting_presets/ 10 PBR lighting benchmark presets
|
|
├── outputs/ Generated iteration outputs (gitignored)
|
|
└── scores/ Scoring results (gitignored)
|
|
```
|
|
|
|
## Coverage Summary
|
|
|
|
| Domain | Count | Scenes |
|
|
|--------|-------|--------|
|
|
| sky | 8 | sunset-2007, sunset-dramatic, tappan-zee-sunset, golden-hour-clouds, mojave-twilight, san-diego-sunset, fiery-silhouette, city-sunrise |
|
|
| portrait | 8 | alysson, jamest-seated, jamest-standing, joi-close, joi-wide, dbrin-xian, portrait-2007, distracted-boyfriend |
|
|
| sea | 2 | sunset-oswego, ocean-horizon |
|
|
| urban | 2 | paris-eiffel, blade-runner |
|
|
| food | 1 | spaghetti |
|
|
| nature | 1 | mountain |
|
|
| parks | 1 | central-park |
|
|
| weather | 1 | fog |
|
|
| Hard | 1 | lasergirls |
|
|
| **Total** | **25** | **across 9 domains** |
|
|
|
|
## Priority Test Scenes
|
|
|
|
| # | Scene | Domain | Difficulty | Notes |
|
|
|---|-------|--------|------------|-------|
|
|
| 1 | **sunset-oswego** | SKY + SEA | Medium | Our original test target |
|
|
| 2 | **paris-eiffel** | GEO + SKY + WATER | Hard | Full Cesium + living replacement |
|
|
| 3 | **central-park** | EARTH + SKY | Medium | Cesium + City Parks Pack |
|
|
| 4 | **spaghetti** | FOOD | Medium | Indoor, food photography |
|
|
| 5 | **mountain** | EARTH + SKY | Easy | Landscape + atmosphere |
|
|
|
|
## Adding a New Scene
|
|
|
|
1. Create a directory: `benchmark/references/{domain}/{scene-name}/`
|
|
2. Add `reference.jpg` (or `.png`)
|
|
3. Add `metadata.md` with scene characterisation and brain config
|
|
4. Optionally add `reference-low.jpg`, `reference.mask.png`, `breakdown.md`
|
|
|
|
## Storage Notes
|
|
|
|
These are binary files. For the git repo, only small/compressed versions are tracked.
|
|
Full-resolution originals can go in `ralpha-ue5` LFS repo if needed.
|