Ernst Haeckel Γ— Stable Diffusion 1.5

Haeckel LoRA

A LoRA trained on all 100 plates of Kunstformen der Natur. Scroll to explore the training run and generated plates directly β€” drag, scrub, click.

100plates
124epochs
6/11bg-color accuracy
Cover of Ernst Haeckel's Kunstformen der Natur, 1904
Pipeline

Scrape to eval

βœ“ Scrape β€” 100 plates
βœ“ Dedup β€” 0 near-dupes
βœ“ Caption β€” genus/order/bg-color
βœ“ 1,102-figure docs
βœ“ Rank-16 LoRA, 6GB VRAM
βœ“ 124 epochs, 3,100 steps
βœ“ Full seeded eval
βœ“ Background-color fix
β—‹ Genus-specific anatomy
124-epoch run

Converges, then plateaus

Drag to scrub through the run. Loss drops for ~50 epochs, then goes flat β€” the remaining ~74 epochs bought almost nothing.

Training sample step 750 Β· converging
750 / 3,100 steps

Loss, per-epoch mean

0.188 β†’ ~0.15, flat from ep. 50
0.211 0.183 0.155 0.128 0.100 epoch 50 β€” plateau starts ep 0ep 123
Root cause, found and fixed

The background-color bias

Captions never mentioned background color, so the model guessed. Fixed by measuring each plate's real background from its pixels β€” a clean, wide split, not a guess.

Two rounds of fine-tuning later (including one that doubled pale-example exposure for 40 more epochs), here's the honest result on the 12-plate eval sample β€” no net gain between rounds, some plates just traded places:

6/11 correct background color (1 plate excluded β€” full outdoor scene, not a flat-background plate)

Real plate vs. generated

Drag to compare

Same caption the model trained on. A win, a nuanced case, and an honest miss β€” not cherry-picked.

Generated Diatomea plate
Real Tafel 84, Navicula, Diatomea
Real Generated

Tafel 84 β€” Navicula, Diatomea. βœ“ correct black bg β€” a genuine win.

Generated Carmaris plate
Real Tafel 26, Carmaris, Trachomedusae
Real Generated

Tafel 26 β€” Carmaris, Trachomedusae. βœ“ correct pale bg, but the jellyfish rendered as an abstract cage.

Generated Ostracion plate
Real Tafel 42, Ostracion, Ostraciontes
Real Generated

Tafel 42 β€” Ostracion, Ostraciontes. βœ— teal, not pale β€” didn't move across two fine-tuning rounds.

Novel recombinations

Prompts that don't exist in the training set. No ground truth β€” the question is plausibility.

Novel generation 1
discomedusae Β· "aurelia nova"
Novel generation 2
siphonophorae Β· deep-sea species
Novel generation 3
radiolaria Β· colonial, larger
Novel generation 4
hexacoralla Γ— radiolaria
Novel generation 5
ophiodea Γ— siphonophorae
Novel generation 6
calcispongiae Β· undiscovered
Where this stands

Status

Done

Scrape, dedup, caption β€” reproducible from scratch
1,102-figure documentation from Haeckel's own text
124-epoch run β€” plateau confirmed, not assumed
Full eval against real checkpoints
Background-color fix, root-caused and measured

Open / accepted as-is

Genus-specific anatomy (e.g. jellyfish β†’ abstract shape)
Further bg-color chasing β€” two rounds, no net gain, stopped
Haeckel's Mistakes β€” companion adapter on the 1887 Challenger Report drawings