RUSHU
experiments··7 min read

Can AI Rebuild a Website From a Screenshot?

Testing multimodal models on complex editorial typography, asymmetric grids, and responsive layouts.

Rushu

Rushu

Product Engineer & Writer

Architectural composition with precise lines

Evaluating visual fidelity and token alignment across multimodal vision models.

EXPERIMENT 007 SPECIFICATIONComplete · 4 days
Tools & Models:
Claude 3.7 SonnetGemini 1.5 ProGPT-4oPlaywrightResemble.js
Hypothesis:

Multimodal LLMs can reproduce complex editorial web layouts with under 5% pixel discrepancy within 3 iterative prompt passes without human CSS intervention.

The Experiment Setup

Every week, a new social media demo claims: "I took a picture of a napkin and an AI gave me a production-ready application."

As someone who cares deeply about editorial design, typographic hierarchy, and micro-spacing, I wanted to rigorously benchmark this claim. Can vision models faithfully translate human visual intent into modern, semantic frontend code?

Methodology & Benchmark Targets

We tested three visually demanding targets:

  • Target A: The Editorial Monograph: Large serif headlines, hairline borders, asymmetric text columns, and delicate metadata tags.
  • Target B: The Technical Documentation Grid: Multi-level sticky navigation, syntax-highlighted code containers, and collapsible callouts.
  • Target C: The Creator Publication: Off-white textured canvas, custom photo framing, and mixed font pairings.
typescript
// benchmark-runner.ts
interface BenchmarkResult {
  target: string;
  model: string;
  structuralScore: number; // DOM node alignment
  pixelDelta: number;      // Resemble.js mismatch percentage
  tokenEfficiency: number; // Lines of CSS generated
}

What Failed: The Card Bias

The most pervasive failure mode across all models was what I call The Card Bias.

When presented with an artistic, asymmetric layout where text freely overlaps an image boundary or hangs into the margin, models almost invariably simplified the design into a standardized 3-column card grid with rounded corners (rounded-xl) and drop shadows (shadow-md).

The models defaulted to generic SaaS patterns because their training sets are saturated with thousands of landing page templates.

Key Takeaway

If you want AI to build an editorial website, you cannot simply say "Make it look like this image." You must define the architectural rules first:

  1. Constrain font choices to specific typographic pairings.
  2. Forbid generic card wrappers and arbitrary border-radii.
  3. Provide explicit semantic color tokens instead of letting the model invent hex codes.
Related Project

SlopFree

Detect suspicious dependencies before they enter your project.

Project Specs →

Related Writing

Writing··9 min read

What I Learned Auditing 10,000 npm Packages

Supply chain risks, phantom dependencies, and why install scripts remain JavaScript's largest security blind spot.

#Security#Node.js#Open Source
Documentation··6 min read

SlopFree Architecture & CLI Reference

Complete technical reference, installation guide, AST heuristics, and CI/CD integration.

#Documentation#SlopFree#CLI