<- Index

Material Video Processing

I’m building a piece of software around a simple idea: take a video, pull it into the physical world, disturb it, then bring it back.

It breaks a video into frames, lets you export them as printable sheets, with a variety of effects, then reconstructs the video after the frames have been altered.

Here’s a clip of my friends Hannah and Sirus in a bathtub. I’ve reduced the image to a binary threshold.

The software's window. A left panel of controls — input file MVI_8078.AVI, effect set to threshold, a threshold slider at 85, a frame selector reading frame 186 of 390, and buttons for Preview Frame, Save Frame, Process Video and Create Sprite Sheets. The preview beside it shows the source frame of two people crouched in a bathtub next to the same frame reduced to flat black and white.

From there the software generates sprite sheets, which are grids containing every frame of the video.

Sprite Sheet 5: a printable page of eighteen thresholded frames in a three-column grid, each numbered in the corner. The early rows are near-solid black shapes; in the last rows the camera swings and a face resolves out of the black.

These sheets can be printed, and this is where the process opens up.

You can draw on them, cut parts out, color them in, add stickers. You could burn them, spit on them, spill something on them, or shoot them with a gun. You could dig a hole and bury them for a week, leave them out in the sun, or run them through the washing machine. You could use them as a coaster, let a child draw on them, or stick them in the oven on low heat for a few hours.

At that point, it’s out of your hands. That’s kind of the point.

Here, I printed them onto pages from an old magazine, letting the original text and images bleed into the frames.

Sprite Sheet 5 printed onto a page of a 1973 Western book catalogue. The thresholded frames of the two figures in the bathtub sit in their grid over columns of book listings and prices, headings for THE AMERICAN WEST and START YOUR CHRISTMAS SHOPPING showing through the white of the frames. A mail order form runs along the bottom under ALL AT BARGAIN PRICES.
The software's second tab, Sprite Sheets to Video. The controls read Found 4 sprite sheets, a grid layout of 7 rows by 3 columns making 21 frames per sheet, and sliders for horizontal and vertical offset, frame spacing, frame width and height, and page margin. The preview shows a scanned printed sheet — the thresholded frames over a page of Old West magazine text and a portrait photograph — with the alignment grid laid over it.
trampoline scanimation