How do I paint over video frames and turn them into a hand-painted animation?

Print the frames at a low frame rate, paint each one on paper, scan the sheets, and put the frames back in order. That is how every hand-painted animation over live footage has been made since people started doing it, and it is still the only way to get real brush marks in the frame. The digital versions, paint one keyframe and let software spread it, or run a "painterly" filter over the clip, give you a painted look. You do not get a painting.

We have tried both. This post is about the hands-on version, why it looks the way it looks, and how MIXD takes the boring half out of it.

What "paint over video frames" actually means

Rotoscoping, in the old sense. The video is under the paper as a guide. You paint what the camera saw, frame by frame, and your hand adds what the camera did not. The footage gives you the motion for free. You do not have to know how a person walks. You trace a person walking and paint them however you like.

That is the trade. The camera takes care of timing and anatomy, and your part is the surface and the mistakes.

The paint-over workflow, hands-on

1. Cut the clip. Two to four seconds of one clear movement. Lock the edit before you print.
2. Upload it and print a contact sheet at 6 to 10 fps. The how-to is in how to print video frames to paint on.
3. Paint. Work across the frames, not one frame at a time. Every background in one pass, then every figure, then the details. We painted frame by frame on our first two sheets and the figure shrank halfway through both.
4. Scan every sheet as a whole page. Do not crop. Do not straighten.
5. Upload the scans and export the MP4. MIXD finds the page, straightens it, crops each frame, and puts them back in order.

The painting is however long you want it to be. The rest is about five minutes.

Translating video motion into painted frames

This is the part nobody explains. The footage moves at 24 or 30 fps. You are painting at 6 or 8. Some things survive that thinning and some do not.

Slow, big movement survives. A head turning, an arm reaching, a walk. At 6 fps you get four or five frames across the move, and the gaps between them read as intent.

Fast, small movement gets lost. A blink is two frames at 24 fps and zero at 6. Fingers typing turn to mush. If the movement matters, pick a clip where it is slower, or bump the frame rate for that clip only. For most phone footage, 8 fps is the compromise. Use 12 if there is a fast beat you cannot lose.

Then there is what you add. The video tells you where the figure is. It does not tell you that the background should be flat orange, or that the figure should be three brush strokes, or that frame 14 gets a scribble because you were annoyed. Those decisions, made 30 times in a row with slight inconsistency, are what make it look hand-painted instead of filtered.

Why it looks alive

Painted animation boils. The edges shiver between frames because no two brush strokes are the same. Editing software would call that an error and smooth it flat, and that is exactly the thing you are hand-painting for.

The rules we ended up with:

Do not fix the boil. If a frame's outline drifts a millimetre from the previous one, leave it.

Leave the drips alone. A drip that appears in frame 9 and is gone in frame 10 is a flicker. Flicker is texture.

Be consistent about the things that matter, loose about everything else. Same palette across all frames. Same rough figure size. Everything else can wander.

Work fast. A frame that took 20 minutes looks laboured next to a frame that took 3. The quick ones are usually better.

What it opens up

Once the frames are on paper, "painting" is a narrow word for it. The same loop takes a knife, a photocopier, a riso, a lighter, a glue stick. We put the material notes in what can I paint or print on printed video frames.

What people make with it. Music videos where the band is painted and the room is not. Title sequences. Reels where a real dog becomes a crayon dog for four seconds and turns back. Wedding footage painted by the couple's kid. A logo that gets scratched into a photo of the shopfront. A dance clip where only the hands are painted, in every frame, and everything else is left as video.

None of those need more than one sheet of A4 to test. The dog one took us an evening.

Start with one sheet

Pick a clip of one thing moving. Print one sheet at 6 fps. Paint it in an hour. Scan it, export it, watch it.

You will learn more from that loop than from planning a minute-long piece you never scan. The full walkthrough, from upload to MP4, is in how to turn a video into a hand-painted animation. The sheets are free. Print one and find out what your hand does at 6 frames per second.