Collecting some recordings of recent experiments. Taking photos of my books, using Gemini image edit generation to isolate those books and then removing their backgrounds, embedding generated summaries of those books and exploring them across various layouts.

Spines and covers

Tabletop + nano banana experiment where you draw over the top of the generated image and feed it back. Searching for a sweetspot of physical <-> digital interaction. (video sped up and edited)

A weird mc escher-ish one:

Working on a book site

Promising result from ranking my handwritten notes using embeddings and then prompting for connections to the top result. Need to prompt it into less clumsy language though.

Needs some cleanup, but having fun.

I got the basics of vector embedding retrieval working for my tabletop notes. Thinking about a more intensely minimal interface that really is image only.

Doing some experiments with my overhead camera setup and the work-in-progress sampler app. Not sure where it's headed but I do like moving between physical and digital arrangement.

Stretch vignette

I have this vague idea of using image blocks as 'light sources' that cast low-resolution light based off their content into the surrounding canvas. Haven't figured out the system yet though.

Experimenting with recording timelapses. Niri has this neat dynamic cast target feature, though right now it's triggered by a hot key and i kept forgetting to switch it.

Capture the difference between two moments in time at https://ghost.constraint.systems/

Experimenting with playing slightly time offset stacked videos. To what purpose I'm not sure.

I tested out my Sampler prototype by converting highlights on a printout into a digital collage and recorded a video documenting the process.

The setup

The result

Starting to enjoy the feel of this.

Experimenting with putting controls and info on the canvas - with some reciprocal scaling to make it more readable. Needs some more finesse but interesting so far.