An apriltag color-picker where x=red, y=green, rotation=blue. A freeform physical slider feels interesting

Also did a 3 card one - different tags all get IDs which makes me think of doing some sort of weird physical variable assignment thing.

Book-to-soundtrack experiment - a projector setup where I send the book image off to Gemini for recommendations and then play with Spotify. Meant to be kind of like putting on a record but for objects. (I clipped out the loading times.)

Thinking about the possibilities of having adjusted mirrors as part of the projector system.

Testing out the mirror

https://tangible.media.mit.edu/project/sandscape/

Trying out april tags. Thinking about how it could complement hand tracking and vision models. This is using https://github.com/arenaxr/apriltag-js-standalone. and I know what april tags are because of https://folk.computer.

Trying out a color picker to get a feel for tabletop UI. I can do it all with pointer fingers (rather than pinch) if I give myself a path to reach them without colliding with other things. Kind of like a maze.

Trying out hand-tracking triggered buttons and some simple LLM calls. There are definite limits imposed by hand-tracking and projector display - but they're kind of interesting ones.

Triggering buttons on overlap

Color change - was not working at first because of webcam reacting to light change, fixed by turning on the overhead light so it's more constant.

I got a projector and webcam set up over the tabletop. Experimenting with hand-tracking.

Tracking pinches

Tracking and projecting pointer fingers

Collecting some recordings of recent experiments. Taking photos of my books, using Gemini image edit generation to isolate those books and then removing their backgrounds, embedding generated summaries of those books and exploring them across various layouts.

Spines and covers

I was looking at a short school bus with three windows with three decals applied beneath. I think it was "Quality", "Bus", "Corp" or something like that. And I was looking to see how they had aligned the decals under the windows. Left-aligned on each one? Left, center, middle? read on scrawl

Working on a book site

Correction: should be Wookash

Re-setup my workspace with a monitor in the tabletop and an overhead camera. Aiming to do more physical computing experiments.

The final arrangement

Stripped down the old setup