Inspired by dynamicland to try some real world manipulation linked to digital objects. I'd guessed coarse color matching would be enough here - it may not be.

Red construction paper in real life moves sloth on computer