Cameras
Blur Lock focusTrack AprilTags with your camera
Pick a camera and press Start. Show a printed tag36h11 tag to the camera, give it a name, and watch its last second of motion in 3D. Add more cameras to track from several sides.
Video is processed on this computer and never sent anywhere.
Recording
Records every pose the Track tab plots, with your notes.Press V and speak. “Track”, “Calibrate”, “Stream”, “Settings”, “Start recording”, “Stop recording”, “Tare”, “Clear tare”, “Calibrate robot”, “Fit” and “Reset view” are commands; anything else is a note. Speech stays on this computer; the model downloads once (40 MB, or 120 MB on the graphics card).
Tags
| Colour | ID | Name | Size | Status | Actions |
|---|
No tags yet. Show one to the camera and it will appear here to name, or add one by its ID.
Rigid objects
Fix two or more tags to one object, at different angles, and it is tracked as one pose from all their corners: steadier, and free of the mirror-image flips a single flat tag can have.
Motion sensors
Use BLE, a direct USB controller, or a USB-connected XIAO ESB receiver. USB and ESB require TP/1 teleop firmware; its default is 1,000,000 baud. Both routes send motion into Filtered tracking and return TacHammer cues. Use Connect capture USB for the Haptography capture device. Disconnect it from Haptography first. Choose a hand, hold the device still for two seconds, then Set neutral to restore the gripper's base orientation at its current position. Turn about the board's up axis to yaw, tip the cable end to pitch, or twist around the cable to roll the gripper. Wrist rotation stops at its limits; mouse or AprilTags still sets its position. Returning to Tasks resumes orientation automatically. Set neutral again after a stream reset or if heading drifts. Test pulse checks the TacHammer output.
Stream
What is sent
One message for every track in view: its key (a tag's ID, or b: and an object's ID), its name, its position in metres and its orientation as a unit quaternion w, x, y, z. The frame is the 3D view's: the camera, or the tag chosen in Relative to, with any tare.
Last message
Start a camera, or the demo, to see messages here.
Serial or USB
To a microcontroller, or anything on a serial port, one line at a time. Needs Chrome or Edge on a computer.
UDP
A web page can't send UDP itself, so a small bridge on your computer passes each message on as one datagram. Download udp-bridge.py (Python 3, nothing else to install) and run it:
python3 udp-bridge.pyCalibrate this camera
1Get the board
Print the board at 100% scale on flat, stiff paper, or show it on a tablet or a second monitor (flatter than paper; keep reflections off it). Then measure one square with a ruler or calipers: measure across all 9 squares and divide by 9.
2Capture views of one lens
Start the camera and hold the board in view.
3Solve
4Place the cameras
| Camera | Views | Position, turn | Fit |
|---|
Tracking
Robot tasks
Five tasks, from a first grasp to two-handed precision and soft fabric.
How to play
AprilTags drive the grippers. You can also drag a gripper with the mouse. Scroll down on it to close, up to open; Space toggles the selected gripper.
Click a gripper to select it, or press 1 for left, 2 for right, 3 for both. W/S forward/back, A/D sideways, Q/E lift/lower. In Robot eyes, ↑/↓ lift/lower and ←/→ move sideways. Space opens/closes. Use Movement to adjust travel. The capture device or wrist tags control gripper orientation.
One star for finishing, one for the target time, one for no dropped props. Best results stay in this browser.
Objects collide, carry weight and can slip from a light grip. The shirt bends, stretches and contacts itself; its loads pull back on the grippers. Beer changes a vessel’s weight and balance as it pours. These are physical models, not measured hardware-force calibration.
Now
| Tag | Position, cm | Orientation, quaternion | Distance | Speed | Corner fit | ± depth | |||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| x | y | z | w | x | y | z | |||||
| Nothing tracked yet. | |||||||||||
Step-by-step instructions
Leaderboard
Best completion times on this device for these five tasks.
| Rank | Player | Time |
|---|
Stuck? Try these hints
Mouse and AprilTags
Drag a gripper to reach. Scroll down on it to close and up to open. Space toggles the selected gripper. Q/E raises or lowers it; Movement adjusts travel.
AprilTags drive the grippers. You can also drag a gripper with the mouse. Scroll down on it to close, up to open; Space toggles the selected gripper.
Click a gripper to select it, or press 1 for left, 2 for right, 3 for both. W/S forward/back, A/D sideways, Q/E lift/lower. In Robot eyes, ↑/↓ lift/lower and ←/→ move sideways. Space opens/closes. Use Movement to adjust travel. The capture device or wrist tags control gripper orientation.
No controllers connected
Use BLE, a direct USB controller, or a USB-connected XIAO ESB receiver. USB and ESB require TP/1 teleop firmware; its default is 1,000,000 baud. Both routes send motion into Filtered tracking and return TacHammer cues. Use Connect capture USB for the Haptography capture device. Disconnect it from Haptography first. Choose a hand, hold the device still for two seconds, then Set neutral to restore the gripper's base orientation at its current position. Turn about the board's up axis to yaw, tip the cable end to pitch, or twist around the cable to roll the gripper. Wrist rotation stops at its limits; mouse or AprilTags still sets its position. Returning to Tasks resumes orientation automatically. Set neutral again after a stream reset or if heading drifts. Test pulse checks the TacHammer output.