annotation-example

From 8 -> 5 -> 4 exocentric cameras, all visualized with rerun.io. I've been working on human pose capture for robotics training data and have started making it more accessible by dropping the number of cameras used and collecting my own data to make sure I'm not overfitting to open-source datasets. I've made lots of improvements to the calibration code and ended up merging the full body estimator with the hands only. Also FINALLY got ego synced and working in the full thing. Full body model really excels in exo views and is worth using if one can get a get view of the upper body, and hands only work great given a good bounding box from projecting 3D exo keypoints into egocentric views. Consistent progress over time really compounds, and I'm excited as to how fast things are improving. Code found here - <https://github.com/rerun-io/annota

Hands‑only multi‑view hand pose pipeline with a browser demo in Rerun. Outputs: per‑view 2D keypoints + boxes, 3D keypoints, MANO joint angles & shape (all predictions, not GT). Four stages: camera estimation → shape calibration → 2D keypoints → pose optimization. Known issues: not real‑time (~5 min for 30s/8 views on a 5090), too many cameras (target: 2 exo + 1 stereo ego), struggles with interacting hands. Code: https://github.com/rerun-io/annotation-example/tree/dbt

I built a labeling UI using Gradio and Rerun in pure Python. I want to emphasize how powerful this combo is. Rerun excels at showing complex multimodal data, and Gradio makes it super easy to spin up a ui all in pure Python quickly Here I use 1. Moge to estimate relative depth 2. Birefnet to remove background + generate masks 3. RTMPose to estimate human poses With this, I'm able to build a labeling pipeline that's fully customizable to my needs, giving me insights into both 2D and 3D perspectives. This isn't something (at least that I've anecdotally seen) with other platforms. The important bit here is that I'm saving the final annotated file as an RRD that contains all the complex context in a single, easily viewable data file. I also showcase reloading the saved file to allow for adjusting annotations after the fact.