IMUPoser: Full-Body Pose Estimation using IMUs in Phones, Watches, and Earbuds

Tracking body pose on-the-go could have powerful uses in fitness, mobile gaming, context-aware virtual assistants, and rehabilitation. However, users are unlikely to buy and wear special suits or sensor arrays to achieve this end. Instead, in this work, we explore the feasibility of estimating body pose using IMUs already in devices that many users own - namely smartphones, smartwatches, and earbuds. This approach has several challenges, including noisy data from low-cost commodity IMUs, and the fact that the number of instrumentation points on a user's body is both sparse and in flux. Our pipeline receives whatever subset of IMU data is available, potentially from just a single device, and produces a best-guess pose. To evaluate our model, we created the IMUPoser Dataset, collected from 10 participants wearing or holding off-the-shelf consumer devices and across a variety of activity contexts. We provide a comprehensive evaluation of our system, benchmarking it on both our own and existing IMU datasets.
Citation:
Mollyn, V., Arakawa, R., Goel, M., Harrison, C. and Ahuja, K. 2023. IMUPoser: Full-Body Pose Estimation using IMUs in Phones, Watches, and Earbuds. To appear in Proceedings of the 41st Annual SIGCHI Conference on Human Factors in Computing Systems (April 23 - 30, 2023). CHI '23. ACM, New York, NY.

[@corriedotdev]

Sick. Will cite in current paper. Been waiting for something using mobile imu. Decagear has a mobile app but using the smart watch in conjunction is brilliant

[@po-hsuanhuang5200]

Very impactful research.

[@l3gacyb3ta21]

woah, this is awesome!

[@MajorFool]

THANK YOU!!!!

[@shyleshsrinivasan5092]

Fascinating!

[@KuyaQuatro]

super clever!

[@yallaskate]

Is this open source?