openpose

It looks like they’re using OpenPose [0] images fed to a special “pose guider” model. You can make them from just regular video. [0] https://github.com/CMU-Perceptual-Computing-Lab/openpose

The input poses appear to be generated from OpenPose [0], which uses regular images as input. With the creation of stable diffusion video, you could theoretically prompt it to make a video of what you wanted, then run it through OpenPose. But I think the more realistic approach is to take a video of yourself doing the motions you want the AI to generate, and run that through OpenPose instead. Using just words leaves a lot to the model’s interpretation. I feel like you might wind up spending a lot of time manually fixing little things, similar to how you might infill the “wrong” parts of an AI generated image. It might be easier to just take a 15 second video to get the exact skeleton animation you want. [0] https://github.com/CMU-Perceptual-Computing-Lab/openpose

Looking at their GitHub repo, you're right: https://github.com/CMU-Perceptual-Computing-Lab/openpose#lic... OpenPose is freely available for free non-commercial use, and may be redistributed under these conditions.

Hi guys, I built this project for fun and I thought it would also be a good practice for me. However, I have read the OpenPose License which strictly disallows their project for commercial use. My project is for research use only and I'm not making any money from it. I have mentioned that I implemented OpenPose and link to their GitHub repo. And I also copy and paste their whole license into my repo license. I want to know is it still possible for me to violate their license in any way? https://github.com/CMU-Perceptual-Computing-Lab/openpose/blo...

Hi, thanks for telling me this. I'm definitely not using it for commercial purpose. I did read their whole license on their GitHub page. https://github.com/CMU-Perceptual-Computing-Lab/openpose/blo... I'm not really good at English, can you please help me with it? From their GitHub LICENSE: 1. ACADEMIC OR NON-PROFIT ORGANIZATION NONCOMMERCIAL RESEARCH USE ONLY 2. Licensor retains exclusive ownership of any copy of the Software (as defined below) licensed under this Agreement and hereby grants to Licensee a personal, non-exclusive, non-transferable license to use the Software for noncommercial research purposes, without the right to sublicense, pursuant to the terms and conditions of this Agreement. 3. PERMITTED USES: The Software may be used for your own noncommercial internal research purposes. Here are my points: 1. I build this only

Warning: funny license: https://github.com/CMU-Perceptual-Computing-Lab/openpose/blo...

Just built a gesture controlled robot[1] with the Xavier board. We were able to run OpenPose[2] at 27FPS, which we found was even faster than running it on K80 on AWS p2.xlarge. It was a pain to install caffe and all the dependencies on an ARM processor, but it worked out eventually. We were able to train and run Tensorflow 2 models quickly also. Felt like using an actual GPU at a fraction of the cost. [1] https://www.youtube.com/watch?v=AF8zmTaa17s [2] https://github.com/CMU-Perceptual-Computing-Lab/openpose

Certainly. For example, https://storage.googleapis.com/tfjs-models/demos/posenet/cam... will run in your browser. https://github.com/CMU-Perceptual-Computing-Lab/openpose is also a decent choice for realtime pose estimation, although I'm not sure if they have a web demo anywhere.

You're right, it's quite plan really: > PERMITTED USES: The Software may be used for your own noncommercial internal research purposes. You understand and agree that Licensor is not obligated to implement any suggestions and/or feedback you might provide regarding the Software, but to the extent Licensor does so, you are not entitled to any compensation related thereto. from https://github.com/CMU-Perceptual-Computing-Lab/openpose/blo.... According to the article, that's powering the pose estimation here. It's not for sale _yet_, so they may be in the clear for all the demo-ing they've been doing. Would CMU even be open providing a paid, commercial license? Does anyone know how CMU usually handles situations like this?

Might find this interesting for extracting info from recorded bouts: https://github.com/CMU-Perceptual-Computing-Lab/openpose

The training data comes from >Check https://github.com/ZheC/Realtime_Multi-Person_Pose_Estimatio... for training questions. We are using their model. https://github.com/CMU-Perceptual-Computing-Lab/openpose/iss... What is the difference between this one and the other one ?