BlendArTrack 2.2.0 - Update based on user feedback
Вставка
- Опубліковано 1 сер 2024
- If you don't have blendartrack installed already, search for blendartrack in the app store to get the app or use the following links.
iOS:
apps.apple.com/us/app/blendar...
Android:
play.google.com/store/apps/de...
The Add-On you grab at Gumroad (requires Blender 2.9+):
github.com/cgtinker/blendartrack
Want to chat or need help? Join me on Discord!
/ discord
If you would like to support me developing tools, join me on patreon :)
/ cgtinker
Don't know blendartrack? Checkout this video:
• blendartrack - ar moti...
Timecodes
0:00 - Camera Tracking
1:20 - Face Tracking - Фільми й анімація
I really wish i could support you, this is one of the most useful addons in the community
It's coming along wonderfully, congratulations.
This addon is really helpful, thanks CG Tinker
Your app is so simple and awesome! Way better than Faceit because I can easily transfer it to a rigify rig via action. I'd love to see eye tracking at some point and maybe isolated eyebrow tracking.
Woow You are really a good person. I wish you could upload more cool stuff. I just stumbled on your app on the app store.
Keep up the good work
Please keep up with this android app development, it's a big help
Typing this as I wait for the smoothing to finish. This is so neat! I wish I could say I'm making something important, but this is going to be a very silly project.
Amazing work!
Thank you, your efforts are not in vain.
fantastic!!!
It would be nice to have the audio imported as well? Wonderful tool, thank you!
So cool!!!
you are awesome, im sorry i couldn’t pay for this, still waiting to get paid for a commission by a friend and putting all my time into learning blender rn so money is non existent. But really amazing you give people like me the ability to use this. Thank you so much.
thanks and no problem, keep creating! :)
thx for your commitment :) I assume your method is different from applying those 52 different shape keys to the face. Can you share with us any pros and cons between those two different facial tracking methods; rigging vs shape key?
WOW! Keep on rocking!!
Amazing!!!
A week ago I discovered this useful app and it was very helpful when making videos with camera tracking and making my own VFX
(even being a novice in using blender hahaha)
I exported the recording files through bluethoot because I couldn't find them inside the phone's storage XD
I exported the videos in 1440x1080... is it normal or can the resolution be higher?
1920x1080... maybe I'm dumb and set it wrong.
(autofocus gives better results, but no manual focus bar yet? TwT)
I also spent some work to delete the trackers placed, I know that keeping my finger pressed I eliminated them but I ended up creating another one on top hahaha.
can you create a little icon in the corner for it, like a ctrl+z?
I wish that 6 trackers could be placed, thus being able to create a plane of four horizontal points and two vertical points and thus move the camera more in vertical shots without losing the dimensions of the scene or distorting the position.
An option of manual calibration of the recording would be useful for when the position of the trackers is challenged... but that can already be problems of the limitations of the phone.
I dint use the face trackers on any project yet :(
Seriously this app is the best!!!
I will tell everyone to try it and support it as much as possible!
My best wishes for you and your projects
For use in production, this add-on need to target arkit shape keys instead of bones or empties. We could then transfer the animation with faceit.
Nice Sir, 🙏🌺😇
iPhone 7 face tracker not working as it's not switching to selfie lens and then the app closes, I guess it's time to upgrade
Awrsome thank you. Any plans tomake a 24fps version?
Your new video is great but I have some sincere comments
Existing iclone8 and iPhone arkit, industrial-grade facegood all choose to use shape keys to drive expressions. AI has errors in recognition, so I think a set of standards for facial animation that is not driven by bones can be established.
Actions like pouting, as well as skin folds, muscle movement, and bone de-reduction are very ineffective. If it is a shape key, it will be extremely powerful.
Because Nvidia has also started the project of facial muscle animation, and metahuman, ziva, and cg circles are getting more and more interesting because of you. Thank you very much.
Great app, Can you please add 4k recording feature for camera tracking
♥️♥️
Hey cg tinker can you please add shape key recognition to blender ar track app for Android please
Can we use the data from blendar track to use with the faceit addon in blender?
Awesome work, one question this update will not have problems with the new rig face of rigify in the new versions of blender?
Still not supporting the new face rig :/
It's getting changed to often to be honest... there are like 3 new ones by now.
How do you transfer to a auto rig pro face rig?
Why is it not available for Samsung A21
how did u connect driver rig to face of human?!
I tested it. It works good for me,. rating 7/10
Hello. Is there a way to export the audio along with the tracked face?
Question. I use Human Generator and it uses rigify but it's orientations aren't exactly like the default rigify. But I've been trying to use this to add facial animations to the facial rig of the models. But they don't seem to see each other. Do I have to primarily use a default rigify metarig to use this or is there some way to retarger the animation from the data rig to the human generator rig? Because I've tried and failed.
A connection to human generator would be awesome
wil the tracking app soon support full hd and 4k video recording?
Is there a way to make this work with faceit?
is there any android spec required bcoz there is an error The phone is not compatible with this app,
Hello amazing tutorial ! I'm really grateful for all your videos and your work. Do you think this could work with a character rigged with Autorig pro ?
while it could it's not supported atm
Can i use this to facial motion capture in real time, similar to what Facemotion3d can do in apple devices? That would be life saver!
Awesome work btw.
thanks ;)
BlendArTrack cannot be used in realtime, checkout BlendArMocap for realtime purposes.
Having problems transferring the Action over to the character rig. Seems like the bones might not be matching up. Very faint movement on the eyebrows. Drop sheet shows all the keyframes. Blender v3.5. Any ideas?
Hey, I think I have a similar issue, and I think it has to do with an issue when generating the driver rig. There's an error message about the baserig lacking some "layers" attribute and then it's just not moved by the empties, so that only some of the movements is tranfered with the action.
I'm still trying to figure this out but I think it may be linked with layers mentionned in the "Skelleton" section of the armature menu. In fact this section does not seem to exist in recent version of Blender? I'm not sure about this tho...
is it possible to connect a sony camera to the phone so you can use the tracking data with sony footage? :)
while it would be cool I guess not
Sorry I have a face model with shape keys and I want to apply the mocap data to the model how can I do this ?
that's not supported yet. something for the future =)
Is there anyway to use this with metahuman avatars?
i can’t find the app on the app store anymore, does anyone know why?
me too
Hi,
My name is Aron. First of all, I want to say that the ARtrack is amazing! I'm currently creating a workflow for my upcoming movie, but I'm having some trouble with getting the face-mocap from the driver rig to look the same on my rigify driverrig. Long story short, I was wondering if there is any way to get in contact with you about this? And if there is any way you could help me with this issue? I hope to hear from you soon!
Kind regards, Aron
If Holistic is selected, the right and left hand sides are reversed. The right hand action connects to the left hand. is it an error? error only in hand.
currently working on an update - a lot of changes are coming. Will check ;)
@@cgtinker Yes. Next time it would be nice to have the ability to preset frames as well :)
My Kinect sensor is being triggered, but the capture window is not opening. What could be wrong?
Kinect? :o
Give me some more context - I wonder how you use blendartrack with a kinect :>
@@cgtinker "My son" (lol) has an XBox one, but we don't have any more games to use. So I turned the Kinect into a webcam. (I have a depth sensor camera! Perfect for MoCap!). I'm watching his tutorials to learn how to use it for MoCap. It works on Windows ok! Zoom ok! Hangouts okay! Google meet ok! But, BlendAr triggers the sensor and makes the kinect work (hardware), but the camera window (software) does not open and does not record the movements. I'm using "SDK Browser 2.0 (Kinect for Windows)" with "Kinect Studio 2.0" and "Visual Gesture Builder". Thanks a lot for your feedback! I am unemployed, but I will do my best to contribute to your channels!! You respect your audience! Big hug!
My mobile not support
Hi, @cgtinker , first, thank you for this great piece of software.
In Blender 4 I get an error when generating the Driver rig. Line 98 n generate_driver_rig fails.
The line reads : bpy.data.armatures["driver_rig"].layers[29] = True
The error reads : AttributeErro : 'Armature' object has no attribute 'layers'.
One consequence of this seems to be that movement from the empties is tranfered but no movement from the rig? Not sure i'm analyzing this correctly.
Are you aware of this issue, and if so, do you have an idea of how to work around it?
Thank you very much !
edit : so I switched to blender 3 to make everything up to and including that issue, and it worked. I then went to blender 4 because the baking would somehow take ages in blender 3 haha.
can imagine 4.0 introduces some issues.. I don't plan to develop anymore on blendarmocap for now so it's just compatible with 3.x - glad you were able to work around the issue :)
So how do you install this? Do you have to download all the individual .py files?
Just download the add-on as .zip. then navigate to settings>add-ons>install add-on and throw it in as a zip
I can't find the old face rig, so i am unable to use it. Can i download the old face rig?
as long you use rigify you should be fine. You are using the old face rig by default - you have to actively press an "update face rig" button to switch to the new one at least as far as I know
@@cgtinker Thanks. I will try again.
will this work with auto rig pro?
think so but maybe requires some manual work
hi! Please tell, which version of the Blender was used to create this video?
2.93
@@cgtinker does this addon work in blender 3.5?
This is amazing but it's too messy
Go sleep!
put subtitles, please I don't speak English 😭😭
Hi, your buymeacofee link is giving a 404 on the google play. Can you please give an updated link? Thanks.
he's got a patreon now i think