- 140
- 599 507
Roy Shilkrot
United States
Приєднався 26 лис 2007
Hi! I'm Prof. Roy, AI hacker, open source advocate, lifelong learner-teacher. PhD from MIT, which I use to make the world a little better every day for as many people as I can. I'm a teaching professor of computer science (Vision + AI), and I'm building locaal.ai
On this channel, I will try to bring AI to the world of content creation, share insights into programming, and explore the intersection of humans and AI technology.
x.com/RoyShilkrot (Feel free to DM me!)
Support: patreon.com/RoyShilkrot
GitHub: github.com/royshil
Subscribe for the latest in AI, coding, and open-source projects! 🚀
On this channel, I will try to bring AI to the world of content creation, share insights into programming, and explore the intersection of humans and AI technology.
x.com/RoyShilkrot (Feel free to DM me!)
Support: patreon.com/RoyShilkrot
GitHub: github.com/royshil
Subscribe for the latest in AI, coding, and open-source projects! 🚀
Private Free AI Note Taker by Locaal.ai [Tutorial]
Download: locaal.ai/note-taker
Code: github.com/locaal-ai/note-taker (⭐ please!)
Code: github.com/locaal-ai/note-taker (⭐ please!)
Переглядів: 254
Відео
AI Visions Live | Merve Noyan | Open-source Multimodality
Переглядів 7694 години тому
Our live conversation at MIT (visions.media.mit.edu) with Merve Noyan x.com/mervenoyann of Hugging Face that covers Multimodal Open Source models, their architecture and applications.
RealTime Captions on OBS Quickstart [Tutorial]
Переглядів 416День тому
Get started with Realtime Local Captions on your OBS with LocalVocal github.com/locaal-ai/obs-localvocal See all of our local private AI solutions at locaal.ai
ScoreSight Per-character Detection [Preview]
Переглядів 105День тому
A sneak peek into new ScoreSight functionality: Reading per-character scoresight.live/ github.com/locaal-ai/scoresight/
Live Caption Local Fine-tuned Models on OBS [Tutorial]
Переглядів 33121 день тому
LocalVocal now has hundreds of fine-tuned models for dozens of languages! Real-time transcription in dozens of languages directly on OBS. github.com/locaal-ai/obs-localvocal
ScoreSight OCR Training Data Collection
Переглядів 341Місяць тому
Help improve ScoreSight scoreboard models by sending us your data for training! Download: github.com/locaal-ai/scoresight/releases Learn: github.com/locaal-ai/scoresight
Realtime Translation! OBS LocalVocal No cloud [Tutorial]
Переглядів 2,5 тис.Місяць тому
Realtime live transcription and translation with OBS LocalVocal. Buffered output for steady long-running caption log. Download: github.com/locaal-ai/obs-localvocal/releases From locaal.ai
True Real-Time Transcription & Translation with LocalVocal [Tutorial]
Переглядів 2,2 тис.3 місяці тому
A new feature in LocalVocal for OBS - true real-time transcription! Partial transcription gives you zero-latency captions fully locally on your machine, along with real-time translation to any language. Download: obsproject.com/forum/resources/localvocal-local-live-captions-translation-on-the-go.1769/ Learn: github.com/occ-ai/obs-localvocal
OBS Text-to-Speech AI Real-Time Local FREE No Cloud [Tutorial]
Переглядів 6 тис.4 місяці тому
Add text-to-speech to OBS with Squawk a real-time TTS engine that runs locally on your machine and costs you $0 forever. It makes lifelike speech and runs automatically as well. obsproject.com/forum/resources/squawk-real-time-local-text-to-speech-with-ai.1965/ github.com/occ-ai/obs-squawk
Real-Time Captions & Translation OBS LocalVocal [Tutorial]
Переглядів 8 тис.4 місяці тому
Caption and Translate your OBS recording or live stream real-time locally on your computer with the LocalVocal plugin! No transcription or translation service fees, no network needed. Fully customizable and optimized for all your needs. github.com/occ-ai/obs-localvocal obsproject.com/forum/resources/localvocal-local-live-captions-translation-on-the-go.1769/ Need help? discord.gg/H3yEs4kwxN 00:0...
Detect Objects & Faces Fast on OBS - Blur, Real-Time FREE Plugin [Tutorial]
Переглядів 3,1 тис.5 місяців тому
Free plugin github.com/occ-ai/obs-detect/releases Real-time object and face detection obsproject.com/forum/resources/detect-object-detection-tracking-built-in-obs.1911/ Need help? discord.gg/H3yEs4kwxN 00:00 Intro 00:22 Download 00:58 Add filter 01:30 Filter options 02:18 Detect faces 02:47 More options 03:36 Tracking and Crop 05:11 Outro
Remove Profanity Live on OBS! CleanStream Filter new version [tutorial]
Переглядів 4,3 тис.5 місяців тому
Remove profanity from live streams on OBS - easy with CleanStream. The world's only free moderation solution, open source and simple to use. The clip in the video: ua-cam.com/video/tcdHHgA_QFA/v-deo.html 🙏 Download: obsproject.com/forum/resources/cleanstream-remove-uhs-ums-profanity-in-your-live-stream-or-recording-with-ai.1732/ GitHub: github.com/occ-ai/obs-cleanstream/releases Need help? disc...
Best FREE Real-Time OCR for Live Gaming ScoreSight [Tutorial]
Переглядів 2,6 тис.6 місяців тому
Learn: scoresight.live Download: github.com/occ-ai/scoresight/releases Need help? Live support on discord.gg/H3yEs4kwxN
Simplest scoreboard OCR for NewBlue Captivate with ScoreSight [Tutorial]
Переглядів 7927 місяців тому
Use ScoreSight HTTP server to setup a scoreboard in NewBlue Captivate in seconds. scoresight.live Need help? discord.gg/H3yEs4kwxN
Best way to Track or Mask ANY object real-time on OBS [Tutorial]
Переглядів 3,1 тис.7 місяців тому
Best way to Track or Mask ANY object real-time on OBS [Tutorial]
Best OCR for Captions with Translation on OBS [Tutorial]
Переглядів 1 тис.7 місяців тому
Best OCR for Captions with Translation on OBS [Tutorial]
Best way to Translate & Caption ANY Application on OBS [Tutorial]
Переглядів 2,3 тис.7 місяців тому
Best way to Translate & Caption ANY Application on OBS [Tutorial]
Best Realtime Translation for OBS with DeepL [Tutorial]
Переглядів 2,5 тис.7 місяців тому
Best Realtime Translation for OBS with DeepL [Tutorial]
Remove background from ANYTHING on OBS! New model
Переглядів 3,6 тис.7 місяців тому
Remove background from ANYTHING on OBS! New model
Best way to POST YouTube Captions: Free URL/API plugin OBS [Tutorial]
Переглядів 1 тис.7 місяців тому
Best way to POST UA-cam Captions: Free URL/API plugin OBS [Tutorial]
Best FREE vMix scoreboard OCR with ScoreSight [Tutorial]
Переглядів 3,5 тис.8 місяців тому
Best FREE vMix scoreboard OCR with ScoreSight [Tutorial]
Shopify $0 Activation Key Service [Programming Tutorial]
Переглядів 2468 місяців тому
Shopify $0 Activation Key Service [Programming Tutorial]
Best scoreboard OCR Setup ScoreSight FREE [Tutorial]
Переглядів 2,2 тис.8 місяців тому
Best scoreboard OCR Setup ScoreSight FREE [Tutorial]
World's best FREE scoreboard OCR ScoreSight [Tutorial]
Переглядів 5 тис.8 місяців тому
World's best FREE scoreboard OCR ScoreSight [Tutorial]
Easiest Text Blur with OCR on OBS [Feature Preview]
Переглядів 1,5 тис.9 місяців тому
Easiest Text Blur with OCR on OBS [Feature Preview]
Fastest FREE OCR for OBS works on all OSs! [Tutorial]
Переглядів 6 тис.9 місяців тому
Fastest FREE OCR for OBS works on all OSs! [Tutorial]
Add VSCode Data to your Stream | OBS | URL/API Source [Tutorial]
Переглядів 90810 місяців тому
Add VSCode Data to your Stream | OBS | URL/API Source [Tutorial]
Easiest Google sheets integration to OBS w/ FREE API plugin [Tutorial]
Переглядів 6 тис.10 місяців тому
Easiest Google sheets integration to OBS w/ FREE API plugin [Tutorial]
ChatGPT popup video "Explainer" on OBS [Tutorial]
Переглядів 52210 місяців тому
ChatGPT popup video "Explainer" on OBS [Tutorial]
Best TTS for OBS ElevenLabs with Lifelike generated speech [2min Tutorial]
Переглядів 2,1 тис.10 місяців тому
Best TTS for OBS ElevenLabs with Lifelike generated speech [2min Tutorial]
Enable "Masking" or "Tracking", Can add Another switch transparent?
Can it identify different speakers?
not just yet but soon!
Same issue as below: Failed to parse json string: Source error". Can anyone please advise how to set it up properly?
WOW thanks
Hi Is it possible to send the translated text directly to UA-cam CC as in POST CAPTIONS TO URL?
You can enable the send captions to stream option in the advanced options That will send to YT live
@@royshilk Hi Roy, Thanks for your reply. I've followed your YT guide URL/API plugin (ua-cam.com/video/E7HKbO6CP_c/v-deo.htmlsi=gurtTqrKnmtjuWVm) and I've run a Test Request and didn't came back with any errors but what I get is the time stamp but no translation. I've selected Method : Post - UA-cam Post Caption. Any idea if I'm missing something? Thanks
Hi Roy, I hope you are well. Could this be a replacement for live captions in Chrome? I have to translate into other languages that are not supported by the translator. Can you help me in this direction? How can I contact you to provide more details about my live translation needs?
1 question! The mb size is for the amount of mb it would take on VRAM of the gpu or the system ram? Or is the download size of that model? Any major effects on gpu usage>? [I know i asked a lot in single question 🤧🤧]
It would be appreciated if you can add by how much does the gpu, ram and cpu gets affect when adding the filters! I know it makes recording and all a bit more complicated. However, for people like me who multistream simultaneously with only a single pc and 16 gigs of ram, we need to keep a check on how much ram and stuff it actually occupies. I recently tried your squawk tts which is so amazing! However, upon adding 4 of those in a single scene, the ram usage went from 2.2 to 3.2 gigs. I know it's running locally so it needs that. Tbh the main reason i loved squawk is because it has so many amazing voiceovers and that too for free! The windows inbuilt TTS is so inferior compared to that. Currently I use speaker bot for alerts and stuff which uses around 100 to 150 MB of ram at max I guess. It'd be amazing if you ever collab with streamer bot and speaker bot! Personally, that would be a huge boon! Nonetheless, Thanks a lot for sharing such plugins (Polyglot, Squawk,etc) for free!! Really amazing work!!
hey is it possible to make it read chat? like giving my stream chat a voice?
NickEh30 should use this instead of banning people on his live stream💀💀💀💀💀💀💀💀💀💀💀💀
Hello, once the plugin is installed, when I create the source, for me it appears as a file (paper icon) and not subtitles. Any chance you know what I do wrong?
Hello Roy! Im having some problems. Whenever I add a source in OBS I get a few correct results then: ERROR CODE 429 QUOTA EXCEEDED FOR QUOTA METRIC "READ REQUESTS" AND LIMIT "READ REQUESTS PER MUTE PER USER". I understand the script is trying to read too many times but I don't know how to limit it. Thanks in advance!
The quota limit is related to the free tier of the API provider, you'll need to switch to a paid plan or change your timer settings to reduce requests.
I was wondering if this would allow us to have an object in OBS follow along with the tracked object. Such as having it track a face, so we can make a speech bubble for closed captioning that always follows the face?
having problem with this bcoz the custom lobby that part is slightly transparent
Hi! I want to do similar thing with performance overlay in GeForce now (Cloud gaming). I want to capture fps, latency and packet loss values in real time and later to export those values to find mean value of them. Is it possible?
yes if the values can be OCR'd (they go on screen) you can use the "append" to get a list of them on which you can calculate statistics
@@royshilk I did it, but there is one thing that is bothering me. Look, I don't want that video to loop. I want it to be played only once and to OCR values. do you understand? Is it possible?
Hi! Is it possible to capture values like this frames/s on my performance stats in real time and export every value to some text file to find mean value?
if it's something that apperas on screen - sure, you can grab it and send it to text file or API
how do i delete the plugin? i installed it a bit ago and now every recording has ocr on it and it ruins the video
Just remove the filter from the video source
@royshilk there isnt a filter, ive fully uninstalled and reinstalled obs and its still doing it
Thanks a lot! This is incredable! Can't wait for external model support.
u r the best
Hello, nice plugin ! I have test it this morning, French detection to English translation. I'm using it on my I5 12400F, do you think it's possible to run it throught Intel ARC GPU ? Cause actually it's working but take 18% of CPU usage and can't translate with Enable Partial Transcription to have real time translation.
Too good, there's no lag for you? can I ask you for the entire configuration you put on it (I'm also looking to make French to English).
did OBS change since you made this? I don't find the exact same UI/uX!
OBS v30.2 is what I'm using but OBS v31 is already out in beta...
@@royshilk Hi Roy! I am using 30.2 on a Mac (Silicon) and the windows were not exactly the same (text "extent"). I figured out how to follow you anyway and I have duplicated your tutorial pretty well. Thanks!
hi i have a question when i connect the camera to the ocr the image slows down
scoresight preview is 1FPS but the camers is handled at 30FPS
I'd like this to be able to monitor a chat window for Bits and Subs, then read out that text in an AI voice I've trained. If you find the time, I'd absolutely love a tutorial on how to do that!
It didn't work on my hp laptop
do you wnat to share obs logs? come to discord discord.gg/Mu8WGw2Nka
Can I use this tracking plugin as a way to track something and mask it / replace it like a greenscreen ? I mean real time detection, tracking and replacing
Hello! Is it possible to grab info from a second sheet within the same document? It would help so much with organization. Thanks!
Hi Roy, You are thriving now with all of your software. I'm happy for you and thanks so much for making so much available. Not sure as of yet what I'll need other than your background removal and your detect plugin, but it's good to know they are there. Thanks.
What is the point at me? I got no output, not in textfile, no direct output into textsource.
I installed it but my video capture device is now black. How do I fix this?
I am having trouble installing it in Windows 11. I installed it using the installer, and then with manual copy-paste, restarted the computer, and still the plugin filter Detect won't show up. Please, help. :( Edit: I just saw minimum version should be 30. I have 29.x. I'll try updating OBS.
Thank you. This is really helping for what I need. Just a couple of issues. Using a website link/HTML output and CSS selector, I have a template setup for {{output0}}<br>{{output1}}<br>{{output2}}<br> etc. But when the site doesn't have data for say {{output5}} that it did previously (as it changes on a daily basis) it doesn't show anything for any of the values and shows blank. Can we change this so it displays the values and then just nothing for the value where there isn't any data? Also, if I have too much data on one of the values, can I reduce the output using a template command? i.e "I need this bit, but not this bit". 🙂
I love you! I was looking for this very thing last year. Thank you sir!
non funziona!!! il programma installa correttamente, ma quando vai ad interagire col programma, non c'è nessun imput perfavore aiutatemi
Can you send the cc to a youtube stream via embedded format?
Is there any way to make this run off of gpu instead of cpu? My computers seems to bottle neck when everything is working
Yes of course just download the CUDA version for windows
i ran the windows installer, and i still cant find DETECT inside the filters list
Please share obs logs on discord for help discord.gg/7hJy6gDa
driving me crazy, i have installed your downloaded zip file and extracted it as a directory, and copied that same directory to every possible root directory on the c drive program files obs studio, and i still cant find it inside the effects filter
The problem may be different. Obs version for example. Please share logs
@@royshilk how do i find logs? my version is 27.4.2
0.26 i am trying to watch, how you add this filter into obs, but you do not show it, you show the filter list nd then skip it, how do i add it, ive downloaded it, and there is no instruction anywhere onl internet how to add filters to obs, i only have basic list like APPLY LUT, CHROMA , SCROLL, SHARPEN KEY, etc help plz,
ive managed to download the zip file to my desktop , but how do i use this on obs, how do i install it
Hi Roy, Very glad to know the information which I can change background with the plugin. I downloaded by Windows 11, and installed it. But I can not find the plug in. Can you please tell me what I can do? Thanks!
I downloaded it but it’s not showing up in the filters list
same
Wish you showed the quality of the hand detection as most background removal apps struggle with that. NVIDIA broadcast does the best with hands but I am considering switching to an AMD Radeon laptop soon…
Hello, I couldn't join because your discord link didn't work. I'm having a problem, I'd appreciate it if you could help me.
Legend !
thank you roy! I was just thinking about this project today! and it would be so cool to have live animations of emojis/icons generated similar to subtitles
The localvocal option to add in audio filters isn't showing up for me
Please share logs on discord
@@royshilk It fixed when I updated OBS 👍
Thank you its a great tool