Roy Shilkrot
Roy Shilkrot
  • 140
  • 599 507

Відео

AI Visions Live | Merve Noyan | Open-source Multimodality
Переглядів 7694 години тому
Our live conversation at MIT (visions.media.mit.edu) with Merve Noyan x.com/mervenoyann of Hugging Face that covers Multimodal Open Source models, their architecture and applications.
RealTime Captions on OBS Quickstart [Tutorial]
Переглядів 416День тому
Get started with Realtime Local Captions on your OBS with LocalVocal github.com/locaal-ai/obs-localvocal See all of our local private AI solutions at locaal.ai
ScoreSight Per-character Detection [Preview]
Переглядів 105День тому
A sneak peek into new ScoreSight functionality: Reading per-character scoresight.live/ github.com/locaal-ai/scoresight/
Live Caption Local Fine-tuned Models on OBS [Tutorial]
Переглядів 33121 день тому
LocalVocal now has hundreds of fine-tuned models for dozens of languages! Real-time transcription in dozens of languages directly on OBS. github.com/locaal-ai/obs-localvocal
ScoreSight OCR Training Data Collection
Переглядів 341Місяць тому
Help improve ScoreSight scoreboard models by sending us your data for training! Download: github.com/locaal-ai/scoresight/releases Learn: github.com/locaal-ai/scoresight
Realtime Translation! OBS LocalVocal No cloud [Tutorial]
Переглядів 2,5 тис.Місяць тому
Realtime live transcription and translation with OBS LocalVocal. Buffered output for steady long-running caption log. Download: github.com/locaal-ai/obs-localvocal/releases From locaal.ai
True Real-Time Transcription & Translation with LocalVocal [Tutorial]
Переглядів 2,2 тис.3 місяці тому
A new feature in LocalVocal for OBS - true real-time transcription! Partial transcription gives you zero-latency captions fully locally on your machine, along with real-time translation to any language. Download: obsproject.com/forum/resources/localvocal-local-live-captions-translation-on-the-go.1769/ Learn: github.com/occ-ai/obs-localvocal
OBS Text-to-Speech AI Real-Time Local FREE No Cloud [Tutorial]
Переглядів 6 тис.4 місяці тому
Add text-to-speech to OBS with Squawk a real-time TTS engine that runs locally on your machine and costs you $0 forever. It makes lifelike speech and runs automatically as well. obsproject.com/forum/resources/squawk-real-time-local-text-to-speech-with-ai.1965/ github.com/occ-ai/obs-squawk
Real-Time Captions & Translation OBS LocalVocal [Tutorial]
Переглядів 8 тис.4 місяці тому
Caption and Translate your OBS recording or live stream real-time locally on your computer with the LocalVocal plugin! No transcription or translation service fees, no network needed. Fully customizable and optimized for all your needs. github.com/occ-ai/obs-localvocal obsproject.com/forum/resources/localvocal-local-live-captions-translation-on-the-go.1769/ Need help? discord.gg/H3yEs4kwxN 00:0...
Detect Objects & Faces Fast on OBS - Blur, Real-Time FREE Plugin [Tutorial]
Переглядів 3,1 тис.5 місяців тому
Free plugin github.com/occ-ai/obs-detect/releases Real-time object and face detection obsproject.com/forum/resources/detect-object-detection-tracking-built-in-obs.1911/ Need help? discord.gg/H3yEs4kwxN 00:00 Intro 00:22 Download 00:58 Add filter 01:30 Filter options 02:18 Detect faces 02:47 More options 03:36 Tracking and Crop 05:11 Outro
Remove Profanity Live on OBS! CleanStream Filter new version [tutorial]
Переглядів 4,3 тис.5 місяців тому
Remove profanity from live streams on OBS - easy with CleanStream. The world's only free moderation solution, open source and simple to use. The clip in the video: ua-cam.com/video/tcdHHgA_QFA/v-deo.html 🙏 Download: obsproject.com/forum/resources/cleanstream-remove-uhs-ums-profanity-in-your-live-stream-or-recording-with-ai.1732/ GitHub: github.com/occ-ai/obs-cleanstream/releases Need help? disc...
Best FREE Real-Time OCR for Live Gaming ScoreSight [Tutorial]
Переглядів 2,6 тис.6 місяців тому
Learn: scoresight.live Download: github.com/occ-ai/scoresight/releases Need help? Live support on discord.gg/H3yEs4kwxN
Simplest scoreboard OCR for NewBlue Captivate with ScoreSight [Tutorial]
Переглядів 7927 місяців тому
Use ScoreSight HTTP server to setup a scoreboard in NewBlue Captivate in seconds. scoresight.live Need help? discord.gg/H3yEs4kwxN
Best way to Track or Mask ANY object real-time on OBS [Tutorial]
Переглядів 3,1 тис.7 місяців тому
Best way to Track or Mask ANY object real-time on OBS [Tutorial]
Best OCR for Captions with Translation on OBS [Tutorial]
Переглядів 1 тис.7 місяців тому
Best OCR for Captions with Translation on OBS [Tutorial]
Best way to Translate & Caption ANY Application on OBS [Tutorial]
Переглядів 2,3 тис.7 місяців тому
Best way to Translate & Caption ANY Application on OBS [Tutorial]
Best Realtime Translation for OBS with DeepL [Tutorial]
Переглядів 2,5 тис.7 місяців тому
Best Realtime Translation for OBS with DeepL [Tutorial]
Remove background from ANYTHING on OBS! New model
Переглядів 3,6 тис.7 місяців тому
Remove background from ANYTHING on OBS! New model
Best way to POST YouTube Captions: Free URL/API plugin OBS [Tutorial]
Переглядів 1 тис.7 місяців тому
Best way to POST UA-cam Captions: Free URL/API plugin OBS [Tutorial]
Best FREE vMix scoreboard OCR with ScoreSight [Tutorial]
Переглядів 3,5 тис.8 місяців тому
Best FREE vMix scoreboard OCR with ScoreSight [Tutorial]
Shopify $0 Activation Key Service [Programming Tutorial]
Переглядів 2468 місяців тому
Shopify $0 Activation Key Service [Programming Tutorial]
Best scoreboard OCR Setup ScoreSight FREE [Tutorial]
Переглядів 2,2 тис.8 місяців тому
Best scoreboard OCR Setup ScoreSight FREE [Tutorial]
World's best FREE scoreboard OCR ScoreSight [Tutorial]
Переглядів 5 тис.8 місяців тому
World's best FREE scoreboard OCR ScoreSight [Tutorial]
Easiest Text Blur with OCR on OBS [Feature Preview]
Переглядів 1,5 тис.9 місяців тому
Easiest Text Blur with OCR on OBS [Feature Preview]
Fastest FREE OCR for OBS works on all OSs! [Tutorial]
Переглядів 6 тис.9 місяців тому
Fastest FREE OCR for OBS works on all OSs! [Tutorial]
Add VSCode Data to your Stream | OBS | URL/API Source [Tutorial]
Переглядів 90810 місяців тому
Add VSCode Data to your Stream | OBS | URL/API Source [Tutorial]
Easiest Google sheets integration to OBS w/ FREE API plugin [Tutorial]
Переглядів 6 тис.10 місяців тому
Easiest Google sheets integration to OBS w/ FREE API plugin [Tutorial]
ChatGPT popup video "Explainer" on OBS [Tutorial]
Переглядів 52210 місяців тому
ChatGPT popup video "Explainer" on OBS [Tutorial]
Best TTS for OBS ElevenLabs with Lifelike generated speech [2min Tutorial]
Переглядів 2,1 тис.10 місяців тому
Best TTS for OBS ElevenLabs with Lifelike generated speech [2min Tutorial]

КОМЕНТАРІ

  • @张张志祥
    @张张志祥 День тому

    Enable "Masking" or "Tracking", Can add Another switch transparent?

  • @Mate2Frio
    @Mate2Frio 2 дні тому

    Can it identify different speakers?

    • @royshilk
      @royshilk 2 дні тому

      not just yet but soon!

  • @victor_four
    @victor_four 2 дні тому

    Same issue as below: Failed to parse json string: Source error". Can anyone please advise how to set it up properly?

  • @Ariel-p9e3s
    @Ariel-p9e3s 3 дні тому

    WOW thanks

  • @matiaskenny7044
    @matiaskenny7044 3 дні тому

    Hi Is it possible to send the translated text directly to UA-cam CC as in POST CAPTIONS TO URL?

    • @royshilk
      @royshilk 2 дні тому

      You can enable the send captions to stream option in the advanced options That will send to YT live

    • @matiaskenny7044
      @matiaskenny7044 2 дні тому

      @@royshilk Hi Roy, Thanks for your reply. I've followed your YT guide URL/API plugin (ua-cam.com/video/E7HKbO6CP_c/v-deo.htmlsi=gurtTqrKnmtjuWVm) and I've run a Test Request and didn't came back with any errors but what I get is the time stamp but no translation. I've selected Method : Post - UA-cam Post Caption. Any idea if I'm missing something? Thanks

  • @pspavlovpavlov2900
    @pspavlovpavlov2900 3 дні тому

    Hi Roy, I hope you are well. Could this be a replacement for live captions in Chrome? I have to translate into other languages ​​that are not supported by the translator. Can you help me in this direction? How can I contact you to provide more details about my live translation needs?

  • @chiroplays
    @chiroplays 3 дні тому

    1 question! The mb size is for the amount of mb it would take on VRAM of the gpu or the system ram? Or is the download size of that model? Any major effects on gpu usage>? [I know i asked a lot in single question 🤧🤧]

  • @chiroplays
    @chiroplays 3 дні тому

    It would be appreciated if you can add by how much does the gpu, ram and cpu gets affect when adding the filters! I know it makes recording and all a bit more complicated. However, for people like me who multistream simultaneously with only a single pc and 16 gigs of ram, we need to keep a check on how much ram and stuff it actually occupies. I recently tried your squawk tts which is so amazing! However, upon adding 4 of those in a single scene, the ram usage went from 2.2 to 3.2 gigs. I know it's running locally so it needs that. Tbh the main reason i loved squawk is because it has so many amazing voiceovers and that too for free! The windows inbuilt TTS is so inferior compared to that. Currently I use speaker bot for alerts and stuff which uses around 100 to 150 MB of ram at max I guess. It'd be amazing if you ever collab with streamer bot and speaker bot! Personally, that would be a huge boon! Nonetheless, Thanks a lot for sharing such plugins (Polyglot, Squawk,etc) for free!! Really amazing work!!

  • @ダンバダンバ
    @ダンバダンバ 4 дні тому

    hey is it possible to make it read chat? like giving my stream chat a voice?

  • @chiroplays
    @chiroplays 5 днів тому

    NickEh30 should use this instead of banning people on his live stream💀💀💀💀💀💀💀💀💀💀💀💀

  • @MarieBinet-n3c
    @MarieBinet-n3c 6 днів тому

    Hello, once the plugin is installed, when I create the source, for me it appears as a file (paper icon) and not subtitles. Any chance you know what I do wrong?

  • @zwiftsquad9036
    @zwiftsquad9036 7 днів тому

    Hello Roy! Im having some problems. Whenever I add a source in OBS I get a few correct results then: ERROR CODE 429 QUOTA EXCEEDED FOR QUOTA METRIC "READ REQUESTS" AND LIMIT "READ REQUESTS PER MUTE PER USER". I understand the script is trying to read too many times but I don't know how to limit it. Thanks in advance!

    • @royshilk
      @royshilk 6 днів тому

      The quota limit is related to the free tier of the API provider, you'll need to switch to a paid plan or change your timer settings to reduce requests.

  • @bakunawavt
    @bakunawavt 7 днів тому

    I was wondering if this would allow us to have an object in OBS follow along with the tracked object. Such as having it track a face, so we can make a speech bubble for closed captioning that always follows the face?

  • @khalilz21
    @khalilz21 8 днів тому

    having problem with this bcoz the custom lobby that part is slightly transparent

  • @midhathrvat150
    @midhathrvat150 9 днів тому

    Hi! I want to do similar thing with performance overlay in GeForce now (Cloud gaming). I want to capture fps, latency and packet loss values in real time and later to export those values to find mean value of them. Is it possible?

    • @royshilk
      @royshilk 9 днів тому

      yes if the values can be OCR'd (they go on screen) you can use the "append" to get a list of them on which you can calculate statistics

    • @midhathrvat150
      @midhathrvat150 9 днів тому

      @@royshilk I did it, but there is one thing that is bothering me. Look, I don't want that video to loop. I want it to be played only once and to OCR values. do you understand? Is it possible?

  • @midhathrvat150
    @midhathrvat150 9 днів тому

    Hi! Is it possible to capture values like this frames/s on my performance stats in real time and export every value to some text file to find mean value?

    • @royshilk
      @royshilk 9 днів тому

      if it's something that apperas on screen - sure, you can grab it and send it to text file or API

  • @AshleyInnit
    @AshleyInnit 9 днів тому

    how do i delete the plugin? i installed it a bit ago and now every recording has ocr on it and it ruins the video

    • @royshilk
      @royshilk 9 днів тому

      Just remove the filter from the video source

    • @AshleyInnit
      @AshleyInnit 9 днів тому

      @royshilk there isnt a filter, ive fully uninstalled and reinstalled obs and its still doing it

  • @Neurogals
    @Neurogals 10 днів тому

    Thanks a lot! This is incredable! Can't wait for external model support.

  • @MFSuccessfully
    @MFSuccessfully 10 днів тому

    u r the best

  • @tainalo2_perso
    @tainalo2_perso 10 днів тому

    Hello, nice plugin ! I have test it this morning, French detection to English translation. I'm using it on my I5 12400F, do you think it's possible to run it throught Intel ARC GPU ? Cause actually it's working but take 18% of CPU usage and can't translate with Enable Partial Transcription to have real time translation.

    • @ragesimple1985
      @ragesimple1985 9 днів тому

      Too good, there's no lag for you? can I ask you for the entire configuration you put on it (I'm also looking to make French to English).

  • @yablalanguages5851
    @yablalanguages5851 11 днів тому

    did OBS change since you made this? I don't find the exact same UI/uX!

    • @royshilk
      @royshilk 11 днів тому

      OBS v30.2 is what I'm using but OBS v31 is already out in beta...

    • @yablalanguages5851
      @yablalanguages5851 11 днів тому

      @@royshilk Hi Roy! I am using 30.2 on a Mac (Silicon) and the windows were not exactly the same (text "extent"). I figured out how to follow you anyway and I have duplicated your tutorial pretty well. Thanks!

  • @basketzm
    @basketzm 11 днів тому

    hi i have a question when i connect the camera to the ocr the image slows down

    • @royshilk
      @royshilk 11 днів тому

      scoresight preview is 1FPS but the camers is handled at 30FPS

  • @Blootrix
    @Blootrix 11 днів тому

    I'd like this to be able to monitor a chat window for Bits and Subs, then read out that text in an AI voice I've trained. If you find the time, I'd absolutely love a tutorial on how to do that!

  • @TheeScaramouche
    @TheeScaramouche 12 днів тому

    It didn't work on my hp laptop

    • @royshilk
      @royshilk 11 днів тому

      do you wnat to share obs logs? come to discord discord.gg/Mu8WGw2Nka

  • @_insomniack
    @_insomniack 13 днів тому

    Can I use this tracking plugin as a way to track something and mask it / replace it like a greenscreen ? I mean real time detection, tracking and replacing

  • @Clionii
    @Clionii 14 днів тому

    Hello! Is it possible to grab info from a second sheet within the same document? It would help so much with organization. Thanks!

  • @49Macman
    @49Macman 15 днів тому

    Hi Roy, You are thriving now with all of your software. I'm happy for you and thanks so much for making so much available. Not sure as of yet what I'll need other than your background removal and your detect plugin, but it's good to know they are there. Thanks.

  • @DreamSpellEN
    @DreamSpellEN 16 днів тому

    What is the point at me? I got no output, not in textfile, no direct output into textsource.

  • @SyrilianGaming
    @SyrilianGaming 17 днів тому

    I installed it but my video capture device is now black. How do I fix this?

  • @cjld104
    @cjld104 17 днів тому

    I am having trouble installing it in Windows 11. I installed it using the installer, and then with manual copy-paste, restarted the computer, and still the plugin filter Detect won't show up. Please, help. :( Edit: I just saw minimum version should be 30. I have 29.x. I'll try updating OBS.

  • @markrobinson9876
    @markrobinson9876 18 днів тому

    Thank you. This is really helping for what I need. Just a couple of issues. Using a website link/HTML output and CSS selector, I have a template setup for {{output0}}<br>{{output1}}<br>{{output2}}<br> etc. But when the site doesn't have data for say {{output5}} that it did previously (as it changes on a daily basis) it doesn't show anything for any of the values and shows blank. Can we change this so it displays the values and then just nothing for the value where there isn't any data? Also, if I have too much data on one of the values, can I reduce the output using a template command? i.e "I need this bit, but not this bit". 🙂

  • @LarryIRL
    @LarryIRL 18 днів тому

    I love you! I was looking for this very thing last year. Thank you sir!

  • @pk_roger99
    @pk_roger99 18 днів тому

    non funziona!!! il programma installa correttamente, ma quando vai ad interagire col programma, non c'è nessun imput perfavore aiutatemi

  • @areenkhachadouri7754
    @areenkhachadouri7754 19 днів тому

    Can you send the cc to a youtube stream via embedded format?

  • @BetelRomanianChurch
    @BetelRomanianChurch 20 днів тому

    Is there any way to make this run off of gpu instead of cpu? My computers seems to bottle neck when everything is working

    • @royshilk
      @royshilk 20 днів тому

      Yes of course just download the CUDA version for windows

  • @My-CCTV
    @My-CCTV 21 день тому

    i ran the windows installer, and i still cant find DETECT inside the filters list

    • @royshilk
      @royshilk 21 день тому

      Please share obs logs on discord for help discord.gg/7hJy6gDa

  • @My-CCTV
    @My-CCTV 21 день тому

    driving me crazy, i have installed your downloaded zip file and extracted it as a directory, and copied that same directory to every possible root directory on the c drive program files obs studio, and i still cant find it inside the effects filter

    • @royshilk
      @royshilk 21 день тому

      The problem may be different. Obs version for example. Please share logs

    • @My-CCTV
      @My-CCTV 21 день тому

      @@royshilk how do i find logs? my version is 27.4.2

  • @My-CCTV
    @My-CCTV 21 день тому

    0.26 i am trying to watch, how you add this filter into obs, but you do not show it, you show the filter list nd then skip it, how do i add it, ive downloaded it, and there is no instruction anywhere onl internet how to add filters to obs, i only have basic list like APPLY LUT, CHROMA , SCROLL, SHARPEN KEY, etc help plz,

  • @My-CCTV
    @My-CCTV 21 день тому

    ive managed to download the zip file to my desktop , but how do i use this on obs, how do i install it

  • @JeffJiang
    @JeffJiang 21 день тому

    Hi Roy, Very glad to know the information which I can change background with the plugin. I downloaded by Windows 11, and installed it. But I can not find the plug in. Can you please tell me what I can do? Thanks!

  • @Madd_Taciturn
    @Madd_Taciturn 22 дні тому

    I downloaded it but it’s not showing up in the filters list

  • @mylesdb
    @mylesdb 23 дні тому

    Wish you showed the quality of the hand detection as most background removal apps struggle with that. NVIDIA broadcast does the best with hands but I am considering switching to an AMD Radeon laptop soon…

  • @can-rq7ho
    @can-rq7ho 24 дні тому

    Hello, I couldn't join because your discord link didn't work. I'm having a problem, I'd appreciate it if you could help me.

  • @lebluxtv
    @lebluxtv 25 днів тому

    Legend !

  • @techfren
    @techfren 25 днів тому

    thank you roy! I was just thinking about this project today! and it would be so cool to have live animations of emojis/icons generated similar to subtitles

  • @OwnyOne
    @OwnyOne 25 днів тому

    The localvocal option to add in audio filters isn't showing up for me

    • @royshilk
      @royshilk 25 днів тому

      Please share logs on discord

    • @OwnyOne
      @OwnyOne 19 днів тому

      @@royshilk It fixed when I updated OBS 👍

  • @FlixmyswitchLASER
    @FlixmyswitchLASER 27 днів тому

    Thank you its a great tool