How to setup your own AI vtuber

Поділитися
Вставка
  • Опубліковано 4 лис 2024

КОМЕНТАРІ • 124

  • @xiaohei9073
    @xiaohei9073  Рік тому +8

    FAQ:
    Cannot find module “customtkinter”:
    Try the exe version here: github.com/0Xiaohei0/VoiceToJapanese/releases/download/v1.2.3/VoiceToJapanese.v1.2.3-exe.zip It requires no setup, just unzip and run the exe file inside. Anti virus may complain about exe files, just click run anyway.
    If you do not trust the exe file, or want to modify the code, you need to troubleshoot why the setup script failed. This error message means setup.py didn't install the required libraries successfully. Run setup.py and check the console for error message. Most common error is using incorrect python version which should be 3.10.
    Error loading api key from environment variable, you need an api key from open ai:
    Check the console for actual error message, if you see "exceeded current quota", it usually means your openai free credits expired. Solution is to upgrade to paid plan, or create new accounts to try and get new free credit.
    Input: you
    The transcriber often transcribes silence into "you". Make sure you selected the correct input device in settings and check if the mic meter is moving.

    • @cc-564
      @cc-564 9 місяців тому

      may I ask the "push to talk" does not work?

    • @Dyrelis
      @Dyrelis 5 місяців тому

      @@cc-564 I think its only in 1.2.4 version

    • @TatsuyaKGJSensei
      @TatsuyaKGJSensei 2 місяці тому

      so can we use it as a mic?

  • @RaykinaBreaker
    @RaykinaBreaker Рік тому +7

    wow this application development is becoming better and better.

  • @Coloride
    @Coloride Рік тому +3

    Hello, node_characterai author there. This looks dope man, keep it up!

  • @RevRevQQ
    @RevRevQQ Рік тому +5

    doing gods work

  • @Max_Gamecock
    @Max_Gamecock Рік тому +1

    This is what I need, thank you

  • @Noxeramas
    @Noxeramas Рік тому +29

    this is incredible, do you know if theres a way to make ignore all the twitch chat bs? people saying single words or emojis, it seems to hyperfixate and waste conversation time

    • @touma-san91
      @touma-san91 Рік тому

      If it had filtering then yes, it would be possible. But it doesn't.

    • @mimi0010yt
      @mimi0010yt 10 місяців тому

      code it yourself

    • @Noxeramas
      @Noxeramas 10 місяців тому

      did already, its been 6 months@@mimi0010yt

  • @nebula297
    @nebula297 Рік тому +5

    this is fun to use but when i use the mic it detect i am talking but it dosen't detect what words i say and so it can't respond with my voice but overall it was fun to use

  • @Nisa-3D
    @Nisa-3D Рік тому +4

    you dont need audiobanana for that, at least in windows, just go to sound, recording and in cable output mark the "hear" slot

    • @notneb82
      @notneb82 3 місяці тому

      Thanks for this comment, for some reason when I tried the banana, it caused the UI to stop loading. Uninstalling audiobananno fixed it and your comment got the audio working.

  • @DoritosCat1
    @DoritosCat1 Місяць тому

    says that i need authorization "Couldn't download, needs authorization"

  • @greyowlaudio
    @greyowlaudio 3 місяці тому +2

    I have a neat question. Now that we have things like llama.ccp and the ollama interface that let us run local LLMs, is there a way to connect this program to your own local custom model, instead of typing in a chatGPT API key?

  • @chelol208
    @chelol208 Рік тому

    Bro i want her in real life. Really.

  • @dominhnate6661
    @dominhnate6661 Рік тому

    Thank you!

  • @Blaizecreativity
    @Blaizecreativity Рік тому

    goodluck im interested also

  • @flawless3055
    @flawless3055 Рік тому

    Thanks

  • @karaLurk
    @karaLurk Рік тому +10

    I'm aware that this might require a lot of work but is linux support planned? And if not would it be posible for you to tell me which parts would be needed to be "ported" so i can try to do that for myself? Thank you :3

    • @xiaohei9073
      @xiaohei9073  Рік тому +2

      Currently there is no linux support planned. Only whisper have run on your local machine. The other components of the pipeline can be moved to cloud so there shouldn't be any compatibility issues. If you swap out the bundled windows voicevox with the linux version, the project might work, but it's not tested. Also, you would need to install dependencies yourself with console commands.

    • @xiaohei9073
      @xiaohei9073  Рік тому +3

      Actually I just got the program to run on Linux with minimal issues, just need to install some dependencies myself and download the Linux version of voicevox.

  • @GingerStraps
    @GingerStraps 9 місяців тому +3

    Can a output English or is it just Japanese?

  • @luvxxander
    @luvxxander Рік тому +2

    No module named 'customtkinter'

  • @gachalillyz
    @gachalillyz Рік тому

    YOU SHOWED AILICE33

    • @a-s-greig
      @a-s-greig Рік тому

      Also my thought. Seems he got the model off Steam Workshop?

  • @killrodx
    @killrodx Рік тому

    Huh. neato.

  • @zeutrakhenlil
    @zeutrakhenlil 5 днів тому +1

    I bought it complete on Steam and it came with support for my language "Portuguese" I would like your help to configure it using my language, can you help me? In the tutorial you used Japanese voice, and since mine has Portuguese, how do I use it?

  • @Fedz-Personal
    @Fedz-Personal Рік тому +5

    Does the "Lore" file read even the W++ format? Since it allows to keep informations more organized! Also, is there a way to make her speak English?

    • @xiaohei9073
      @xiaohei9073  Рік тому +5

      You can put elevenlab api key in settings to make her speak English.

    • @ashidira
      @ashidira Рік тому

      Can you read Twitch comments in Spanish and respond in Spanish? @@xiaohei9073

  • @PromethorYT
    @PromethorYT Рік тому +3

    Anyone know of a natural sounding English voice pack I could use for this?

  • @GingerGingr
    @GingerGingr Рік тому +10

    Is there a english version?

  • @nicolasneh9435
    @nicolasneh9435 Рік тому +2

    I don't know English so that it detects my voice, how can I add other languages ​​that are not just English, Chinese or Japanese?

  • @sh4d0wj0j0
    @sh4d0wj0j0 Рік тому +2

    Do I need to pay for using an open ai api key? As far as I know it does take money from you for some iterations

    • @pablobarrios1260
      @pablobarrios1260 Рік тому +2

      Let me know if you have to or not please I was also wondering 😅

    • @sh4d0wj0j0
      @sh4d0wj0j0 Рік тому

      @@pablobarrios1260 You actually need to pay some cents per interaction

    • @Vamprei
      @Vamprei Рік тому

      costs money each time you have it generate something. @@pablobarrios1260

    • @intihardusunceleri
      @intihardusunceleri Рік тому

      No.

    • @SapphireYuna
      @SapphireYuna 11 місяців тому +2

      U get some free credits the first time u create an account but remember it stays there for only 3 months so use it all before the trial is over. Mine got wasted unfortunately.

  • @yanko38
    @yanko38 Рік тому +1

    is there any way I can work an a german language addon (with both input and output option) and where do I start?

  • @Wallarouge_Industries
    @Wallarouge_Industries Рік тому

    Mate can you please go through it slowly, step by step? im old lol and if u need to, use a TTS to better translate through the language barrier

  • @oceyy2763
    @oceyy2763 9 місяців тому

    when i connected the cable to voicemeeter banana the vtube studio mouth tracking stopped working

  • @ExeFreezy
    @ExeFreezy Рік тому +1

    Can you upload your own model as well or does this only work the model in the video?

    • @AkaneChiba
      @AkaneChiba Рік тому

      This'll work on any model you have. It can also be used on software such as VSeeface.

  • @比乐
    @比乐 Рік тому +1

    我超,原(

  • @Infelious
    @Infelious 9 місяців тому

    Hi would there be anyway to connect this to Vseeface over vtube studio since you need to pay for a good vtube model or use default otherwise.

  • @sekolahgadget
    @sekolahgadget Рік тому +1

    EOF error, RIFF error. Any solution?

  • @lujen0001
    @lujen0001 9 місяців тому

    i get an error message saying i need to put my api key in a location which i have and even using other api's they all result in the same error

  • @notneb82
    @notneb82 3 місяці тому

    I set up an Elevenlabs account and input the API key into the settings for Elevenlabs for an English voice. When loading the UI, I see on the console it loads both API keys for the AI from Open AI and the API key for the Elevenlabs voices. However, when I send messages to the AI and the AI responds I receive no audio when Elevenlabs is set to 'true'. The console returns this error message: "FileNotFoundError: [winerror 2] the system cannot find the file specified". Any ideas about what is causing the error? Did I miss something on my part that needs additional setup?

  • @luvxxander
    @luvxxander Рік тому

    how to fix python: can't open file 'C:\\Users\\lilbr\\Downloads\\UI.py': [Errno 2] No such file or directory
    Press any key to continue . . .

  • @itskiggu
    @itskiggu 11 місяців тому

    Can this be used with a local chat model using oobabooga?

  • @Sulanaonsol
    @Sulanaonsol 17 днів тому

    how to use subtitles

  • @Nani_wkwk
    @Nani_wkwk Рік тому +1

    Do you know how to make the youtube live chat also sound text to speech?

  • @周子健-h9i
    @周子健-h9i Рік тому

    Hello, sir. I tried it and it felt good, but the response speed was too slow. It took more than 6 seconds to ask a question and answer it.

  • @leandroasdf9245
    @leandroasdf9245 Рік тому +1

    How can you speak to him in Spanish?

  • @Syslori56
    @Syslori56 Рік тому

    portaudioerror(f'error querying device device ') how do i fix this :(

  • @luvxxander
    @luvxxander Рік тому

    i got it working but the ai key didnt work for some reason and the mouth doesnt move and she doesnt read chat this is so broken

  • @ned254
    @ned254 Рік тому

    HI! How can I change subtitles for example on Russian,because I can speak Russian, AI answer me on Japanese but subtitles will be in English?

  • @TearuRain
    @TearuRain Рік тому +1

    I got the text working, why theres no audio from the program? I wonder
    did I miss something? and Open API also not working... it did not detect my API
    also I got ffmpeg input error or something

    • @KEV.IN_
      @KEV.IN_ 8 місяців тому

      did you solve it? help

  • @EreilaOfficial
    @EreilaOfficial 4 місяці тому

    my chat isnt working i followed all the steps?

  • @MonchiMochiXT
    @MonchiMochiXT 9 місяців тому

    whart source is it in streamlabs?? please help

  • @canvy_the_best
    @canvy_the_best Рік тому

    Can it learn?

  • @PiggymcPigster
    @PiggymcPigster 3 місяці тому

    i cant hear anything and the vtuber wont say anything

  • @fakernoob377
    @fakernoob377 Рік тому

    does there english vision?

  • @Markus-r6g
    @Markus-r6g 7 місяців тому

    ENGLISH VERSION??

  • @TriWGaming
    @TriWGaming 7 місяців тому

    Why custumkintter

  • @mirkomirror7438
    @mirkomirror7438 Рік тому +1

    can i use custom voice models?

    • @SapphireYuna
      @SapphireYuna 11 місяців тому

      Only voicevox and eleven lab ones but if u mean custom trained models such as rvc model then no it's not supported yet but you can add it ofc

  • @mirkomirror7438
    @mirkomirror7438 Рік тому

    i need the makise kurisu voice model :c

    • @Klevsify
      @Klevsify Рік тому

      Bro is about to replicate her irl

  • @biglexj
    @biglexj Рік тому

    I get an error on line 111 of Pyaudio.

  • @Sulanaonsol
    @Sulanaonsol 17 днів тому

    helo

  • @UMP45BOT
    @UMP45BOT Рік тому

    how do i change the elevenlab voices

  • @Beneficialzombie777
    @Beneficialzombie777 Рік тому

    question, how come i cant hear my vtuber?

  • @desainekosjaya5745
    @desainekosjaya5745 Рік тому

    does this work with RTX2060 6gb?

  • @deadacc-s
    @deadacc-s 10 місяців тому

    how can i make her speak english without a paid service?

  • @Shajirr_
    @Shajirr_ Рік тому

    why do you have file extensions disabled on your system???

  • @luvxxander
    @luvxxander Рік тому

    the mouth doesnt move?

  • @nakamaro
    @nakamaro Рік тому +1

    when i ask her name she replies "Tama", is there a way to change the name? 🙂🙂

    • @xiaohei9073
      @xiaohei9073  Рік тому +4

      You can write "your name is ..." in in lores.txt

  • @itagamineko
    @itagamineko Рік тому

    can i use my own voice models?

    • @SapphireYuna
      @SapphireYuna 11 місяців тому

      You'd need to add RVC or another similar program to do that

  • @StolenPw
    @StolenPw 11 місяців тому

    is there no english option

  • @chrustosking4812
    @chrustosking4812 Рік тому

    When setting up that chat feature im getting this, any help?
    You need an API key stored in an environment variable

    • @xiaohei9073
      @xiaohei9073  Рік тому

      If you have put the api key in settings and still getting this error, check console for the actual error.

  • @RajPal-x9o
    @RajPal-x9o 7 місяців тому

    Pls bro publish it online

  • @crooonburry
    @crooonburry Рік тому

    Where did you get that vtuber model?

  • @r4vr4m12
    @r4vr4m12 Рік тому

    Is there a way to set it up without openai keys? any other github program or actual free website?

    • @SapphireYuna
      @SapphireYuna 11 місяців тому

      if u can add llama llm then it's completely free and people say it's as good as gpt 4 or at least close to it

  • @sleezydoodle1053
    @sleezydoodle1053 Рік тому

    when I try to start, it says modulenotfounderror: no module named 'customkinter'

    • @xiaohei9073
      @xiaohei9073  Рік тому +1

      The automated setup script didn’t run successfully, check the console for error message. Most common reason is using incorrect python version which should be 3.10. You can also try the exe version in version 1.2.3.

    • @sleezydoodle1053
      @sleezydoodle1053 Рік тому

      @xiaohei9073 Thanks! I had the wrong version of python running.

    • @goodvitamins6271
      @goodvitamins6271 Рік тому

      ​@sleezydoodle1053 what python is bad? 3.10 you use?

  • @CodeBroRob
    @CodeBroRob Рік тому

    can this be used in discord?

  • @lujen0001
    @lujen0001 9 місяців тому

    this doesnt work

  • @bhuvanp8776
    @bhuvanp8776 4 місяці тому

    how to make it to speak in english?

    • @fortnitefatboy
      @fortnitefatboy 3 місяці тому

      You can't, I modified the python translator to return the original text in english and it sounds messed up because the app uses voicebox which vocalizes text exclusively in japanese. I'm trying to find solutions to it because I don't want to pay 30 bucks a month just for 2 hours of translation but it's not simple

  • @isseiotakudesu748
    @isseiotakudesu748 Рік тому

    why do I get an error, can you help? I have installed this program ( import customtkinter
    ModuleNotFoundError: No module named 'customtkinter' )

    • @METALPOPO
      @METALPOPO Рік тому

      i have the same problem did u find the solution by any chance ?

    • @xiaohei9073
      @xiaohei9073  Рік тому

      github.com/0Xiaohei0/VoiceToJapanese/blob/master/README.md#faq

  • @azrieljale
    @azrieljale Рік тому

    Is there a way to have this on linux?

  • @NimoriWorld
    @NimoriWorld Рік тому

    what to do if Open-AI api is not available in your contry? and cant use vpn ?

    • @xiaohei9073
      @xiaohei9073  Рік тому

      need to write code to use another chatbot AI

    • @NimoriWorld
      @NimoriWorld Рік тому

      @@xiaohei9073 and what chatbot ai will that be?

  • @nufh
    @nufh Рік тому

    How fast the response?

    • @SapphireYuna
      @SapphireYuna 11 місяців тому +2

      Depends on ur gpu but I'd say it's usually 3-6 secs

    • @nufh
      @nufh 11 місяців тому

      @@SapphireYuna It's been 7 month since you posted it. The program still works? Because there is a change in openai lately.

    • @SapphireYuna
      @SapphireYuna 11 місяців тому +1

      @@nufh um sorry but I'm not the one who made it I was just reading through comments here. And yes it still works I've been facing some issues (not related to openai) but I managed to fix it. If you face problems I can probably help u. I've tried different projects using openai and all works fine so I don't think the changes did anything. I don't know what are the changes tbh I just came back to mess around with AI after months to maybe revive the AI vtubers again? Who knows. It's been very quiet lately

  • @ayylmao394
    @ayylmao394 Рік тому

    Is there a way to make it speak english?

    • @SapphireYuna
      @SapphireYuna 11 місяців тому

      Use the eleven labs settings

  • @tamkakit1233
    @tamkakit1233 Рік тому

    Does this require DeepL?

  • @chelol208
    @chelol208 Рік тому

    why she say in japanese and not in english language?

  • @uwuzziuwu4726
    @uwuzziuwu4726 11 місяців тому

    Is not free, api key need to pay 😔

  • @JosephOluremi
    @JosephOluremi Рік тому

    Pls d link