AI Voice 3D Assistant in Spline - Tutorial

Поділитися
Вставка
  • Опубліковано 27 лис 2024

КОМЕНТАРІ • 72

  • @bigloong6171
    @bigloong6171 22 дні тому +7

    Wow, spline is getting stronger and stronger, plus I'm honored to be able to provide case inspiration for the officials!

    • @splinetool
      @splinetool  22 дні тому

      @@bigloong6171 ❤️❤️❤️

    • @sagarbhat7317
      @sagarbhat7317 21 день тому

      Hi I have a question for the integration of AI into spline for my project. Could I get in touch with you on email? or Instagram?

    • @splinetool
      @splinetool  14 днів тому

      @@sagarbhat7317 Feel free to contact our team! You can reach us at review@spline.design.

  • @dingosmoov
    @dingosmoov 23 дні тому +5

    Nice tutorial! Yes would love to have a morph target tutorial.

    • @splinetool
      @splinetool  23 дні тому +1

      Noted! Thanks

    • @ceez-fr3zv
      @ceez-fr3zv 11 днів тому

      I would love to see that one too!

  • @madebypico
    @madebypico 22 дні тому +4

    Man this is awesome. Congrats to the team.

  • @FloNocode
    @FloNocode 24 дні тому +1

    Hi, thanks for this content ! We need more tutorial like that for upgrade our skill in Spline

    • @splinetool
      @splinetool  23 дні тому

      We’re really happy to hear that it’s helpful! We have even more tutorials coming your way to help build those skills! 😊 Let us know what other topics you’d like to see!

  • @vahiddaem
    @vahiddaem 25 днів тому

    wow... perfect... i have been waiting for this so long

  • @RIVETEStore
    @RIVETEStore 11 днів тому

    I'm pretty new to this but I was blown away. I intend to use or make one for my comm site as a virtual assistant for shopping or my 3d shop in my store. I would love to request if you have a more in-depth tutorial for such avenues, please? I will follow this for now but about instructions, personality feed, and the in-between edits I'd follow this tutorial. Could you add to this if you think it necessary for us common people

  • @ChannelQodequay
    @ChannelQodequay 14 днів тому +3

    Hey, I've been struggling to get response from AI, after API Key, can u share a tutorial on event set-up. After putting API key, it just dosent respond !!

    • @Feryzal
      @Feryzal 9 днів тому

      I have got the same problem

    • @TashaNicolee
      @TashaNicolee 8 днів тому

      I wasn't able to get it to play either.

    • @splinetool
      @splinetool  2 дні тому

      Hey there, could you check if you have a Credit Balance in your OpenAI developer account and try again.
      You can find more information on the Ai Voice Assistant feature + setup here: docs.spline.design/doc/ai-voice-assistant-api/doczANMXu23U#configuring-an-ai-voice-assistant

  • @awin24
    @awin24 24 дні тому +2

    Thank you for the tutorials! I did everything as you mentioned and when I press Play there is no response. what am I doing wrong?

    • @vahiddaem
      @vahiddaem 24 дні тому +1

      same here

    • @splinetool
      @splinetool  23 дні тому

      Hi there! Please check that you have an active, paid OpenAI account to enter your API key, verify your microphone settings, and clear your browser cache.
      Let us know if that helps! If you need more assistance, feel free to reach out to us at review@spline.design.

    • @madebypico
      @madebypico 22 дні тому +1

      Same issue, here is what I tried but the issue persists:
      - 3 different browsers + incognito mode
      - 2 different mic input, tested both mics in OBS
      - Made sure all other audio software was closed
      - Reboot
      - Created 3 different scenes and used suggested template
      - Tried 2 different API keys
      - Waited for the API key to take effect
      The OpenAI key registers a date for when it was used, so it does connect.
      I don't have any ideas left?

    • @madebypico
      @madebypico 22 дні тому

      I got a hunch.
      The voices in Spline are called:
      - Alloy
      - Echo
      - Shimmer
      The voices in openai settings are called:
      - Arbor
      - Ember
      - Spruce
      - Juniper
      - Sol
      - Vale
      - Cove
      - Maple
      - Breeze
      Maybe the voices you have mapped are not available in all countries, I'm based in Europe.

    • @splinetool
      @splinetool  21 день тому

      Hello @@madebypico! Check if you have an active OpenAI paid account. You can also try clearing your browser's cache. If you still need assistance, please contact our team at review@spline.design 🙌

  • @Bonini000
    @Bonini000 11 днів тому

    Hi, are there options to get text from links in customized ways like a normal “GET” or a customized “POST”?

  • @shifatmasud
    @shifatmasud 24 дні тому +2

    Morph tutorial please 🙏

  • @sagarbhat7317
    @sagarbhat7317 18 днів тому +1

    Hi is there a face model available like used in this video? I want the ai assistant to move its mouth when it talks.

    • @splinetool
      @splinetool  8 днів тому

      Hi there! You can now find the links to the demos ready to duplicate in the video description. We hope you find them useful!

  • @digitalmarketingroi617
    @digitalmarketingroi617 4 дні тому

    so cool

  • @Noah-bd7bs
    @Noah-bd7bs 13 днів тому

    is it possible to use elevenlavs voices ? Would be awesome !

  • @KL-bd1tg
    @KL-bd1tg 18 днів тому +1

    I followed the video instructions to create an API key on OpenAI, pasted the API key as shown in the video, and enabled microphone permissions, but there’s no response when I speak.

    • @stanislavkrofta7811
      @stanislavkrofta7811 14 днів тому

      Same here.. Did you manage to solve this?

    • @Feryzal
      @Feryzal 8 днів тому

      Ive got the same problem

    • @splinetool
      @splinetool  2 дні тому

      Hey there, you can mention the name of the variable in the instruction parameter in API panel. The Voice Assistant API will understand that it's a variable and work as instructed. Hope this helps! 😊
      You can learn more here: docs.spline.design/doc/ai-voice-assistant-api/doczANMXu23U

    • @TG-Pro.67
      @TG-Pro.67 День тому

      @@splinetool Same probleme here ! What do you mean by "mention the name of the variable in the instruction parameter in API panel" ? The document does not talks about it... Thank you !

    • @TG-Pro.67
      @TG-Pro.67 День тому

      Edit : It DOES work. I didn't buy a "developper plan" on chat GPT (different than the current plan)

  • @rusydamulayyana37
    @rusydamulayyana37 13 днів тому

    Does voice interaction still can be use after we embed this 3D character on our frame website?

    • @splinetool
      @splinetool  2 дні тому

      Hey, yes, you can embed using Spline Viewer and have the Voice Assistant API working,. The website will prompt to allow microphone access.

  • @jsizzle_
    @jsizzle_ 13 днів тому

    Is it possible to make the scale variable less dramatic when the assistant is speaking? I tried using "0.25 + AI Voice Spectrum" but that isn't working

    • @splinetool
      @splinetool  2 дні тому

      Hey there, could you share this file with us? We can test it on our end and let you know what we find. You can send it to help@spline.design

  • @designckinet
    @designckinet 18 днів тому

    Have a problem in the application for the Mac. You need to add the ability to call a voice assistant. It is necessary to allow access to the microphone to the recording, because in the version for the Mac I did not find such an opportunity. And it is desirable to do this automatically, as in Safari. When at the start of Safari asks if it is possible to allow the pop-up window.

  • @stenotest
    @stenotest 13 днів тому

    would it be possible to get the file used in the tutorial for the first Assistant 3d avatar? I am struggling on creating the floor

    • @splinetool
      @splinetool  8 днів тому

      Hi! The demo links are now in the video description, ready to duplicate!

  • @sarcophoguy-x
    @sarcophoguy-x 4 дні тому

    Why does using it cost so much? I ran it in preview for roughly 15 seconds and exchanged less than 20 words, it increased my real-time API by 0.06 - I upgraded to pro for this only to find out it is unusable? Edit: ran it live on my site and it cut itself off three times, had the page up for about 20 seconds, another 6 cents.

  • @chinatyu4778
    @chinatyu4778 5 днів тому

    Can we have variable support for the AI system prompt?

    • @splinetool
      @splinetool  2 дні тому

      Hey there, you can mention the name of the variable in the instruction parameter in API panel. The Voice Assistant API will understand that it's a variable and work as instructed.
      You can learn more here: docs.spline.design/doc/ai-voice-assistant-api/doczANMXu23U

  • @AlexRivera-uj8ie
    @AlexRivera-uj8ie 16 днів тому

    Is it possible to bring the project to a website with Webflow or WordPress?

    • @splinetool
      @splinetool  14 днів тому

      Hello! Yes! You can learn more about integrating your Spline projects with WebFlow, WordPress, and other web builders by checking the documentation here: docs.spline.design/

    • @AlexRivera-uj8ie
      @AlexRivera-uj8ie 13 днів тому

      Thanks!! :D

  • @designckinet
    @designckinet 18 днів тому +1

    Awesome idea. But nov it's works like A test Beta. Everything is constantly in bugs. Works badly.

  • @creative_one-z6f
    @creative_one-z6f 3 дні тому

    The bill from openai for realtime API access, is quite steep for this. A few dollars for a new minutes conversation. Ouch.

  • @Web3RealtyLLC
    @Web3RealtyLLC 5 днів тому

    how come after i exported my agent it wont talk to me??

    • @Web3RealtyLLC
      @Web3RealtyLLC 5 днів тому

      only in spline it talks to me?

    • @splinetool
      @splinetool  2 дні тому

      Hey there! I would check the microphone permission on your browser. 😊 This could be the issue, hope this helps.

  • @Rensoconese
    @Rensoconese 23 дні тому

    Can i chat with the character? I want the user to write what they want to ask and the character to respond with voice and text

    • @splinetool
      @splinetool  22 дні тому +1

      @@Rensoconese currently the voice can only receive voice input. But seems like a possible future improvement.

    • @Rensoconese
      @Rensoconese 20 днів тому

      @@splinetool Great! If they add the chat feature, they could create an experience like that of a role-playing game. Combined with other Spline features, it could be a game-changer.

  • @robertasumendi
    @robertasumendi 14 днів тому

    Would love to learn more about moving character's mouth to an audio file rather than AI

  • @designckinet
    @designckinet 23 дні тому

    How to integrate to iOS app?

    • @splinetool
      @splinetool  23 дні тому

      Hi! We have a tutorial focused on how to integrate your Spline designs into iOS.
      You can check it out here 👉 ua-cam.com/video/44OPMq7FdD0/v-deo.html

    • @designckinet
      @designckinet 23 дні тому

      @@splinetool I mean if I have AI voice in my iOS app can I integrate that responsive face?

    • @splinetool
      @splinetool  2 дні тому

      @@designckinet Hey again 😊APIs and Webhooks are not supported in IOS or Android Embeds, but noted this is something you would like to see.

  • @AngryApple
    @AngryApple 17 днів тому

    Why the forced OpenAI API? This could have been done with every OpenAI Compatible API with an self hosted LLM or other LLM.

    • @minkeymoo
      @minkeymoo 15 днів тому

      Mainly because of the real time api limitation, it's taking the text as well as voice, which even tho can be done by a local model, will be really slow, open ai imo has just made it be super fast somehow in their api

  • @BoburMavlonov
    @BoburMavlonov 13 днів тому

    it is not speaking

    • @Feryzal
      @Feryzal 8 днів тому

      I have the same problem

    • @splinetool
      @splinetool  2 дні тому

      Hey there, could you check if you have a Credit Balance in your OpenAI developer account and try again.
      You can find more information on the Ai Voice Assistant feature + setup here: docs.spline.design/doc/ai-voice-assistant-api/doczANMXu23U#configuring-an-ai-voice-assistant

  • @davidfitcher2953
    @davidfitcher2953 25 днів тому

    7:50 Why is this so childish?

    • @frostimusprime
      @frostimusprime 24 дні тому +1

      Because they told it to pretend to be Cookie Monster from Sesame Street. A children's tv show.

  • @Thomsonx
    @Thomsonx 15 днів тому

    Gross.