I have insight that may be useful. On my screen, I see your likes counter clocking up, however, it continues to show 47. Is this the same on your screen? If so, then in both instances, what could this be demonstrating?
The interruption is determined by the model. When it detects your interruption, the on-going output will be stop, so the transcription text will also stop at what has been generated. And then the model will generate a special message showing the rest generation is discarded. In this demo project, you will see a transcript message "No audio data received".
It possible to do it for camera video capturing, by redesigning the HTML/CSS and wrap it into a native android/ios app. The backend and most of JS functions in the frontend remains. However, implementing the screen capture on mobile looks much harder because it will need your app to record the screen activities and meanwhile do voice interaction in the background.
Google-genai has been upgraded, and the session.send() definition was changed. Make sure you run the demo code on google-genai==0.3.0.
excelente coonteúdo e entrega! parabéns por ensinar tanto!
Thanks for sharing man ❤
Thx bro, amazing! Really appreciate the detailed sharing and demo. Learned a ton from your video.
You are welcome! Glad it is helpful!
I have insight that may be useful. On my screen, I see your likes counter clocking up, however, it continues to show 47. Is this the same on your screen? If so, then in both instances, what could this be demonstrating?
So what happens if the model is interrupted.
Will it still transcribe the response before the inturruption
The interruption is determined by the model. When it detects your interruption, the on-going output will be stop, so the transcription text will also stop at what has been generated. And then the model will generate a special message showing the rest generation is discarded. In this demo project, you will see a transcript message "No audio data received".
Is it possible to adapt the screen sharing capability to mobile? Because it is not possible through Google Studio
It possible to do it for camera video capturing, by redesigning the HTML/CSS and wrap it into a native android/ios app. The backend and most of JS functions in the frontend remains. However, implementing the screen capture on mobile looks much harder because it will need your app to record the screen activities and meanwhile do voice interaction in the background.
@yeyulab can we create android app do that?
Bro! You are the greatest !!! 老黄牛🐮!!! Will send you an email to say thank you as well !!!
Thank you too!