Build copilots with VISION | GPT-4 Turbo with Vision + Azure AI

Build and deploy copilot style apps that leverage the power of both GPT-4 Turbo with Vision and Azure AI Vision and Search in Microsoft’s Azure AI Studio. Enable direct lookups from image inputs over your organizational data to ground generative AI responses. This marks a significant improvement in the accuracy of natural language processing and image recognition tasks to enable new generative AI scenarios. Video inputs are also uniquely supported when you combine GPT-4 Turbo with Vision and Azure AI Vision.
Seth Juarez, Principal Program Manager for Azure AI, shares how it’s easy to build and orchestrate powerful copilot style apps.
► QUICK LINKS:
00:00 - GPT-4 Turbo with Vision + Azure AI Vision
00:42 - Baseline capabilities of GPT-4 Turbo with Vision
02:43 - Direct lookups of image and video data
04:53 - See the two combined: Demo
05:52 - How to build it
07:17 - See the code behind your app
► Link References
Watch a detailed overview at aka.ms/AzureAIStudioMechanics
Start using Azure AI Studio today at ai.azure.com
Check out our QuickStart guides at aka.ms/LearnAIStudio
► Unfamiliar with Microsoft Mechanics?
As Microsoft's official video series for IT, you can watch and share valuable content and demos of current and upcoming tech from the people who build it at Microsoft.
• Subscribe to our UA-cam: / microsoftmechanicsseries
• Talk with other IT Pros, join us on the Microsoft Tech Community: techcommunity.microsoft.com/t...
• Watch or listen from anywhere, subscribe to our podcast: microsoftmechanics.libsyn.com...
► Keep getting this insider knowledge, join us on social:
• Follow us on Twitter: / msftmechanics
• Share knowledge on LinkedIn: / microsoft-mechanics
• Enjoy us on Instagram: / msftmechanics
• Loosen up with us on TikTok: / msftmechanics
#AzureAI #GPT4 #Copilot #OpenAI

[@acodersjourney]

Your dedication to simplifying coding concepts is truly appreciated. Thanks for being an invaluable resource for learners like me!

[@RP_USA]

Great video!

[@user-gg8we2ot4b]

Super!

[@JamieTorontoAtkinson]

clear Microsoft videos yay

[@hussienalsafi1149]

❤️❤️❤️❤️❤️

[@honeymak]

if bing chat is capable of this, it would be superb-niceness

[@MustafaFarooq]

can this be integrated into copilot for M365 as a plugin ?

[@Familymnn]

Wow

[@kevindibb6534]

When will GPT-4V be available in the East US region? And which regions is it available in right now?

[@maxmuller7842]

Is GPT-4 Turbo with Vision enough for "normal" OCR from invoices? Or do you need Azure AI Vision for this tasks.

[@dipteshbosedb]

A very valid question. What is the purpose of the "Enhancements: Vision" AI Services Toggle in the playground?

[@MSFTMechanics]

As covered in the video, the enhancements enable object detection for direct data lookups, bounding boxes on images to identify those objects, and video analysis. At a high level, it allows you to operationalize and act on what's detected in the image, whereas GPT 4 Turbo with Vision excels at verbose descriptions, but on its own isn't optimized to query and find matches in a related dataset.

[@oguzhanguvenkaya660]

how can i integrated with ios app ? is that possible ?