- 80
- 68 898
Data Leaps
United Kingdom
Приєднався 13 сер 2020
Welcome to Data Leaps, this is a data channel for Power BI, Databricks, DevOps, Platform Security, Career in Data, and Learning Resources.
I am Liping, Data & AI Solution Architect, ex-Microsoft, I specialize in Big Data Analytics, Data Engineering, Data Warehousing and Business Intelligence. In addition to creating content on UA-cam, I am also a blogger (www.dataleaps.co.uk) and international public speaker (www.sessionize.com/lipinght), you can follow me on Linkedin (www.linkedin.com/in/lipinght) for content release notification.
The statements and views expressed here are mine alone.
I am Liping, Data & AI Solution Architect, ex-Microsoft, I specialize in Big Data Analytics, Data Engineering, Data Warehousing and Business Intelligence. In addition to creating content on UA-cam, I am also a blogger (www.dataleaps.co.uk) and international public speaker (www.sessionize.com/lipinght), you can follow me on Linkedin (www.linkedin.com/in/lipinght) for content release notification.
The statements and views expressed here are mine alone.
How to create #Databricks #lakehouse apps with a Databricks backend featuring Daniel Brookes
The code used in this demo can be found in github.com/db-dan/databricks-dino-game
In this video, Databricks Senior Solution Engineer Daniel Brookes (www.linkedin.com/in/db-dan/) walks through how to create and deploy a simple dino game app on lakehouse apps with a Databricks backend.
-----------------------------------------------
This video is part of the series "Databricks Essentials".ua-cam.com/video/sOCQgoemQIo/v-deo.html
In this series, I will cover the fundamentals of #Databricks, #deltalake, #apachespark, #mlflow, and #unitycatalog
-----------------------------------------------
Hi, I am Liping, Data & AI Solution Architect, ex-Microsoft, I specialize in Big Data Analytics, Data Engineering, Data Warehousing and Business Intelligence. In addition to creating content on UA-cam, I am also a blogger (www.dataleaps.co.uk) and international public speaker (www.sessionize.com/lipinght), you can follow me on Linkedin (www.linkedin.com/in/lipinght) for content release notification.
The statements and views expressed here are mine alone.
-----------------------------------------------
In this video, Databricks Senior Solution Engineer Daniel Brookes (www.linkedin.com/in/db-dan/) walks through how to create and deploy a simple dino game app on lakehouse apps with a Databricks backend.
-----------------------------------------------
This video is part of the series "Databricks Essentials".ua-cam.com/video/sOCQgoemQIo/v-deo.html
In this series, I will cover the fundamentals of #Databricks, #deltalake, #apachespark, #mlflow, and #unitycatalog
-----------------------------------------------
Hi, I am Liping, Data & AI Solution Architect, ex-Microsoft, I specialize in Big Data Analytics, Data Engineering, Data Warehousing and Business Intelligence. In addition to creating content on UA-cam, I am also a blogger (www.dataleaps.co.uk) and international public speaker (www.sessionize.com/lipinght), you can follow me on Linkedin (www.linkedin.com/in/lipinght) for content release notification.
The statements and views expressed here are mine alone.
-----------------------------------------------
Переглядів: 155
Відео
How to incorporate #Databricks #AI Functions in Genie space
Переглядів 266Місяць тому
This video walks through how to incorporate Databricks AI Functions to be used by Databricks #genie space. This demo was created by my coworkder Puneet Jain www.linkedin.com/in/puneetjain159/ follow him on linkedin for more LLM content. This video is part of the series "Databricks Essentials".ua-cam.com/video/sOCQgoemQIo/v-deo.html In this series, I will cover the fundamentals of #Databricks, #...
How to use #Databricks AI Functions to analyze your text data with out-of-box Gen AI features
Переглядів 2172 місяці тому
In this video, I cover how to build AI functions in Databricks to analyze your text data with out-of-box Gen AI functioanlities. This video is part of the series "Databricks Essentials".ua-cam.com/video/sOCQgoemQIo/v-deo.html In this series, I will cover the fundamentals of #Databricks, #deltalake, #apachespark, #mlflow, and #unitycatalog Hi, I am Liping, Data & AI Solution Architect, ex-Micros...
How to build a personal brand as a data professional #data #dataengineering #machinelearning #ai
Переглядів 1012 місяці тому
In this video, I go through how to build a personal brand as a data professional. 00:00 Intro 00:33 Why personal brand building is important for you 04:29 What's your brand 07:13 How to get started 09:20 Reach the right audience 11:21 Personal brand vs company brand 12:50 Solo or partner in crime 14:26 The support system This is part of the Diary of a Solution Architect series ua-cam.com/play/P...
Managing #linkedin connections and follows and avoid homogeneous feed
Переглядів 712 місяці тому
This is part of the Diary of a Solution Architect series ua-cam.com/play/PLE_IpfSmEJ80dnKUJ3VswZIv7vgo4Cudr.html in this series, I will cover #jobhunting tips #Interview tips #Skillbuilding Different roles #Careerprogression Productivity tips Life before and after solution architect Hi, I am Liping, Data & AI Solution Architect, ex-Microsoft, I specialize in Big Data Analytics, Data Engineering...
How to connect #Excel to #Databricks with fine-grained #accesscontrol via #PowerBI dataset
Переглядів 4712 місяці тому
In this video, I go through how to connect Excel to data in Databricks with fine-grained access control. This approach is achieved using Power BI semantic models, in the next video, I will go through how to do the Excel to Databricks connection using ODBC connector. This video is part of the series "Databricks Essentials".ua-cam.com/video/sOCQgoemQIo/v-deo.html In this series, I will cover the ...
How to use #Anomalo to automatically monitor #data #quality on #Databricks #dataengineering #AI
Переглядів 4173 місяці тому
In this demo, Toon Weyens Ph.D. (www.linkedin.com/in/toonweyens/) from Anomalo showcases how to integrate Animal with Databricks to automatically monitor data quality on Databricks lakehouse. This is part of a UA-cam Series Databricks and Friends: In this series, I will cover Databricks integration with ISV partners. Hi, I am Liping, Data & AI Solution Architect, ex-Microsoft, I specialize in B...
How to visualise #realtime #data using #PowerBI #streaming API and #Databricks #structuredstreaming
Переглядів 2023 місяці тому
In this video, I walked through how to use Structured Streaming in Databricks and Streaming dataset API in Power BI to visualize streaming /realtime data This is a video part of Power BI on Databricks series ua-cam.com/play/PLE_IpfSmEJ80jrlBxnfJ9DPRMl8oj8fj4.html Hi, I am Liping, Data & AI Solution Architect, ex-Microsoft, I specialize in Big Data Analytics, Data Engineering, Data Warehousing a...
How to visualise #streaming / #realtime #data using #PowerBI and #Databricks #dataanalysis
Переглядів 2503 місяці тому
In this video, I walked through how to use Delta Live Tables in Databricks and Direct Query and Auto Page Refresh in Power BI to visualize streaming /realtime data This is a video part of Power BI on Databricks series ua-cam.com/play/PLE_IpfSmEJ80jrlBxnfJ9DPRMl8oj8fj4.html Hi, I am Liping, Data & AI Solution Architect, ex-Microsoft, I specialize in Big Data Analytics, Data Engineering, Data War...
Life of a #Databricks Senior Solution Engineer --New Joiner PoV --Interview with Daniel Brooks
Переглядів 6053 місяці тому
In this video, Daniel Brooks (www.linkedin.com/in/db-dan/) shares his perspective as a new Senior Solution Engineer at Databricks, covering: 00:00 Intro 00:58 Life before Databricks 02:04 #Motivation to join Databricks 02:41 Preparing for the interview 03:40 The interview process 04:31 The onboarding 05:41 Difference between working for vs with Databricks 07:50 What about Databricks surprises y...
How to build #AIBI #Dashboard in #Databricks #datanalytics #visualization
Переглядів 9564 місяці тому
How to build #AIBI #Dashboard in #Databricks #datanalytics #visualization
How to start & grow a #data & #ai consultancy-Interview with Advancing Analytics CEO Terry McCann
Переглядів 3124 місяці тому
How to start & grow a #data & #ai consultancy-Interview with Advancing Analytics CEO Terry McCann
How to use #Databricks AIBI genie #nocode #data #exploration
Переглядів 3944 місяці тому
How to use #Databricks AIBI genie #nocode #data #exploration
Life of a Resident Solution Architect in #Databricks -- feat. Holly Smith, How to become a #data RSA
Переглядів 7494 місяці тому
Life of a Resident Solution Architect in #Databricks feat. Holly Smith, How to become a #data RSA
#Data and #AI decoded webinar #data101#learning #dataanalytics #dataengineering #dadtascience
Переглядів 3184 місяці тому
#Data and #AI decoded webinar #data101#learning #dataanalytics #dataengineering #dadtascience
#Data & #AI decoded: Live Webinar Announcement What is data & AI, How to #pivot into #career in Data
Переглядів 1694 місяці тому
#Data & #AI decoded: Live Webinar Announcement What is data & AI, How to #pivot into #career in Data
How to connect #PowerBI to #Databricks on AWS using SSO passthrough and use Unity Catalog ACL in PBI
Переглядів 4855 місяців тому
How to connect #PowerBI to #Databricks on AWS using SSO passthrough and use Unity Catalog ACL in PBI
How to #interview at #microsoft as Cloud Solution Architect or Technical Specialist #jobhunting
Переглядів 9845 місяців тому
How to #interview at #microsoft as Cloud Solution Architect or Technical Specialist #jobhunting
#Databricks Essentials: How to import CSV files in Databricks
Переглядів 6695 місяців тому
#Databricks Essentials: How to import CSV files in Databricks
What different types of architects do and their names in #databricks, #microsoft, #aws, #google
Переглядів 3085 місяців тому
What different types of architects do and their names in #databricks, #microsoft, #aws, #google
How to become a digital nomad as a data professional feat. Mara from datapears #data #digitalnomad
Переглядів 4606 місяців тому
How to become a digital nomad as a data professional feat. Mara from datapears #data #digitalnomad
How to stand out in job applications as solution architects, data engineers, data scientists etc.
Переглядів 1856 місяців тому
How to stand out in job applications as solution architects, data engineers, data scientists etc.
How to do Databricks Cost Analysis and Cross Charge using Power BI template: customization
Переглядів 2376 місяців тому
How to do Databricks Cost Analysis and Cross Charge using Power BI template: customization
How to do Databricks Cost Analysis and Cross Charge using Power BI template: Report Navigation
Переглядів 5587 місяців тому
How to do Databricks Cost Analysis and Cross Charge using Power BI template: Report Navigation
Welcome to Data Leaps - A channel for #PowerBI #Databricks #platformsecurity #DevOps #Careerindata
Переглядів 3017 місяців тому
Welcome to Data Leaps - A channel for #PowerBI #Databricks #platformsecurity #DevOps #Careerindata
How to publish semantic models to #PowerBI directly from #Databricks workspace, no desktop needed
Переглядів 3,4 тис.7 місяців тому
How to publish semantic models to #PowerBI directly from #Databricks workspace, no desktop needed
How to do Access Control for #powerbi on #databricks
Переглядів 1 тис.8 місяців тому
How to do Access Control for #powerbi on #databricks
How to do Databricks Cost Analysis and Cross Charge using Power BI template: Set Up
Переглядів 7849 місяців тому
How to do Databricks Cost Analysis and Cross Charge using Power BI template: Set Up
How to configure #powerbi Authentication to #databricks
Переглядів 1,7 тис.10 місяців тому
How to configure #powerbi Authentication to #databricks
How to choose #databricks connector for #powerbi: Azure Databricks Connector vs Databricks Connector
Переглядів 86810 місяців тому
How to choose #databricks connector for #powerbi: Azure Databricks Connector vs Databricks Connector
Hi there! Thanks for the video. Small question: if a table has multiple foreign keys, the Power BI automatically sets the relationships and the first field with a foreign key is set as the active relationship and others will naturally be set with non active relationships. Is it possible to configure on Databricks end which foreign key field should be with the active relationship? Or is this something that the developer has to always edit in the Power BI side.
can you share the repo used for deployment? I did not catch what the requirements were for deploying on databricks
Here is the repo github.com/db-dan/databricks-dino-game
Thank You ! You are a gold mine and now my 'go-to' for Databricks - PowerBI stuff !
Great explanation of a very key capability ! Thank you 🙏
Nice Video, It would be really nice that If we get a path to get selected in databricks
Yeah, I will do a interview process video soon
@dataleaps appreciate, thanks
Awesome! Have 1 question. Running time increases a lot using AI query in Genie ?
Processing time will increase, yes, whether it increases a lot will be dependent on which ai function you use and how much data you have
Awesome demo is there a github link to code
github.com/lipinght/PBI-on-DB-Cookbook/blob/main/RT_with_DB_and_PBI_DAIS23/README.md
Puneet Jain and Nikhil Chandna's medium blog on this subject nikhil-chandna71.medium.com/turbocharge-your-genie-experience-with-databricks-ai-functions-unlock-ai-for-business-users-9b04965ef128
Where did you find published dataset link that pasted in tabular editor ?
Thanks for the video! I'm pretty new on Power BI admin and I try to find the best way to handle Dataflow migration with the deployment pipeline. But it seems that it does not migrate passwords, so I have to use a workaround... By any chance, do you know a course or any other resources that could help to understand the entire picture, please? I used Chatgpt to generate PowerShell scripts and thought about using task scheduler
Thank you for the content! Informative and engaging.
Thank you 😊
I am using Power BI report in import mode, data coming in from azure databricks. Is there anyway Unity Catalog security can be applied on Power BI report? Please note I am using Import mode in Power BI.
Thanks so much for sharing ❤ I have subscribed
Thank you 😊
Hey is it possible to create dshboards the way you have done if i am using community edition of databricks ?? I dont see options of SQL , Dataengineering in the side bar . So i was thinking for community edition users to create visualizations can be done only through notebooks . Sorry if the question seems dumb i am a newbie . Thanks!!
Unfortunately community edition has limited features Vs the full databricks experience , you can try the free trial for databricks for features not offered in community edition
This is really helpful. One quick question, if we use import while publishing to Power BI. Is it possible to manage access control from the unity catalog?
Import mode is using a service account, so UC can only control what that account has access to, not the end users in power bi, I explained it in a separate video ua-cam.com/video/1n2M4NfH5XA/v-deo.htmlsi=9KrPxUU4Gixo_k_9
what if the UC is not set up?
Then you use the access control set up in your databricks workspace, non UC world has no fine grain access control though
Thanks for sharing!
Great interview ! Holly I like how candid you were, it really helps bring us into the life of a RSA :)
Great
no no
Thanks for sharing, you are sharing useful info on your channel Keep up the good work 👍👍
Great video! Nice call out on the Mac use case. Is there a way to refresh the semantic model (schema and/or metadata changes) once it’s been published?
Yes, you refresh it the same way you would when you publish from desktop
Learn something new! Thanks for sharing. Excellent content!
Did not know this existed! thanks! A lot of Mac Users will love this
Feature is brand new :)
Magic!
This is great!
basically, I can connect to databrick, but I am not able to see system table. however, i can use yout template to see system table and the dashboard
You need access to 3 things: 1. access to system tables. ie. being able to do SELECT * FROM system.billing.usage ( you might need admin to grant you access to the billing schema) 2. access to use the databricks workspace, which you already have, when you say you can connect to Databricks 3. access to a sql warehouse, again, ask admin to give you access, and use the connection string for power bi template
Hello Liping, Thanks so much for your videos, that works for me. but I am not able to setup data connection for system table from PowerBI-》 get the data source, can you give me some idea?
Is there actually a difference between using Azure Databricks Connector within Power Bi as opposed to partner connect? I really can’t see any difference which suggests to use one as opposed to the other?
If your databricks is on azure, there is no difference apart from partner connection pre-populate the connection string for you. If your databricks is on AWS and if you using some other oauth and not AAD, partner connect defaults to Azure Databricks connector and AAD as Oauth, so you are better off connecting manually in Power BI
@@dataleaps yeah mine is Azure. So it’s basically down to preference? Also, do you know if query folding will ever be supported as standard? When connecting to Azure Databricks?
Hi, is there a away to bring source table name???
Hello, iam not getting that custom actions option in tabular editor for single partiton refresh. Please help!
Nicely explained. Thanks for sharing!
Great video! Thank you! I have a large table that is not being refreshed because of premium memory capacity limit. Can I create multiple partitions based on date, and refresh all partitions separately to avoid power BI memory limit issue?
you could do incremental refreshes learn.microsoft.com/en-us/power-bi/connect-data/incremental-refresh-overview
Thanks. But I can’t, because after implementing incremental refresh, the first refresh in power BI service is a full refresh which I get memory capacity error.
@@Amir_mo what's your model size and what power bi capacity are you on?
If you are using AAD with databricks on AWS, you can use the Azure Databricks connector in Power BI as long as you have SSO enabled
*Promosm*
Thank you so much for this. I'm new to Data Analytics and this video has helped me a lot with a project I'm working on
Al momento de intentar realizar el análisis de sentimiento me arroja el siguiente error. Agradecería tu ayuda: Expression.Error: No se puede convertir el valor "[Function]" al tipo Function. Detalles: Value=[Function] Type=[Type]
El error me aparace al conectar una Hoja de Cálculo de Google. No así cuando uso un Excel, ahí no tengo problemas
Just what I was looking for! Really helpful! Thanks a mil :)
The sound of this video was recorded on the right channel. If you cannot hear anything, change your computer sound audio balance and increase the right balance, you will be able to hear better
Voice is very low, no use of video information, its very difficult to hear and understand
The sound of this video was recorded on the right channel. If you cannot hear anything, change your computer sound audio balance and increase the right balance, you will be able to hear better
You forgot to add your voice.
Great!
Not able to hear anything
The sound of this video was recorded on the right channel. If you cannot hear anything, change your computer sound audio balance and increase the right balance, you will be able to hear better
Does the powershell script also work if you have MFA on your account? or is a ServiceAccount some specific account type that you need to create in Azure AD?
Service Principal is not an normal AAD account, you set it up by setting up app reg in AAD, take a look at this github.com/lipinght/PBICookbook/blob/main/ServicePrincipal/ServicePrincipal.md
Very good video. TY
Glad it was helpful!
Really helpful! How's the performance through the gateway approach?
gateway typically ends up being the performance bottleneck
Thank you, it was very clear and useful!
Great to hear! Thanks
Hi, Can we do the similar Power BI Partition refresh using Power Automate? Basically we have to execute the xmla code.
data-marc.com/2020/01/13/manage-all-your-power-bi-refreshes-in-one-place-with-power-automate-flow/
I executed the same script but i am getting the below error used below module Install-Module -Name MicrosoftPowerBIMgmt.Profile -Verbose -Scope CurrentUser -Force Install-Module -Name MicrosoftPowerBIMgmt.Workspaces -Verbose -Scope CurrentUser -Force Install-Module MicrosoftPowerBIMgmt -force -AllowClobber Connect-PowerBIServiceAccount : One or more errors occurred. At D:\a\_temp\2f66e56e-fd4c-4dc0-b011-d2aa4bdd1079.ps1:8 char:1 + Connect-PowerBIServiceAccount -ServicePrincipal -Credential $credenti ... + ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + CategoryInfo : WriteError: (Microsoft.Power...IServiceAccount:ConnectPowerBIServiceAccount) [Connect-Po werBIServiceAccount], AggregateException + FullyQualifiedErrorId : One or more errors occurred.,Microsoft.PowerBI.Commands.Profile.ConnectPowerBIServiceAccount
cool