- 85
- 75 653
Data Leaps
United Kingdom
Приєднався 13 сер 2020
Welcome to Data Leaps, this is a data channel for Power BI, Databricks, DevOps, Platform Security, Career in Data, and Learning Resources.
I am Liping, Data & AI Solution Architect, ex-Microsoft, I specialize in Big Data Analytics, Data Engineering, Data Warehousing and Business Intelligence. In addition to creating content on UA-cam, I am also a blogger (www.dataleaps.co.uk) and international public speaker (www.sessionize.com/lipinght), you can follow me on Linkedin (www.linkedin.com/in/lipinght) for content release notification.
The statements and views expressed here are mine alone.
I am Liping, Data & AI Solution Architect, ex-Microsoft, I specialize in Big Data Analytics, Data Engineering, Data Warehousing and Business Intelligence. In addition to creating content on UA-cam, I am also a blogger (www.dataleaps.co.uk) and international public speaker (www.sessionize.com/lipinght), you can follow me on Linkedin (www.linkedin.com/in/lipinght) for content release notification.
The statements and views expressed here are mine alone.
What are the possible next roles for Solution Architects #data #career
In this video, I go through the possible next roles for solution architects
00:00 Intro
01:23 SA/SSA/RSA Role Rotation
02:29 Manager
03:15 Sales
04:02 Product PM
05:32 DevRel
06:19 Join a consultancy
06:54 Contracting
07:46 Solopreneur
08:49 Start your own consultancy
09:31 Going back to Industry
10:21 Something different
---------------------------
This is part of the Diary of a Solution Architect series ua-cam.com/play/PLE_IpfSmEJ80dnKUJ3VswZIv7vgo4Cudr.html
in this series, I will cover
#jobhunting tips
#Interview tips
#Skillbuilding
Different roles
#Careerprogression
Productivity tips
Life before and after solution architect
---------------------------
Hi, I am Liping, Data & AI Solution Architect, ex-Microsoft, I specialize in Big Data Analytics, Data Engineering, Data Warehousing and Business Intelligence. In addition to creating content on UA-cam, I am also a blogger (www.dataleaps.co.uk) and international public speaker (www.sessionize.com/lipinght), you can follow me on Linkedin (www.linkedin.com/in/lipinght) for content release notification.
The statements and views expressed here are mine alone.
-----------------------------------------------
00:00 Intro
01:23 SA/SSA/RSA Role Rotation
02:29 Manager
03:15 Sales
04:02 Product PM
05:32 DevRel
06:19 Join a consultancy
06:54 Contracting
07:46 Solopreneur
08:49 Start your own consultancy
09:31 Going back to Industry
10:21 Something different
---------------------------
This is part of the Diary of a Solution Architect series ua-cam.com/play/PLE_IpfSmEJ80dnKUJ3VswZIv7vgo4Cudr.html
in this series, I will cover
#jobhunting tips
#Interview tips
#Skillbuilding
Different roles
#Careerprogression
Productivity tips
Life before and after solution architect
---------------------------
Hi, I am Liping, Data & AI Solution Architect, ex-Microsoft, I specialize in Big Data Analytics, Data Engineering, Data Warehousing and Business Intelligence. In addition to creating content on UA-cam, I am also a blogger (www.dataleaps.co.uk) and international public speaker (www.sessionize.com/lipinght), you can follow me on Linkedin (www.linkedin.com/in/lipinght) for content release notification.
The statements and views expressed here are mine alone.
-----------------------------------------------
Переглядів: 18
Відео
How to interview for Solution Architect/Solution Engineer roles at #Databricks (SA/SSA/RSA)
Переглядів 158День тому
In this video, I go through how to interview at Databricks for Solution Architect/ Specialist Solution Architect/Resident Solution Architect roles at Solution Engineer level or Solution Architect Level 00:00 Intro 00:18 Solution Architect vs Solution Engineer 01:35 Solution Architect/Specialist Solution Architect Interview process 06:43 Resident Solution Architect interview process This is part...
How to do #PowerBI embedded RLS in 2024
Переглядів 11914 днів тому
This video quickly walks through the user owns data and app owns data RLS implementation options. 00:00 Intro 01:43 User owns data 02:34 App owns data Dynamic RLS 04:25 App owns data Service Principal Profile Check out my other videos on Power BI ua-cam.com/play/PLE_IpfSmEJ81gZFIBAfViSNeWXhcBkB0s.html Hi, I am Liping, Data & AI Solution Architect, ex-Microsoft, I specialize in Big Data Analytic...
How to build a #streamlit quiz app and deploy it on #Databricks lakehouse apps
Переглядів 18321 день тому
In this video, I went through how to build a simple streamlit quiz app and then deploy it on Databicks lakehouse apps. This video is part of the series "Databricks Essentials".ua-cam.com/video/sOCQgoemQIo/v-deo.html In this series, I will cover the fundamentals of #Databricks, #deltalake, #apachespark, #mlflow, and #unitycatalog Hi, I am Liping, Data & AI Solution Architect, ex-Microsoft, I spe...
Updated #PowerBI Template for #Databricks #Cost #Analysis and #Cross Charging
Переглядів 147Місяць тому
This is an updated #powerbi template to do #databricks cost management and cross charge Download Power BI template: github.com/lipinght/Databricks-cost-analysis-using-powerbi How to set up: ua-cam.com/video/tTbngPbldzY/v-deo.htmlfeature=shared How to customise: ua-cam.com/video/FCtE5R1irbU/v-deo.htmlfeature=shared This is part of video series for Power BI template on Databricks system tables fo...
How to create #Databricks #lakehouse apps with a Databricks backend featuring Daniel Brookes
Переглядів 307Місяць тому
The code used in this demo can be found in github.com/db-dan/databricks-dino-game In this video, Databricks Senior Solution Engineer Daniel Brookes (www.linkedin.com/in/db-dan/) walks through how to create and deploy a simple dino game app on lakehouse apps with a Databricks backend. This video is part of the series "Databricks Essentials".ua-cam.com/video/sOCQgoemQIo/v-deo.html In this series,...
How to incorporate #Databricks #AI Functions in Genie space
Переглядів 3693 місяці тому
This video walks through how to incorporate Databricks AI Functions to be used by Databricks #genie space. This demo was created by my coworkder Puneet Jain www.linkedin.com/in/puneetjain159/ follow him on linkedin for more LLM content. This video is part of the series "Databricks Essentials".ua-cam.com/video/sOCQgoemQIo/v-deo.html In this series, I will cover the fundamentals of #Databricks, #...
How to use #Databricks AI Functions to analyze your text data with out-of-box Gen AI features
Переглядів 2803 місяці тому
In this video, I cover how to build AI functions in Databricks to analyze your text data with out-of-box Gen AI functioanlities. This video is part of the series "Databricks Essentials".ua-cam.com/video/sOCQgoemQIo/v-deo.html In this series, I will cover the fundamentals of #Databricks, #deltalake, #apachespark, #mlflow, and #unitycatalog Hi, I am Liping, Data & AI Solution Architect, ex-Micros...
How to build a personal brand as a data professional #data #dataengineering #machinelearning #ai
Переглядів 1353 місяці тому
In this video, I go through how to build a personal brand as a data professional. 00:00 Intro 00:33 Why personal brand building is important for you 04:29 What's your brand 07:13 How to get started 09:20 Reach the right audience 11:21 Personal brand vs company brand 12:50 Solo or partner in crime 14:26 The support system This is part of the Diary of a Solution Architect series ua-cam.com/play/P...
Managing #linkedin connections and follows and avoid homogeneous feed
Переглядів 893 місяці тому
This is part of the Diary of a Solution Architect series ua-cam.com/play/PLE_IpfSmEJ80dnKUJ3VswZIv7vgo4Cudr.html in this series, I will cover #jobhunting tips #Interview tips #Skillbuilding Different roles #Careerprogression Productivity tips Life before and after solution architect Hi, I am Liping, Data & AI Solution Architect, ex-Microsoft, I specialize in Big Data Analytics, Data Engineering...
How to connect #Excel to #Databricks with fine-grained #accesscontrol via #PowerBI dataset
Переглядів 6324 місяці тому
In this video, I go through how to connect Excel to data in Databricks with fine-grained access control. This approach is achieved using Power BI semantic models, in the next video, I will go through how to do the Excel to Databricks connection using ODBC connector. This video is part of the series "Databricks Essentials".ua-cam.com/video/sOCQgoemQIo/v-deo.html In this series, I will cover the ...
How to use #Anomalo to automatically monitor #data #quality on #Databricks #dataengineering #AI
Переглядів 6124 місяці тому
In this demo, Toon Weyens Ph.D. (www.linkedin.com/in/toonweyens/) from Anomalo showcases how to integrate Animal with Databricks to automatically monitor data quality on Databricks lakehouse. This is part of a UA-cam Series Databricks and Friends: In this series, I will cover Databricks integration with ISV partners. Hi, I am Liping, Data & AI Solution Architect, ex-Microsoft, I specialize in B...
How to visualise #realtime #data using #PowerBI #streaming API and #Databricks #structuredstreaming
Переглядів 2774 місяці тому
How to visualise #realtime #data using #PowerBI #streaming API and #Databricks #structuredstreaming
How to visualise #streaming / #realtime #data using #PowerBI and #Databricks #dataanalysis
Переглядів 3364 місяці тому
How to visualise #streaming / #realtime #data using #PowerBI and #Databricks #dataanalysis
Life of a #Databricks Senior Solution Engineer --New Joiner PoV --Interview with Daniel Brooks
Переглядів 7965 місяців тому
Life of a #Databricks Senior Solution Engineer New Joiner PoV Interview with Daniel Brooks
How to build #AIBI #Dashboard in #Databricks #datanalytics #visualization
Переглядів 1,5 тис.5 місяців тому
How to build #AIBI #Dashboard in #Databricks #datanalytics #visualization
How to start & grow a #data & #ai consultancy-Interview with Advancing Analytics CEO Terry McCann
Переглядів 3375 місяців тому
How to start & grow a #data & #ai consultancy-Interview with Advancing Analytics CEO Terry McCann
How to use #Databricks #AIBI #genie #nocode #data #exploration
Переглядів 4835 місяців тому
How to use #Databricks #AIBI #genie #nocode #data #exploration
Life of a Resident Solution Architect in #Databricks -- feat. Holly Smith, How to become a #data RSA
Переглядів 9015 місяців тому
Life of a Resident Solution Architect in #Databricks feat. Holly Smith, How to become a #data RSA
#Data and #AI decoded webinar #data101#learning #dataanalytics #dataengineering #dadtascience
Переглядів 3256 місяців тому
#Data and #AI decoded webinar #data101#learning #dataanalytics #dataengineering #dadtascience
#Data & #AI decoded: Live Webinar Announcement What is data & AI, How to #pivot into #career in Data
Переглядів 2066 місяців тому
#Data & #AI decoded: Live Webinar Announcement What is data & AI, How to #pivot into #career in Data
How to connect #PowerBI to #Databricks on AWS using SSO passthrough and use Unity Catalog ACL in PBI
Переглядів 5766 місяців тому
How to connect #PowerBI to #Databricks on AWS using SSO passthrough and use Unity Catalog ACL in PBI
How to #interview at #microsoft as Cloud Solution Architect or Technical Specialist #jobhunting
Переглядів 1,3 тис.6 місяців тому
How to #interview at #microsoft as Cloud Solution Architect or Technical Specialist #jobhunting
#Databricks Essentials: How to import CSV files in Databricks
Переглядів 8856 місяців тому
#Databricks Essentials: How to import CSV files in Databricks
What different types of architects do and their names in #databricks, #microsoft, #aws, #google
Переглядів 3477 місяців тому
What different types of architects do and their names in #databricks, #microsoft, #aws, #google
How to become a digital nomad as a data professional feat. Mara from datapears #data #digitalnomad
Переглядів 5047 місяців тому
How to become a digital nomad as a data professional feat. Mara from datapears #data #digitalnomad
How to stand out in job applications as solution architects, data engineers, data scientists etc.
Переглядів 2097 місяців тому
How to stand out in job applications as solution architects, data engineers, data scientists etc.
How to do Databricks Cost Analysis and Cross Charge using Power BI template: customization
Переглядів 2778 місяців тому
How to do Databricks Cost Analysis and Cross Charge using Power BI template: customization
How to do Databricks Cost Analysis and Cross Charge using Power BI template: Report Navigation
Переглядів 6668 місяців тому
How to do Databricks Cost Analysis and Cross Charge using Power BI template: Report Navigation
Welcome to Data Leaps - A channel for #PowerBI #Databricks #platformsecurity #DevOps #Careerindata
Переглядів 3578 місяців тому
Welcome to Data Leaps - A channel for #PowerBI #Databricks #platformsecurity #DevOps #Careerindata
What all topics will be asked in Coding round? What will be the level of coding questions?
Data eng, machine learning, spark optimization, same coding test is for all levels, your score together with other feedback from other rounds determine what level you get hired at
Looking forward to your next update on job and query costs.
working on it
thank you very much for this clear video
If you are connected using DQ, can you enforce RLS in power bi? Are there performance issues to be aware of?
If you are connected using DQ, can you enforce RLS in power bi? --Yes Are there performance issues to be aware of? --Please see this ua-cam.com/video/K_6E1V3E6Q0/v-deo.html
You are doing excellent work❤ in the field of data streams. I have one suggestion: could you consider organizing the videos by each technology, such as Power BI, Databricks, Tabular Editor, and so on?
Thanks for the compliment and advice, Power BI and Databricks are already organised into playlist, Tabular Editor playlist is coming next year, I will try to make these more visible on the channel home page
Hi there! Thanks for the video. Small question: if a table has multiple foreign keys, the Power BI automatically sets the relationships and the first field with a foreign key is set as the active relationship and others will naturally be set with non active relationships. Is it possible to configure on Databricks end which foreign key field should be with the active relationship? Or is this something that the developer has to always edit in the Power BI side.
It's not configurable on Databricks' end
can you share the repo used for deployment? I did not catch what the requirements were for deploying on databricks
Here is the repo github.com/db-dan/databricks-dino-game
Thank You ! You are a gold mine and now my 'go-to' for Databricks - PowerBI stuff !
Great explanation of a very key capability ! Thank you 🙏
Nice Video, It would be really nice that If we get a path to get selected in databricks
Yeah, I will do a interview process video soon
@dataleaps appreciate, thanks
@suryapratapsingh9713 ua-cam.com/video/Tfpdwf45eK8/v-deo.html
@@dataleaps thanks a lot, happy that you remembered 😊
Awesome! Have 1 question. Running time increases a lot using AI query in Genie ?
Processing time will increase, yes, whether it increases a lot will be dependent on which ai function you use and how much data you have
Awesome demo is there a github link to code
github.com/lipinght/PBI-on-DB-Cookbook/blob/main/RT_with_DB_and_PBI_DAIS23/README.md
Puneet Jain and Nikhil Chandna's medium blog on this subject nikhil-chandna71.medium.com/turbocharge-your-genie-experience-with-databricks-ai-functions-unlock-ai-for-business-users-9b04965ef128
Where did you find published dataset link that pasted in tabular editor ?
Thanks for the video! I'm pretty new on Power BI admin and I try to find the best way to handle Dataflow migration with the deployment pipeline. But it seems that it does not migrate passwords, so I have to use a workaround... By any chance, do you know a course or any other resources that could help to understand the entire picture, please? I used Chatgpt to generate PowerShell scripts and thought about using task scheduler
Thank you for the content! Informative and engaging.
Thank you 😊
I am using Power BI report in import mode, data coming in from azure databricks. Is there anyway Unity Catalog security can be applied on Power BI report? Please note I am using Import mode in Power BI.
Thanks so much for sharing ❤ I have subscribed
Thank you 😊
Hey is it possible to create dshboards the way you have done if i am using community edition of databricks ?? I dont see options of SQL , Dataengineering in the side bar . So i was thinking for community edition users to create visualizations can be done only through notebooks . Sorry if the question seems dumb i am a newbie . Thanks!!
Unfortunately community edition has limited features Vs the full databricks experience , you can try the free trial for databricks for features not offered in community edition
This is really helpful. One quick question, if we use import while publishing to Power BI. Is it possible to manage access control from the unity catalog?
Import mode is using a service account, so UC can only control what that account has access to, not the end users in power bi, I explained it in a separate video ua-cam.com/video/1n2M4NfH5XA/v-deo.htmlsi=9KrPxUU4Gixo_k_9
what if the UC is not set up?
Then you use the access control set up in your databricks workspace, non UC world has no fine grain access control though
Thanks for sharing!
Great interview ! Holly I like how candid you were, it really helps bring us into the life of a RSA :)
Great
no no
Thanks for sharing, you are sharing useful info on your channel Keep up the good work 👍👍
Great video! Nice call out on the Mac use case. Is there a way to refresh the semantic model (schema and/or metadata changes) once it’s been published?
Yes, you refresh it the same way you would when you publish from desktop
Learn something new! Thanks for sharing. Excellent content!
Did not know this existed! thanks! A lot of Mac Users will love this
Feature is brand new :)
Magic!
This is great!
basically, I can connect to databrick, but I am not able to see system table. however, i can use yout template to see system table and the dashboard
You need access to 3 things: 1. access to system tables. ie. being able to do SELECT * FROM system.billing.usage ( you might need admin to grant you access to the billing schema) 2. access to use the databricks workspace, which you already have, when you say you can connect to Databricks 3. access to a sql warehouse, again, ask admin to give you access, and use the connection string for power bi template
Hello Liping, Thanks so much for your videos, that works for me. but I am not able to setup data connection for system table from PowerBI-》 get the data source, can you give me some idea?
Is there actually a difference between using Azure Databricks Connector within Power Bi as opposed to partner connect? I really can’t see any difference which suggests to use one as opposed to the other?
If your databricks is on azure, there is no difference apart from partner connection pre-populate the connection string for you. If your databricks is on AWS and if you using some other oauth and not AAD, partner connect defaults to Azure Databricks connector and AAD as Oauth, so you are better off connecting manually in Power BI
@@dataleaps yeah mine is Azure. So it’s basically down to preference? Also, do you know if query folding will ever be supported as standard? When connecting to Azure Databricks?
Hi, is there a away to bring source table name???
Hello, iam not getting that custom actions option in tabular editor for single partiton refresh. Please help!
Nicely explained. Thanks for sharing!
Great video! Thank you! I have a large table that is not being refreshed because of premium memory capacity limit. Can I create multiple partitions based on date, and refresh all partitions separately to avoid power BI memory limit issue?
you could do incremental refreshes learn.microsoft.com/en-us/power-bi/connect-data/incremental-refresh-overview
Thanks. But I can’t, because after implementing incremental refresh, the first refresh in power BI service is a full refresh which I get memory capacity error.
@@Amir_mo what's your model size and what power bi capacity are you on?
If you are using AAD with databricks on AWS, you can use the Azure Databricks connector in Power BI as long as you have SSO enabled
*Promosm*
Thank you so much for this. I'm new to Data Analytics and this video has helped me a lot with a project I'm working on
Al momento de intentar realizar el análisis de sentimiento me arroja el siguiente error. Agradecería tu ayuda: Expression.Error: No se puede convertir el valor "[Function]" al tipo Function. Detalles: Value=[Function] Type=[Type]
El error me aparace al conectar una Hoja de Cálculo de Google. No así cuando uso un Excel, ahí no tengo problemas
Just what I was looking for! Really helpful! Thanks a mil :)
The sound of this video was recorded on the right channel. If you cannot hear anything, change your computer sound audio balance and increase the right balance, you will be able to hear better
Voice is very low, no use of video information, its very difficult to hear and understand
The sound of this video was recorded on the right channel. If you cannot hear anything, change your computer sound audio balance and increase the right balance, you will be able to hear better
You forgot to add your voice.
Great!
Not able to hear anything
The sound of this video was recorded on the right channel. If you cannot hear anything, change your computer sound audio balance and increase the right balance, you will be able to hear better
Does the powershell script also work if you have MFA on your account? or is a ServiceAccount some specific account type that you need to create in Azure AD?
Service Principal is not an normal AAD account, you set it up by setting up app reg in AAD, take a look at this github.com/lipinght/PBICookbook/blob/main/ServicePrincipal/ServicePrincipal.md
Very good video. TY
Glad it was helpful!