Data Leaps
Data Leaps
  • 85
  • 75 653
What are the possible next roles for Solution Architects #data #career
In this video, I go through the possible next roles for solution architects
00:00 Intro
01:23 SA/SSA/RSA Role Rotation
02:29 Manager
03:15 Sales
04:02 Product PM
05:32 DevRel
06:19 Join a consultancy
06:54 Contracting
07:46 Solopreneur
08:49 Start your own consultancy
09:31 Going back to Industry
10:21 Something different
---------------------------
This is part of the Diary of a Solution Architect series ua-cam.com/play/PLE_IpfSmEJ80dnKUJ3VswZIv7vgo4Cudr.html
in this series, I will cover
#jobhunting tips
#Interview tips
#Skillbuilding
Different roles
#Careerprogression
Productivity tips
Life before and after solution architect
---------------------------
Hi, I am Liping, Data & AI Solution Architect, ex-Microsoft, I specialize in Big Data Analytics, Data Engineering, Data Warehousing and Business Intelligence. In addition to creating content on UA-cam, I am also a blogger (www.dataleaps.co.uk) and international public speaker (www.sessionize.com/lipinght), you can follow me on Linkedin (www.linkedin.com/in/lipinght) for content release notification.
The statements and views expressed here are mine alone.
-----------------------------------------------
Переглядів: 18

Відео

How to interview for Solution Architect/Solution Engineer roles at #Databricks (SA/SSA/RSA)
Переглядів 158День тому
In this video, I go through how to interview at Databricks for Solution Architect/ Specialist Solution Architect/Resident Solution Architect roles at Solution Engineer level or Solution Architect Level 00:00 Intro 00:18 Solution Architect vs Solution Engineer 01:35 Solution Architect/Specialist Solution Architect Interview process 06:43 Resident Solution Architect interview process This is part...
How to do #PowerBI embedded RLS in 2024
Переглядів 11914 днів тому
This video quickly walks through the user owns data and app owns data RLS implementation options. 00:00 Intro 01:43 User owns data 02:34 App owns data Dynamic RLS 04:25 App owns data Service Principal Profile Check out my other videos on Power BI ua-cam.com/play/PLE_IpfSmEJ81gZFIBAfViSNeWXhcBkB0s.html Hi, I am Liping, Data & AI Solution Architect, ex-Microsoft, I specialize in Big Data Analytic...
How to build a #streamlit quiz app and deploy it on #Databricks lakehouse apps
Переглядів 18321 день тому
In this video, I went through how to build a simple streamlit quiz app and then deploy it on Databicks lakehouse apps. This video is part of the series "Databricks Essentials".ua-cam.com/video/sOCQgoemQIo/v-deo.html In this series, I will cover the fundamentals of #Databricks, #deltalake, #apachespark, #mlflow, and #unitycatalog Hi, I am Liping, Data & AI Solution Architect, ex-Microsoft, I spe...
Updated #PowerBI Template for #Databricks #Cost #Analysis and #Cross Charging
Переглядів 147Місяць тому
This is an updated #powerbi template to do #databricks cost management and cross charge Download Power BI template: github.com/lipinght/Databricks-cost-analysis-using-powerbi How to set up: ua-cam.com/video/tTbngPbldzY/v-deo.htmlfeature=shared How to customise: ua-cam.com/video/FCtE5R1irbU/v-deo.htmlfeature=shared This is part of video series for Power BI template on Databricks system tables fo...
How to create #Databricks #lakehouse apps with a Databricks backend featuring Daniel Brookes
Переглядів 307Місяць тому
The code used in this demo can be found in github.com/db-dan/databricks-dino-game In this video, Databricks Senior Solution Engineer Daniel Brookes (www.linkedin.com/in/db-dan/) walks through how to create and deploy a simple dino game app on lakehouse apps with a Databricks backend. This video is part of the series "Databricks Essentials".ua-cam.com/video/sOCQgoemQIo/v-deo.html In this series,...
How to incorporate #Databricks #AI Functions in Genie space
Переглядів 3693 місяці тому
This video walks through how to incorporate Databricks AI Functions to be used by Databricks #genie space. This demo was created by my coworkder Puneet Jain www.linkedin.com/in/puneetjain159/ follow him on linkedin for more LLM content. This video is part of the series "Databricks Essentials".ua-cam.com/video/sOCQgoemQIo/v-deo.html In this series, I will cover the fundamentals of #Databricks, #...
How to use #Databricks AI Functions to analyze your text data with out-of-box Gen AI features
Переглядів 2803 місяці тому
In this video, I cover how to build AI functions in Databricks to analyze your text data with out-of-box Gen AI functioanlities. This video is part of the series "Databricks Essentials".ua-cam.com/video/sOCQgoemQIo/v-deo.html In this series, I will cover the fundamentals of #Databricks, #deltalake, #apachespark, #mlflow, and #unitycatalog Hi, I am Liping, Data & AI Solution Architect, ex-Micros...
How to build a personal brand as a data professional #data #dataengineering #machinelearning #ai
Переглядів 1353 місяці тому
In this video, I go through how to build a personal brand as a data professional. 00:00 Intro 00:33 Why personal brand building is important for you 04:29 What's your brand 07:13 How to get started 09:20 Reach the right audience 11:21 Personal brand vs company brand 12:50 Solo or partner in crime 14:26 The support system This is part of the Diary of a Solution Architect series ua-cam.com/play/P...
Managing #linkedin connections and follows and avoid homogeneous feed
Переглядів 893 місяці тому
This is part of the Diary of a Solution Architect series ua-cam.com/play/PLE_IpfSmEJ80dnKUJ3VswZIv7vgo4Cudr.html in this series, I will cover #jobhunting tips #Interview tips #Skillbuilding Different roles #Careerprogression Productivity tips Life before and after solution architect Hi, I am Liping, Data & AI Solution Architect, ex-Microsoft, I specialize in Big Data Analytics, Data Engineering...
How to connect #Excel to #Databricks with fine-grained #accesscontrol via #PowerBI dataset
Переглядів 6324 місяці тому
In this video, I go through how to connect Excel to data in Databricks with fine-grained access control. This approach is achieved using Power BI semantic models, in the next video, I will go through how to do the Excel to Databricks connection using ODBC connector. This video is part of the series "Databricks Essentials".ua-cam.com/video/sOCQgoemQIo/v-deo.html In this series, I will cover the ...
How to use #Anomalo to automatically monitor #data #quality on #Databricks #dataengineering #AI
Переглядів 6124 місяці тому
In this demo, Toon Weyens Ph.D. (www.linkedin.com/in/toonweyens/) from Anomalo showcases how to integrate Animal with Databricks to automatically monitor data quality on Databricks lakehouse. This is part of a UA-cam Series Databricks and Friends: In this series, I will cover Databricks integration with ISV partners. Hi, I am Liping, Data & AI Solution Architect, ex-Microsoft, I specialize in B...
How to visualise #realtime #data using #PowerBI #streaming API and #Databricks #structuredstreaming
Переглядів 2774 місяці тому
How to visualise #realtime #data using #PowerBI #streaming API and #Databricks #structuredstreaming
How to visualise #streaming / #realtime #data using #PowerBI and #Databricks #dataanalysis
Переглядів 3364 місяці тому
How to visualise #streaming / #realtime #data using #PowerBI and #Databricks #dataanalysis
Life of a #Databricks Senior Solution Engineer --New Joiner PoV --Interview with Daniel Brooks
Переглядів 7965 місяців тому
Life of a #Databricks Senior Solution Engineer New Joiner PoV Interview with Daniel Brooks
How to build #AIBI #Dashboard in #Databricks #datanalytics #visualization
Переглядів 1,5 тис.5 місяців тому
How to build #AIBI #Dashboard in #Databricks #datanalytics #visualization
How to start & grow a #data & #ai consultancy-Interview with Advancing Analytics CEO Terry McCann
Переглядів 3375 місяців тому
How to start & grow a #data & #ai consultancy-Interview with Advancing Analytics CEO Terry McCann
How to use #Databricks #AIBI #genie #nocode #data #exploration
Переглядів 4835 місяців тому
How to use #Databricks #AIBI #genie #nocode #data #exploration
Life of a Resident Solution Architect in #Databricks -- feat. Holly Smith, How to become a #data RSA
Переглядів 9015 місяців тому
Life of a Resident Solution Architect in #Databricks feat. Holly Smith, How to become a #data RSA
#Data and #AI decoded webinar #data101#learning #dataanalytics #dataengineering #dadtascience
Переглядів 3256 місяців тому
#Data and #AI decoded webinar #data101#learning #dataanalytics #dataengineering #dadtascience
#Data & #AI decoded: Live Webinar Announcement What is data & AI, How to #pivot into #career in Data
Переглядів 2066 місяців тому
#Data & #AI decoded: Live Webinar Announcement What is data & AI, How to #pivot into #career in Data
How to connect #PowerBI to #Databricks on AWS using SSO passthrough and use Unity Catalog ACL in PBI
Переглядів 5766 місяців тому
How to connect #PowerBI to #Databricks on AWS using SSO passthrough and use Unity Catalog ACL in PBI
How to #interview at #microsoft as Cloud Solution Architect or Technical Specialist #jobhunting
Переглядів 1,3 тис.6 місяців тому
How to #interview at #microsoft as Cloud Solution Architect or Technical Specialist #jobhunting
#Databricks Essentials: How to import CSV files in Databricks
Переглядів 8856 місяців тому
#Databricks Essentials: How to import CSV files in Databricks
What different types of architects do and their names in #databricks, #microsoft, #aws, #google
Переглядів 3477 місяців тому
What different types of architects do and their names in #databricks, #microsoft, #aws, #google
How to become a digital nomad as a data professional feat. Mara from datapears #data #digitalnomad
Переглядів 5047 місяців тому
How to become a digital nomad as a data professional feat. Mara from datapears #data #digitalnomad
How to stand out in job applications as solution architects, data engineers, data scientists etc.
Переглядів 2097 місяців тому
How to stand out in job applications as solution architects, data engineers, data scientists etc.
How to do Databricks Cost Analysis and Cross Charge using Power BI template: customization
Переглядів 2778 місяців тому
How to do Databricks Cost Analysis and Cross Charge using Power BI template: customization
How to do Databricks Cost Analysis and Cross Charge using Power BI template: Report Navigation
Переглядів 6668 місяців тому
How to do Databricks Cost Analysis and Cross Charge using Power BI template: Report Navigation
Welcome to Data Leaps - A channel for #PowerBI #Databricks #platformsecurity #DevOps #Careerindata
Переглядів 3578 місяців тому
Welcome to Data Leaps - A channel for #PowerBI #Databricks #platformsecurity #DevOps #Careerindata

КОМЕНТАРІ

  • @ganeshnayak4179
    @ganeshnayak4179 10 днів тому

    What all topics will be asked in Coding round? What will be the level of coding questions?

    • @dataleaps
      @dataleaps 9 днів тому

      Data eng, machine learning, spark optimization, same coding test is for all levels, your score together with other feedback from other rounds determine what level you get hired at

  • @yasinmoha1
    @yasinmoha1 11 днів тому

    Looking forward to your next update on job and query costs.

  • @emmarita134
    @emmarita134 17 днів тому

    thank you very much for this clear video

  • @fatimatayeb677
    @fatimatayeb677 22 дні тому

    If you are connected using DQ, can you enforce RLS in power bi? Are there performance issues to be aware of?

    • @dataleaps
      @dataleaps 22 дні тому

      If you are connected using DQ, can you enforce RLS in power bi? --Yes Are there performance issues to be aware of? --Please see this ua-cam.com/video/K_6E1V3E6Q0/v-deo.html

  • @dineshgodge1171
    @dineshgodge1171 Місяць тому

    You are doing excellent work❤ in the field of data streams. I have one suggestion: could you consider organizing the videos by each technology, such as Power BI, Databricks, Tabular Editor, and so on?

    • @dataleaps
      @dataleaps Місяць тому

      Thanks for the compliment and advice, Power BI and Databricks are already organised into playlist, Tabular Editor playlist is coming next year, I will try to make these more visible on the channel home page

  • @aleksant3r1
    @aleksant3r1 Місяць тому

    Hi there! Thanks for the video. Small question: if a table has multiple foreign keys, the Power BI automatically sets the relationships and the first field with a foreign key is set as the active relationship and others will naturally be set with non active relationships. Is it possible to configure on Databricks end which foreign key field should be with the active relationship? Or is this something that the developer has to always edit in the Power BI side.

    • @dataleaps
      @dataleaps Місяць тому

      It's not configurable on Databricks' end

  • @christopherchalcraft1134
    @christopherchalcraft1134 Місяць тому

    can you share the repo used for deployment? I did not catch what the requirements were for deploying on databricks

    • @dataleaps
      @dataleaps Місяць тому

      Here is the repo github.com/db-dan/databricks-dino-game

  • @Pankjtraining
    @Pankjtraining Місяць тому

    Thank You ! You are a gold mine and now my 'go-to' for Databricks - PowerBI stuff !

  • @Pankjtraining
    @Pankjtraining Місяць тому

    Great explanation of a very key capability ! Thank you 🙏

  • @suryapratapsingh9713
    @suryapratapsingh9713 2 місяці тому

    Nice Video, It would be really nice that If we get a path to get selected in databricks

    • @dataleaps
      @dataleaps 2 місяці тому

      Yeah, I will do a interview process video soon

    • @suryapratapsingh9713
      @suryapratapsingh9713 2 місяці тому

      @dataleaps appreciate, thanks

    • @dataleaps
      @dataleaps 10 днів тому

      @suryapratapsingh9713 ua-cam.com/video/Tfpdwf45eK8/v-deo.html

    • @suryapratapsingh9713
      @suryapratapsingh9713 10 днів тому

      @@dataleaps thanks a lot, happy that you remembered 😊

  • @joysin9574
    @joysin9574 2 місяці тому

    Awesome! Have 1 question. Running time increases a lot using AI query in Genie ?

    • @dataleaps
      @dataleaps 2 місяці тому

      Processing time will increase, yes, whether it increases a lot will be dependent on which ai function you use and how much data you have

  • @sheikhfpk7129
    @sheikhfpk7129 2 місяці тому

    Awesome demo is there a github link to code

    • @dataleaps
      @dataleaps 2 місяці тому

      github.com/lipinght/PBI-on-DB-Cookbook/blob/main/RT_with_DB_and_PBI_DAIS23/README.md

  • @dataleaps
    @dataleaps 3 місяці тому

    Puneet Jain and Nikhil Chandna's medium blog on this subject nikhil-chandna71.medium.com/turbocharge-your-genie-experience-with-databricks-ai-functions-unlock-ai-for-business-users-9b04965ef128

  • @praveensahni5547
    @praveensahni5547 3 місяці тому

    Where did you find published dataset link that pasted in tabular editor ?

  • @vroumvroumxiv
    @vroumvroumxiv 3 місяці тому

    Thanks for the video! I'm pretty new on Power BI admin and I try to find the best way to handle Dataflow migration with the deployment pipeline. But it seems that it does not migrate passwords, so I have to use a workaround... By any chance, do you know a course or any other resources that could help to understand the entire picture, please? I used Chatgpt to generate PowerShell scripts and thought about using task scheduler

  • @abinjacob1
    @abinjacob1 3 місяці тому

    Thank you for the content! Informative and engaging.

  • @Sanj803
    @Sanj803 4 місяці тому

    I am using Power BI report in import mode, data coming in from azure databricks. Is there anyway Unity Catalog security can be applied on Power BI report? Please note I am using Import mode in Power BI.

  • @PrincessAda-u1c
    @PrincessAda-u1c 4 місяці тому

    Thanks so much for sharing ❤ I have subscribed

  • @mohdazhar4534
    @mohdazhar4534 5 місяців тому

    Hey is it possible to create dshboards the way you have done if i am using community edition of databricks ?? I dont see options of SQL , Dataengineering in the side bar . So i was thinking for community edition users to create visualizations can be done only through notebooks . Sorry if the question seems dumb i am a newbie . Thanks!!

    • @dataleaps
      @dataleaps 5 місяців тому

      Unfortunately community edition has limited features Vs the full databricks experience , you can try the free trial for databricks for features not offered in community edition

  • @Sanj803
    @Sanj803 5 місяців тому

    This is really helpful. One quick question, if we use import while publishing to Power BI. Is it possible to manage access control from the unity catalog?

    • @dataleaps
      @dataleaps 5 місяців тому

      Import mode is using a service account, so UC can only control what that account has access to, not the end users in power bi, I explained it in a separate video ua-cam.com/video/1n2M4NfH5XA/v-deo.htmlsi=9KrPxUU4Gixo_k_9

  • @Siyakutti_
    @Siyakutti_ 5 місяців тому

    what if the UC is not set up?

    • @dataleaps
      @dataleaps 5 місяців тому

      Then you use the access control set up in your databricks workspace, non UC world has no fine grain access control though

  • @NoahPitts713
    @NoahPitts713 5 місяців тому

    Thanks for sharing!

  • @DGermishuizen
    @DGermishuizen 5 місяців тому

    Great interview ! Holly I like how candid you were, it really helps bring us into the life of a RSA :)

  • @ArijitBiswasMakeup
    @ArijitBiswasMakeup 6 місяців тому

    Great

  • @Mhs.51
    @Mhs.51 6 місяців тому

    no no

  • @getsetgoo3334
    @getsetgoo3334 6 місяців тому

    Thanks for sharing, you are sharing useful info on your channel Keep up the good work 👍👍

  • @yarbrother
    @yarbrother 8 місяців тому

    Great video! Nice call out on the Mac use case. Is there a way to refresh the semantic model (schema and/or metadata changes) once it’s been published?

    • @dataleaps
      @dataleaps 8 місяців тому

      Yes, you refresh it the same way you would when you publish from desktop

  • @clnguye
    @clnguye 8 місяців тому

    Learn something new! Thanks for sharing. Excellent content!

  • @haroldfranciscobartelssanc4299
    @haroldfranciscobartelssanc4299 9 місяців тому

    Did not know this existed! thanks! A lot of Mac Users will love this

    • @dataleaps
      @dataleaps 9 місяців тому

      Feature is brand new :)

  • @joe_plumb
    @joe_plumb 9 місяців тому

    Magic!

  • @stephaniedatabricksrivera
    @stephaniedatabricksrivera 9 місяців тому

    This is great!

  • @wangkaitj1
    @wangkaitj1 9 місяців тому

    basically, I can connect to databrick, but I am not able to see system table. however, i can use yout template to see system table and the dashboard

    • @dataleaps
      @dataleaps 9 місяців тому

      You need access to 3 things: 1. access to system tables. ie. being able to do SELECT * FROM system.billing.usage ( you might need admin to grant you access to the billing schema) 2. access to use the databricks workspace, which you already have, when you say you can connect to Databricks 3. access to a sql warehouse, again, ask admin to give you access, and use the connection string for power bi template

  • @wangkaitj1
    @wangkaitj1 9 місяців тому

    Hello Liping, Thanks so much for your videos, that works for me. but I am not able to setup data connection for system table from PowerBI-》 get the data source, can you give me some idea?

  • @jakai1775
    @jakai1775 9 місяців тому

    Is there actually a difference between using Azure Databricks Connector within Power Bi as opposed to partner connect? I really can’t see any difference which suggests to use one as opposed to the other?

    • @dataleaps
      @dataleaps 9 місяців тому

      If your databricks is on azure, there is no difference apart from partner connection pre-populate the connection string for you. If your databricks is on AWS and if you using some other oauth and not AAD, partner connect defaults to Azure Databricks connector and AAD as Oauth, so you are better off connecting manually in Power BI

    • @jakai1775
      @jakai1775 9 місяців тому

      @@dataleaps yeah mine is Azure. So it’s basically down to preference? Also, do you know if query folding will ever be supported as standard? When connecting to Azure Databricks?

  • @venkataraju4644
    @venkataraju4644 10 місяців тому

    Hi, is there a away to bring source table name???

  • @vivekupadhyay3978
    @vivekupadhyay3978 10 місяців тому

    Hello, iam not getting that custom actions option in tabular editor for single partiton refresh. Please help!

  • @hamooda.7994
    @hamooda.7994 10 місяців тому

    Nicely explained. Thanks for sharing!

  • @Amir_mo
    @Amir_mo 11 місяців тому

    Great video! Thank you! I have a large table that is not being refreshed because of premium memory capacity limit. Can I create multiple partitions based on date, and refresh all partitions separately to avoid power BI memory limit issue?

    • @dataleaps
      @dataleaps 11 місяців тому

      you could do incremental refreshes learn.microsoft.com/en-us/power-bi/connect-data/incremental-refresh-overview

    • @Amir_mo
      @Amir_mo 11 місяців тому

      Thanks. But I can’t, because after implementing incremental refresh, the first refresh in power BI service is a full refresh which I get memory capacity error.

    • @dataleaps
      @dataleaps 11 місяців тому

      @@Amir_mo what's your model size and what power bi capacity are you on?

  • @dataleaps
    @dataleaps 11 місяців тому

    If you are using AAD with databricks on AWS, you can use the Azure Databricks connector in Power BI as long as you have SSO enabled

  • @grayson5933
    @grayson5933 Рік тому

    *Promosm*

  • @followrajah7743
    @followrajah7743 Рік тому

    Thank you so much for this. I'm new to Data Analytics and this video has helped me a lot with a project I'm working on

  • @claudio5870
    @claudio5870 Рік тому

    Al momento de intentar realizar el análisis de sentimiento me arroja el siguiente error. Agradecería tu ayuda: Expression.Error: No se puede convertir el valor "[Function]" al tipo Function. Detalles: Value=[Function] Type=[Type]

    • @claudio5870
      @claudio5870 Рік тому

      El error me aparace al conectar una Hoja de Cálculo de Google. No así cuando uso un Excel, ahí no tengo problemas

  • @Stateoftheheart
    @Stateoftheheart Рік тому

    Just what I was looking for! Really helpful! Thanks a mil :)

  • @dataleaps
    @dataleaps Рік тому

    The sound of this video was recorded on the right channel. If you cannot hear anything, change your computer sound audio balance and increase the right balance, you will be able to hear better

  • @ShubhamYadav-xr9jq
    @ShubhamYadav-xr9jq Рік тому

    Voice is very low, no use of video information, its very difficult to hear and understand

    • @dataleaps
      @dataleaps Рік тому

      The sound of this video was recorded on the right channel. If you cannot hear anything, change your computer sound audio balance and increase the right balance, you will be able to hear better

  • @rajsatia
    @rajsatia Рік тому

    You forgot to add your voice.

  • @aaquibislam1524
    @aaquibislam1524 Рік тому

    Great!

  • @GudhawalaLadka
    @GudhawalaLadka Рік тому

    Not able to hear anything

    • @dataleaps
      @dataleaps Рік тому

      The sound of this video was recorded on the right channel. If you cannot hear anything, change your computer sound audio balance and increase the right balance, you will be able to hear better

  • @lasseLundqvist
    @lasseLundqvist Рік тому

    Does the powershell script also work if you have MFA on your account? or is a ServiceAccount some specific account type that you need to create in Azure AD?

    • @dataleaps
      @dataleaps Рік тому

      Service Principal is not an normal AAD account, you set it up by setting up app reg in AAD, take a look at this github.com/lipinght/PBICookbook/blob/main/ServicePrincipal/ServicePrincipal.md

  • @HiYurd
    @HiYurd Рік тому

    Very good video. TY