Thanks Reza. That part of adding the table to a destination (Lakehouse) was the tricky part. Also the "Connect to SQL Endpoint" explanation open new possibilities. PS.: I still have that shirt from RADCAD I won at Montreal/Canada 2018. RLS Question!!
This video is awesome. I spent tons of times in searching for the "right" and "clear" information about fabric and this is genuine. Thank you for a great work. One of my questions is, in the first video, you talked about "direct lake" mode. If we can use "direct lake" mode, then why do we still need Lakehouse? I know this a quite weird question. But I am still confused with the "future concept" of fabric. What is the difference between "OneLake" and "Lakehouse" ?
Glad you liked it OneLake is the storage engine for Fabric. Lakehouse, however is one of the objects that you can create in Fabric, the Lakehouse can keep data in structured or unstructured format, and it will save it in the OneLake. So no matter if you use Lakehouse or Warehouse, you still use Onelake, because that is the storage engine. Power BI then provide connection to it using Direct Lake, which is a direct connection to the OneLake. If you check our few of our other videos about Fabric some of these concepts would be explained more in there.
an end-to-end project might come in different paths; sometimes it might uses lakehouse, etl, and Power BI. Sometimes it might uses ETL, Data Warehouse, and then Power BI and Machine Learning. I'll come up with scenarios hopefully in some videos to cover some of those.
Great. Please explain what is the advantage to connect to a dataflow created in a lake house, and to a dataflow, because I understand that we have the two options when creating a lake house. I appreciate your help. Is not clear for my, because I can create A data flow in power bi service too. Thank you so much👍
for dataset modify, what if i enable option on workspace to modify dataset online ( which is new feature from april i believe) this would give option to modify "power bi item" dataset
Thank you Rada I Tried to connect lakehouse with my SQL Server in my local machin by adding the server name and database name and simpl select some filed but it give me error by the way the steps i did with power query it is working if there is any additional steps for lakehouse Thanks in advance
Thanks for the introduction, Could you please let us know what is going to change for a power BI developer, most of the editing experience would move to cloud?
I guess Power BI web editing experience at some point will be strong enough to do everything in the web. However, the Desktop would still exists I imagine as it is faster to do things there.
I don't think so, Data warehouse is still different than the Lakehouse, I might do another video about that subject later. But most of the Power BI Desktop functionality is coming to web now, Which would make Power BI editing experience anywhere, even from Mac devices
Thank you Rada I Tried to connect lakehouse with my SQL Server in my local machin by adding the server name and database name and simpl select some filed but it give me error by the way the steps i did with power query it is working if there is any additional steps for lakehouse Thanks in advance
Hi, you always post very very informative videos. One Que. I have an Excel365 file which has data from the odbc connection, which updates automatically in scheduled intervals, how can I sync that Excel data into Google Sheets with auto updates? Please Help.
Thank you Reza for the videos. Could you start a playlist to go over data lake and warehouse by details , and little bit slowly to follow Microsoft updates. I feel MS are going fast.
Thanks for sharing! Interesting the way you can also create a semantic model in the data lakehouse. Can we create multiple models in the same lakehouse? I'll look forward to your videos showing how that links to data marts.
OneLake is the storage. Lakehouse is a logical object, which stores both structured and unstructured files, but the storage that the Lakehouse uses is OneLake.
Thank you Reza, that is very helpful. When I tried Fabric I was confused by the different objects that were created in the Workspace. It does seem odd to me that you can write new DAX measures and structure your data in the SQL Endpoint rather than in the Power BI Dataset - is there a reason for that?
You're welcome You are still doing that in the Power BI Dataset, however, the entry point of that seems to be from SQL Endpoint link. I imagine we might have an entry point from the dataset itself in the future too.
I hope Microsoft Fabric isn't mandatory to use Power BI, Synapse or Azure Data Lake. Some customers can't or won't do that. For example, some customers use an ADLS2 storage account for DEV, another for QA/UAT and another for PROD. One of the promises of OneLake is there is only one account. Also, the data is auto-tagged. How does one override a bad/stupid tag? It will happen. I'm hoping I'm wrong on these, but I have concerns. Also, if the entry point for Power BI is through this channel only - we'll see adoption drop - not grow.
No Power BI will go as is. You don't need a Fabric license or pathway to use it. As you said, for some businesses, Power BI itself is enough. But if you have Fabric, you can do more
Please make a series of MS Fabric, especially for Power BI user 😊 And do you know any pricing table of MS Fabric?
That is on the plan :)
Thanks Reza. That part of adding the table to a destination (Lakehouse) was the tricky part.
Also the "Connect to SQL Endpoint" explanation open new possibilities.
PS.: I still have that shirt from RADCAD I won at Montreal/Canada 2018. RLS Question!!
Yes, SQL endpoint is great
Oh, yes, I remember that RLS session, great time 😃👊 good to see you here
This video is awesome. I spent tons of times in searching for the "right" and "clear" information about fabric and this is genuine. Thank you for a great work. One of my questions is, in the first video, you talked about "direct lake" mode. If we can use "direct lake" mode, then why do we still need Lakehouse? I know this a quite weird question. But I am still confused with the "future concept" of fabric. What is the difference between "OneLake" and "Lakehouse" ?
Glad you liked it
OneLake is the storage engine for Fabric. Lakehouse, however is one of the objects that you can create in Fabric, the Lakehouse can keep data in structured or unstructured format, and it will save it in the OneLake.
So no matter if you use Lakehouse or Warehouse, you still use Onelake, because that is the storage engine.
Power BI then provide connection to it using Direct Lake, which is a direct connection to the OneLake.
If you check our few of our other videos about Fabric some of these concepts would be explained more in there.
@RADACAD Thanks. It helps me to better understand fabric ! I will watch the others as well.
could you please make an end to end project video on fabric then we would be able to connect the dots and understand the whole process.
an end-to-end project might come in different paths; sometimes it might uses lakehouse, etl, and Power BI. Sometimes it might uses ETL, Data Warehouse, and then Power BI and Machine Learning.
I'll come up with scenarios hopefully in some videos to cover some of those.
Just wanted to say thank you Sir for your insightful videos
You are very welcome
Thank you!..i am learning from you!... regards from Ecuador
Cheers
Can we load multiple tables in the lakehouse in a single go
Great. Please explain what is the advantage to connect to a dataflow created in a lake house, and to a dataflow, because I understand that we have the two options when creating a lake house. I appreciate your help. Is not clear for my, because I can create A data flow in power bi service too. Thank you so much👍
for dataset modify, what if i enable option on workspace to modify dataset online ( which is new feature from april i believe) this would give option to modify "power bi item" dataset
Really informative. Can you please confirm if the LakeHouse can be used in place of Kusto? If we take about a very huge volume of data and queries?
Could you pls tell me will the SQLend point file be created or not for the semi-structured and unstructured data if we load into DataLake
SQL endpoint won't make sense for unstructured data, it only makes sense when you are querying a data table.
Thank you Rada
I Tried to connect lakehouse with my SQL Server in my local machin by adding the server name and database name and simpl select some filed but it give me error by the way the steps i did with power query it is working if there is any additional steps for lakehouse
Thanks in advance
Thanks for the introduction, Could you please let us know what is going to change for a power BI developer, most of the editing experience would move to cloud?
I guess Power BI web editing experience at some point will be strong enough to do everything in the web. However, the Desktop would still exists I imagine as it is faster to do things there.
Thank you Reza, for the great video. Where can I download AdventureWorksDW Excel file? Could you please share the link?
great video.
Thanks!
After published I didn't find dataset only SQL endpoint and lake house
plus no refresh icon
Did you load the data into the Lakehouse?
Thx! Interesting demo
Glad you liked it!
Thank you for the great introduction. So is Power BI Desktop, Datawarehouses will be replaced by this feature ?
I don't think so, Data warehouse is still different than the Lakehouse, I might do another video about that subject later.
But most of the Power BI Desktop functionality is coming to web now, Which would make Power BI editing experience anywhere, even from Mac devices
@@RADACAD that's amazing . I like the features .
Thank you Rada
I Tried to connect lakehouse with my SQL Server in my local machin by adding the server name and database name and simpl select some filed but it give me error by the way the steps i did with power query it is working if there is any additional steps for lakehouse
Thanks in advance
Hi, you always post very very informative videos. One Que. I have an Excel365 file which has data from the odbc connection, which updates automatically in scheduled intervals, how can I sync that Excel data into Google Sheets with auto updates? Please Help.
Very informative, & Gr8 Explanation! Besiar Ziba bood.
Thanks for liking
Awesome video, thank you.
Glad you liked it!
Thank you so much ❤
Thank you Reza for the videos. Could you start a playlist to go over data lake and warehouse by details , and little bit slowly to follow Microsoft updates. I feel MS are going fast.
Sure, we'll have a play list for Fabric. and there will be videos for comparing Lakehouse and Warehouse and Datamart etc.
Thanks for sharing! Interesting the way you can also create a semantic model in the data lakehouse. Can we create multiple models in the same lakehouse? I'll look forward to your videos showing how that links to data marts.
Thanks
Yes, you can build more datasets with importing data from Lakehouse.
I'll work on the datamart vs lakehouse video sometimes soon.
Hello Reza, Thank you so much. I cannot get the AdventureWorksDW_2019 excel file. Please help me 🙂
Sure. You can get it from here: radacad.com/files/AdventureWorksDW2012.xlsx
@@RADACAD Thanks a lot🙏🙏
Thank You
You're welcome
What is the difference between Lakehouse and One Lake?
OneLake is the storage. Lakehouse is a logical object, which stores both structured and unstructured files, but the storage that the Lakehouse uses is OneLake.
Thank you Reza, that is very helpful. When I tried Fabric I was confused by the different objects that were created in the Workspace. It does seem odd to me that you can write new DAX measures and structure your data in the SQL Endpoint rather than in the Power BI Dataset - is there a reason for that?
You're welcome
You are still doing that in the Power BI Dataset, however, the entry point of that seems to be from SQL Endpoint link. I imagine we might have an entry point from the dataset itself in the future too.
I hope Microsoft Fabric isn't mandatory to use Power BI, Synapse or Azure Data Lake. Some customers can't or won't do that. For example, some customers use an ADLS2 storage account for DEV, another for QA/UAT and another for PROD. One of the promises of OneLake is there is only one account. Also, the data is auto-tagged. How does one override a bad/stupid tag? It will happen. I'm hoping I'm wrong on these, but I have concerns.
Also, if the entry point for Power BI is through this channel only - we'll see adoption drop - not grow.
No
Power BI will go as is. You don't need a Fabric license or pathway to use it. As you said, for some businesses, Power BI itself is enough.
But if you have Fabric, you can do more