I've been a fan of this feature and it has greatly improved my workflow. One thing I haven'y wraped my head around is if I use dataflows gen 2, within the power query editor on the bottom right I can set where the data is being stored but this isn't the case with Gen1 dataflows so I wonder, where is the gen1 dataflow storing the data in this case? Thanks for your informal videos @Radacad love your content, keep up the great work!
Yes, dataflows in Power BI Service can be used in conjunction with Row-Level Security (RLS). It's important to make the distinction here, RLS is configured at the dataset level in Power BI, not within the dataflows themselves. When you create a dataflow, it doesn't have any security rules; it simply prepares the data. The security rules you define for RLS will apply to the data pulled from the dataflow.
Excellent video Sir, thank you sir for you efforts. I've been following your videos since 2022. I just want to learn power query lessons from beginning from you to become PRO.. Pls Help me
Just a clarification, if you already refresh the dataflow, the dashboard that connects to it still needs to be refreshed, but will now be faster right?
Yes that's the case, in my experience dataflows run much quicker and smoother then local. You can schedule dataflow refreshes at the interval of choice up to 8 times per day per dataflow. Indeed, you will still need to refresh your report but depending on which tool you used to build your report, you can either schedule refreshes on the report itself or if you have access to an automation tool like power automate, you can have power automate perform the refresh by connecting the automation flow to an office script for example if your report is in Excel. Important to note that dataflow refresh cycles and your report refreshes are independent whereas the dataflow refresh prepares your data and performs ETL operations and stores the data into dataverse/datalake and the other pulls data from the dataflow upon refresh. Hope that clarifies things for you :) Good luck!
Great video, thank you. I have a question on Dataflows though. I am aware that connecting to an Excel File in Power Query does not allow for scheduled refresh in Power BI Service. If you connect to Excel files in a Dataflow, would this allow for scheduled refresh of those excel files?
Hmmm - I think this requires a PBI Premium license? I'm on PBI Pro and I don't have the same configuration in PBI Service as the video. I only have a Data Hub.
With Pro, you can use the dataflow. By getting Data Power Platform in the Power BI Desktop, you should be able to see the Dataflow. With Premium, you will have some additional features in Dataflow, but Premium is not mandatory for dataflow.
@@RADACAD thank you very much! What about new datamart feature? Does that brings additional cost to pro or ppu? Or it is still unknown since its preview feature.
Hi there, My company is already adopting a centralised operational Dataset ( star schema approach) allowing users across department to build a Power BI report on top of the dataset. Having said that , the operational dataset is not fully matured yet and the team is working on getting the data from different departments. One of the request received from business is to use a date dimension table from the operational dataset and bring it into their model rather than creating one. What would be a feasible solution - create a dataflow to bring date dimension table or ask them to connect to the ops dataset and use already existed date table, but then this will bring out unnecessary table into their table.
As you suggested in several of your videos, in order to try and understand the concept and idea, I have seen them over and over! I am so glad I did! Mi question, the only way I seem to be able to use dataflow with excel is with OneDrive. I do have a corporate account, is it safe?
awesome Thank you for sharing the knowledge I just got that problem like your example my data set is very very big ( .pbix file ~1.6 GB and increase every day)
Dear Reza, I am currently in Iran and am really passionate to be an expert in PowerBI. Unfortunately, I can not work with Dataflow because as you said it is typically on the cloud. May I have your solution in this matter? is there any solution to practice with? I would really appreciate you if you lend me a hand here.
Great Job,thank you from Europe 👍🏻
thanks for simplifying this!
Glad it was helpful!
Thanks for the video, learned a lot
Once the dataflow is created, can we go to azure and access the data from there?
Thanks
Great Thanks!
You're welcome!
do this have limitation of data size in dataflow? if yes then what is the size limitation based on license?
I've been a fan of this feature and it has greatly improved my workflow. One thing I haven'y wraped my head around is if I use dataflows gen 2, within the power query editor on the bottom right I can set where the data is being stored but this isn't the case with Gen1 dataflows so I wonder, where is the gen1 dataflow storing the data in this case? Thanks for your informal videos @Radacad love your content, keep up the great work!
Thanks
That is right, with Dataflow Gen1 it will be saved as CSV files in ADLS Gen2.
even if you create all the transformations in data flow, we need to still apply joins in power bi desktop is it?
Hi Reza, thanks for this content. I'm wondering how dataflows can be used with models that employ row-level security. Is this possible? Cheers.
Yes, dataflows in Power BI Service can be used in conjunction with Row-Level Security (RLS). It's important to make the distinction here, RLS is configured at the dataset level in Power BI, not within the dataflows themselves. When you create a dataflow, it doesn't have any security rules; it simply prepares the data. The security rules you define for RLS will apply to the data pulled from the dataflow.
Hi i have created the dataflow but while importing into the powerbi desktop im getting blank/empty table value do you know why?
After you create your dataflow, you need to refresh your dataflow before importing the data in other apps/services.
Excellent video Sir, thank you sir for you efforts. I've been following your videos since 2022. I just want to learn power query lessons from beginning from you to become PRO.. Pls Help me
Thanks for your nice words. All the best in your journey
Will using data flow reduce the size of pbix file ?
If we migrate the data source from direct sql to data flows
Is it possible to use Python in the dataflow to transform data? Thanks
Just a clarification, if you already refresh the dataflow, the dashboard that connects to it still needs to be refreshed, but will now be faster right?
Yes that's the case, in my experience dataflows run much quicker and smoother then local. You can schedule dataflow refreshes at the interval of choice up to 8 times per day per dataflow. Indeed, you will still need to refresh your report but depending on which tool you used to build your report, you can either schedule refreshes on the report itself or if you have access to an automation tool like power automate, you can have power automate perform the refresh by connecting the automation flow to an office script for example if your report is in Excel. Important to note that dataflow refresh cycles and your report refreshes are independent whereas the dataflow refresh prepares your data and performs ETL operations and stores the data into dataverse/datalake and the other pulls data from the dataflow upon refresh. Hope that clarifies things for you :) Good luck!
Great video, thank you. I have a question on Dataflows though. I am aware that connecting to an Excel File in Power Query does not allow for scheduled refresh in Power BI Service. If you connect to Excel files in a Dataflow, would this allow for scheduled refresh of those excel files?
Hmmm - I think this requires a PBI Premium license? I'm on PBI Pro and I don't have the same configuration in PBI Service as the video. I only have a Data Hub.
With Pro, you can use the dataflow. By getting Data Power Platform in the Power BI Desktop, you should be able to see the Dataflow. With Premium, you will have some additional features in Dataflow, but Premium is not mandatory for dataflow.
Very nice
Thanks
Does dataflows generate any additional cost to your pro or ppu licence?
No. with Pro license you can use some of the functionalities in the dataflow, and with Premium you can use all. but no additional cost.
@@RADACAD thank you very much!
What about new datamart feature? Does that brings additional cost to pro or ppu? Or it is still unknown since its preview feature.
Hi there,
My company is already adopting a centralised operational Dataset ( star schema approach) allowing users across department to build a Power BI report on top of the dataset.
Having said that , the operational dataset is not fully matured yet and the team is working on getting the data from different departments.
One of the request received from business is to use a date dimension table from the operational dataset and bring it into their model rather than creating one.
What would be a feasible solution - create a dataflow to bring date dimension table or ask them to connect to the ops dataset and use already existed date table, but then this will bring out unnecessary table into their table.
As you suggested in several of your videos, in order to try and understand the concept and idea, I have seen them over and over! I am so glad I did! Mi question, the only way I seem to be able to use dataflow with excel is with OneDrive. I do have a corporate account, is it safe?
You need to have a Power BI or Power Apps account to be able to create dataflows
awesome Thank you for sharing the knowledge
I just got that problem like your example
my data set is very very big ( .pbix file ~1.6 GB and increase every day)
Thanks :)
I suggest add incremental refresh to your implementation soon (if the data source supports query folding)
Dear Reza,
I am currently in Iran and am really passionate to be an expert in PowerBI. Unfortunately, I can not work with Dataflow because as you said it is typically on the cloud. May I have your solution in this matter? is there any solution to practice with?
I would really appreciate you if you lend me a hand here.
no se ve nada, no explicas mucho
❤Thanks a lot 🫂
😊👊
I cannot understand your accent