Data flows are great but t you need premium to use things such as calculated columns êtc. The other issue is refresh issues can be problematic with data flows. I set up once and it worked for 2 weeks before it decided to stop and would not refresh. I then used a dataset instead
do you show the end-to-end pipeline in any of your videos? I want to see best practices for what you describe. from dataflows that you describe here to datamart, to dataset, to report, to dashboard/metric/or app
Hi @rafalg8575, we’re glad that you appreciated our content! We agree, it's puzzling how major companies often struggle with data organization, especially when effective organization is crucial to breaking down silos and fostering collaboration. Finding better solutions could lead to significant improvements in their overall efficiency and communication.
Hii . I want to show lineage to show relation from report to view to table to etl along with individual nodes additional information when clicked on using power bi , can u plz help with that
Hi K KAVYA, Thank You for posting your query onto our channel. We really appreciate you taking your valuable time to post it. In Power BI Desktop, go to the Model view and click on "Manage Relationships" and in Power BI Service, click on 3 dots available against the name of the dataset and then click onto the option of "View Lineage" and you'll be able to see the nodes. For furthermore queries, you can also reach out to us onto our Community Forum by providing a proper description of the query along with the reference mock-up files to work on, where our members as well as experts team will be able to assist you in a better and efficient manner. Below is the link of the forum provided for the reference as well. Hoping you find this useful! If you haven't yet, you can subscribe to our UA-cam channel so that you won't miss out on any Power BI & Power Platform updates. You can also join our LinkedIn group to receive latest updates on Power BI. Cheers, Enterprise DNA forum.enterprisedna.co/ ua-cam.com/channels/y2rBgj4M1tzK-urTZ28zcA.html www.linkedin.com/groups/12004506/
Every time I am publishing a report connected to a data flow.. It is again creating a dataset along with data flow... When it creates a dataset again and again.. What is the advantage of having a data flow in terms of saving the memory in premium capacity.. Help me with inputs and correct me if I am missing anything here... Thank you
Hello krishnakishore peddisetti, Thank you for posting your query onto our channel. We really appreciate you taking your valuable time to post it. The dataflow is a transformational or data cleaning process carried out in an Power Query Editor Online. Dataflow is not equivalent to a dataset. Here's the difference between the two - Dataflow - Dataflow is the data transformation component of Power BI, which is independent of any other Power BI artifacts. It is a power query process that runs in the cloud and stores the data in Azure Data Lake storage or Dataverse. Dataflow is run by Power Query engine and Power Query Editor Online. If you are consistently re-using same tables in multiple files, dataflow is highly recommended in such scenarios that means dataflow will provide you a re-usable ETL (Extract-Transform-Load) component. Dataset - Power BI datasets are considered as a source of data what we used for reporting and visualization. Datasets are the object that contains the connection to the data source, data tables, the relationship between tables, DAX calculations and the data itself. Power BI Dataset also enable us to establish connection to published report, and create your own report based on published dataset. All tables and columns can be viewed in data tab of Power BI Desktop and the entire dataset is displayed in Power BI Service under ‘My Workspace’. So, anything somehow related to the data is a part of the dataset. We're providing couple of links below on Microsoft documentation pertaining to these topics for your reference purposes. Please go through those links for your better understanding between the two concepts. For furthermore queries, you can also reach out to us onto our Community Forum by providing a proper description of the query along with the reference mock-up files to work on, where our members as well as experts team will be able to assist you in a better and efficient manner. Below is the link of the forum provided for the reference as well. Hoping you find this useful! If you haven't yet, you can subscribe to our UA-cam channel so that you won't miss out on any Power BI & Power Platform updates. You can also join our LinkedIn group to receive latest updates on Power BI. Cheers, Enterprise DNA forum.enterprisedna.co/ ua-cam.com/channels/y2rBgj4M1tzK-urTZ28zcA.html www.linkedin.com/groups/12004506/ learn.microsoft.com/en-us/power-bi/transform-model/dataflows/dataflows-introduction-self-service learn.microsoft.com/en-us/power-bi/fundamentals/service-basic-concepts learn.microsoft.com/en-us/power-bi/connect-data/service-datasets-understand
For me the most problematic aspect is that it is useless without premium. I paste some queries and they are blocked. I thought that maybe if use one premium workspace and then use this data in pro workspace I could the report with other pro users but I guess they need premium as well(i am not sure). So it seems useless- 10 premium accounts in order to use dataflow for 1 experienced user. 9 premium accounts for people who only read report. It makes no sense
Hey Sam … great video 2 Questions 1. Is this feature available only for premium users? 2. Is incremental refresh available if I using facts table in dataflow ( since same facts table are used in multiple reports)
Hello Avil Pinto, Thank you for posting your query onto our channel. We really appreciate you taking your valuable time to post it. Below are the answers provided to both of your queries - 1). Dataflows can be used by Power BI Pro, Premium and Premium Per User license holders. But there're certain features which are available only to the Premium users. Below is the link of the Microsoft documentation provided for the reference. 2). Users with Premium license can only set-up Incremental Refresh inside Dataflows. For furthermore queries, you can also reach out to us onto our Community Forum where our members as well as experts team will be able to assist you in a better and efficient manner. Below is the link of the forum provided for the reference as well. Hoping you find this useful! You can subscribe to our UA-cam channel so that you won't miss out on any Power BI updates. You can also join our LinkedIn group to receive latest updates on Power BI. Cheers, Enterprise DNA forum.enterprisedna.co/ ua-cam.com/channels/y2rBgj4M1tzK-urTZ28zcA.html www.linkedin.com/groups/12004506/ learn.microsoft.com/en-us/power-bi/transform-model/dataflows/dataflows-create learn.microsoft.com/en-us/power-bi/transform-model/dataflows/dataflows-premium-features?tabs=gen2
Hello @nishantkumar9570, We're providing a link of the video below pertaining to this topic. For further queries, you can also reach out to us at our Community Forum by providing a detailed description of your query along with relevant files for reference. Our members and team of Experts will be happy to help out! If you haven't yet, do subscribe to our UA-cam channel and LinkedIn group to keep posted on the latest data skills and tools updates. Hoping you find this useful! Cheers, Enterprise DNA ua-cam.com/video/mteeKPNGIdM/v-deo.html forum.enterprisedna.co/ www.youtube.com/@EnterpriseDNA www.linkedin.com/groups/12004506/
Exactly what I am thinking. Why not just have a data warehouse? Wouldn’t that give the organization more flexibility as you are not getting more deeply entangled in the Microsoft ecosystem.
I am pulling data from the SharePoint and there are multiple steps done on power query which makes the model heavier and it takes around 35 mins average for refresh the data on daily basis. Does moving it to dataflows makes the refresh faster since we are moving it to the dedicated capacity?
Hello Wassam Masood, Thank you for posting your query onto our channel. We really appreciate you taking your valuable time to post it. Moving it to the Dataflows does make refresh faster but then it also depends further upto what extent that dedicated capacity is. If it's under the Premium capacity then refresh will be much quicker in comparison to the Pro license. But then you'll still have to check the performance by using both the options in order to make informed decisions. For furthermore queries, you can also reach out to us onto our Community Forum where our members as well as experts team will be able to assist you in a better and efficient manner. Below is the link of the forum provided for the reference as well. Hoping you find this useful! You can subscribe to our UA-cam channel so that you won't miss out on any Power BI updates. You can also join our LinkedIn group to receive latest updates on Power BI. Cheers, Enterprise DNA forum.enterprisedna.co/ ua-cam.com/channels/y2rBgj4M1tzK-urTZ28zcA.html www.linkedin.com/groups/12004506/
what if the user puts the Excel file on sharepoint and Access the sharepoint folder for all your mapping files? i am not sure If dataflows really does much in that sense... why wouldn't the user go a step further and do it data marts?
I would still go a dataflow over a mapping file on a SharePoint if this would mean the whole department would use the same data. Datamarts are a step further, as it would imply a whole data model, but keep in mind this is premium only and computation power will be paid separately.
Hello VoiceofNEil, Thank you for posting your query onto our channel. We really appreciate you taking your valuable time to post it. We haven't explored that path yet and thank you for posting your suggestion into our comments section. We'll try and explore that option and will create a content in future. For furthermore queries, you can also reach out to us onto our Community Forum where our members as well as experts team will be able to assist you in a better and efficient manner. Below is the link of the forum provided for the reference as well. Hoping you find this useful! You can subscribe to our UA-cam channel so that you won't miss out on any Power BI updates. You can also join our LinkedIn group to receive latest updates on Power BI. Cheers, Enterprise DNA forum.enterprisedna.co/ ua-cam.com/channels/y2rBgj4M1tzK-urTZ28zcA.html www.linkedin.com/groups/12004506/
Hi Sachin, glad that you appreciated our content! If you haven't yet, you can subscribe to our channel to see all our upcoming Power BI and Power Platform video tutorials and announcements. Cheers!
Check out our FREE courses: bit.ly/3N00AJw
The dates table as a first dataflow is a great example. I just started looking at using dataflows and this logic makes really helps me.
Data flows are great but t you need premium to use things such as calculated columns êtc. The other issue is refresh issues can be problematic with data flows. I set up once and it worked for 2 weeks before it decided to stop and would not refresh.
I then used a dataset instead
do you show the end-to-end pipeline in any of your videos? I want to see best practices for what you describe. from dataflows that you describe here to datamart, to dataset, to report, to dashboard/metric/or app
Love it! I just do not understand why huge companies have so poor data organization which are ustally one of the reason for siloses.
Hi @rafalg8575, we’re glad that you appreciated our content! We agree, it's puzzling how major companies often struggle with data organization, especially when effective organization is crucial to breaking down silos and fostering collaboration. Finding better solutions could lead to significant improvements in their overall efficiency and communication.
Thanks,Do you have any video about common data model?
So dataflows are part of the power platform? Thanks
Hii . I want to show lineage to show relation from report to view to table to etl along with individual nodes additional information when clicked on using power bi , can u plz help with that
Hi K KAVYA,
Thank You for posting your query onto our channel. We really appreciate you taking your valuable time to post it.
In Power BI Desktop, go to the Model view and click on "Manage Relationships" and in Power BI Service, click on 3 dots available against the name of the dataset and then click onto the option of "View Lineage" and you'll be able to see the nodes.
For furthermore queries, you can also reach out to us onto our Community Forum by providing a proper description of the query along with the reference mock-up files to work on, where our members as well as experts team will be able to assist you in a better and efficient manner. Below is the link of the forum provided for the reference as well.
Hoping you find this useful! If you haven't yet, you can subscribe to our UA-cam channel so that you won't miss out on any Power BI & Power Platform updates. You can also join our LinkedIn group to receive latest updates on Power BI.
Cheers,
Enterprise DNA
forum.enterprisedna.co/
ua-cam.com/channels/y2rBgj4M1tzK-urTZ28zcA.html
www.linkedin.com/groups/12004506/
Every time I am publishing a report connected to a data flow.. It is again creating a dataset along with data flow... When it creates a dataset again and again.. What is the advantage of having a data flow in terms of saving the memory in premium capacity..
Help me with inputs and correct me if I am missing anything here...
Thank you
Hello krishnakishore peddisetti,
Thank you for posting your query onto our channel. We really appreciate you taking your valuable time to post it.
The dataflow is a transformational or data cleaning process carried out in an Power Query Editor Online. Dataflow is not equivalent to a dataset. Here's the difference between the two -
Dataflow - Dataflow is the data transformation component of Power BI, which is independent of any other Power BI artifacts. It is a power query process that runs in the cloud and stores the data in Azure Data Lake storage or Dataverse. Dataflow is run by Power Query engine and Power Query Editor Online. If you are consistently re-using same tables in multiple files, dataflow is highly recommended in such scenarios that means dataflow will provide you a re-usable ETL (Extract-Transform-Load) component.
Dataset - Power BI datasets are considered as a source of data what we used for reporting and visualization. Datasets are the object that contains the connection to the data source, data tables, the relationship between tables, DAX calculations and the data itself. Power BI Dataset also enable us to establish connection to published report, and create your own report based on published dataset. All tables and columns can be viewed in data tab of Power BI Desktop and the entire dataset is displayed in Power BI Service under ‘My Workspace’. So, anything somehow related to the data is a part of the dataset.
We're providing couple of links below on Microsoft documentation pertaining to these topics for your reference purposes. Please go through those links for your better understanding between the two concepts.
For furthermore queries, you can also reach out to us onto our Community Forum by providing a proper description of the query along with the reference mock-up files to work on, where our members as well as experts team will be able to assist you in a better and efficient manner. Below is the link of the forum provided for the reference as well.
Hoping you find this useful! If you haven't yet, you can subscribe to our UA-cam channel so that you won't miss out on any Power BI & Power Platform updates. You can also join our LinkedIn group to receive latest updates on Power BI.
Cheers,
Enterprise DNA
forum.enterprisedna.co/
ua-cam.com/channels/y2rBgj4M1tzK-urTZ28zcA.html
www.linkedin.com/groups/12004506/
learn.microsoft.com/en-us/power-bi/transform-model/dataflows/dataflows-introduction-self-service
learn.microsoft.com/en-us/power-bi/fundamentals/service-basic-concepts
learn.microsoft.com/en-us/power-bi/connect-data/service-datasets-understand
For me the most problematic aspect is that it is useless without premium. I paste some queries and they are blocked. I thought that maybe if use one premium workspace and then use this data in pro workspace I could the report with other pro users but I guess they need premium as well(i am not sure). So it seems useless- 10 premium accounts in order to use dataflow for 1 experienced user. 9 premium accounts for people who only read report. It makes no sense
Hey Sam … great video
2 Questions
1. Is this feature available only for premium users?
2. Is incremental refresh available if I using facts table in dataflow ( since same facts table are used in multiple reports)
Hello Avil Pinto,
Thank you for posting your query onto our channel. We really appreciate you taking your valuable time to post it.
Below are the answers provided to both of your queries -
1). Dataflows can be used by Power BI Pro, Premium and Premium Per User license holders. But there're certain features which are available only to the Premium users. Below is the link of the Microsoft documentation provided for the reference.
2). Users with Premium license can only set-up Incremental Refresh inside Dataflows.
For furthermore queries, you can also reach out to us onto our Community Forum where our members as well as experts team will be able to assist you in a better and efficient manner. Below is the link of the forum provided for the reference as well.
Hoping you find this useful! You can subscribe to our UA-cam channel so that you won't miss out on any Power BI updates. You can also join our LinkedIn group to receive latest updates on Power BI.
Cheers,
Enterprise DNA
forum.enterprisedna.co/
ua-cam.com/channels/y2rBgj4M1tzK-urTZ28zcA.html
www.linkedin.com/groups/12004506/
learn.microsoft.com/en-us/power-bi/transform-model/dataflows/dataflows-create
learn.microsoft.com/en-us/power-bi/transform-model/dataflows/dataflows-premium-features?tabs=gen2
How can we reuse the power query template (pqt) that we export from dataflow in another dataflow?
Hello @nishantkumar9570,
We're providing a link of the video below pertaining to this topic.
For further queries, you can also reach out to us at our Community Forum by providing a detailed description of your query along with relevant files for reference. Our members and team of Experts will be happy to help out!
If you haven't yet, do subscribe to our UA-cam channel and LinkedIn group to keep posted on the latest data skills and tools updates.
Hoping you find this useful!
Cheers,
Enterprise DNA
ua-cam.com/video/mteeKPNGIdM/v-deo.html
forum.enterprisedna.co/
www.youtube.com/@EnterpriseDNA
www.linkedin.com/groups/12004506/
@@EnterpriseDNA Thank You so much, That was really helpful.
In what scenarios would you might want to create a dataflow instead of having your Data Team add that to the Data Warehouse?
Exactly what I am thinking. Why not just have a data warehouse? Wouldn’t that give the organization more flexibility as you are not getting more deeply entangled in the Microsoft ecosystem.
What version of powerbi are you using? PREMIUM OR PRO?
I am pulling data from the SharePoint and there are multiple steps done on power query which makes the model heavier and it takes around 35 mins average for refresh the data on daily basis. Does moving it to dataflows makes the refresh faster since we are moving it to the dedicated capacity?
Hello Wassam Masood,
Thank you for posting your query onto our channel. We really appreciate you taking your valuable time to post it.
Moving it to the Dataflows does make refresh faster but then it also depends further upto what extent that dedicated capacity is. If it's under the Premium capacity then refresh will be much quicker in comparison to the Pro license. But then you'll still have to check the performance by using both the options in order to make informed decisions.
For furthermore queries, you can also reach out to us onto our Community Forum where our members as well as experts team will be able to assist you in a better and efficient manner. Below is the link of the forum provided for the reference as well.
Hoping you find this useful! You can subscribe to our UA-cam channel so that you won't miss out on any Power BI updates. You can also join our LinkedIn group to receive latest updates on Power BI.
Cheers,
Enterprise DNA
forum.enterprisedna.co/
ua-cam.com/channels/y2rBgj4M1tzK-urTZ28zcA.html
www.linkedin.com/groups/12004506/
Great video/tutorial like always. Thx
thanks much! it helps a lot!
what if the user puts the Excel file on sharepoint and Access the sharepoint folder for all your mapping files? i am not sure If dataflows really does much in that sense... why wouldn't the user go a step further and do it data marts?
I would still go a dataflow over a mapping file on a SharePoint if this would mean the whole department would use the same data.
Datamarts are a step further, as it would imply a whole data model, but keep in mind this is premium only and computation power will be paid separately.
Hello VoiceofNEil,
Thank you for posting your query onto our channel. We really appreciate you taking your valuable time to post it.
We haven't explored that path yet and thank you for posting your suggestion into our comments section. We'll try and explore that option and will create a content in future.
For furthermore queries, you can also reach out to us onto our Community Forum where our members as well as experts team will be able to assist you in a better and efficient manner. Below is the link of the forum provided for the reference as well.
Hoping you find this useful! You can subscribe to our UA-cam channel so that you won't miss out on any Power BI updates. You can also join our LinkedIn group to receive latest updates on Power BI.
Cheers,
Enterprise DNA
forum.enterprisedna.co/
ua-cam.com/channels/y2rBgj4M1tzK-urTZ28zcA.html
www.linkedin.com/groups/12004506/
Excellent work Sam!
Hi Sachin, glad that you appreciated our content! If you haven't yet, you can subscribe to our channel to see all our upcoming Power BI and Power Platform video tutorials and announcements. Cheers!
great video