Just started implementing this a couple of week ago with the added step of refreshing a datfaflow and when that is done, refreshing the dataset. Works great!
thank you. What happens if your files on the folder have a lot of rows? I mean like more than 2Million combined... Does it refresh only the new file or does it refresh the new and the other 2million rows? I wonder if there is a way to refresh that new file without taking +2hours... help!
You could maybe try this incremental refresh approach. (see warning in the notes) ua-cam.com/video/6Uy59RsqgrM/v-deo.html With many million row files it’s really a point where you need to invest in a sql database.
Can you show an example of what your excel file looks like? I am able to get the power automate flow to work when a document is added, however, it is not adding the new data even though the table structure in the excel workbook is the same. Maybe it could be how I am bringing in the data in the query in the Transform Data editor on PBI desktop? Thank you in advance for your assistance!
@@AccessAnalytic I figured it out! I had Month and Year columns on the table. I converted to the date format and the new data automatically added to the table! Thanks again for your video and feedback! Extremely helpful!
Hello what do i do it the option „data source credentials“ are grey and not clickable? I crated the dataset with power bi desktop but only use onedrive documents of the same company account.
You need to share the Flow with at least one other colleague so they have easy access to take over. Same goes for access to the SharePoint folder and Power BI workspace
I'm facing a similar issue, so let me try to rephrase the question. Let's say I applied some transformation steps to the first file while creating the dashboard. If a new file is added to the SharePoint list, will those same transformation steps be applied to the new file as well? The dashboard is based on the transformed structure, so the new file coming in through Power Automate needs to have those same Power Query steps applied to ensure the structure remains consistent.
I recently started to use power automate , don’t know why I didn’t learn about it before I use it for dataflow refresh then when my dataflow is refreshed it goes on to refresh my dataset
Do we need this? If the user refresh the power bi report and that power bi is connected to SharePoint files, that should refresh the data right? Why do we need a trigger from power automate?
Users can't refresh Power BI reports, only the report owners can refresh or schedule refresh. This is to force the refresh when a user adds a new file to the folder. So the report will update for them within a few minutes
data source credentials not active in power bi, why is that. I have the folder in SharePoint and wok great in Bi Desktop but in power BI service data source credentials not active so I can't chose or do anything.
Can I do this for the same if the file is locally in a shared drive? I assume I need to configure the gateway for this. if that's the case is this free that comes under the normal M365 license?
I don’t think there’s a trigger to detect that happening, even if there was you’d then need the gateway software installed to allow power bi to refresh. Can you sync your folder with SharePoint / OneDrive?
Ok, got it but can we see the list of files in the Power BI slicer/filter that we added in to the folder? & by just searching we can see the particular report?
Hi, this was very useful, I have a specific requirement if the new file is added how can powerBI display the dashboard for that particular file, without merging the data. That is, when you did it merged Jan and Feb but what if I want to just see the Feb data, and if I upload the March file, it should only display march data not combined. Thanks for the video!
Sometimes you have to go to clear out existing credentials via the Transform Data drop down - data source settings - and clear permissions on any SharePoint connections. Then try again making sure you only use the root folder. And make sure you can actually access all levels of the folder structure.
@@AccessAnalytic What if that Excel file I have read access to belongs to another owner in the same organization? Do I need edit access? Do I have to be co-owner of that file? Thanks.
@@AccessAnalytic I have read access only (no edit access) Or should I manually download a copy each time to my OneDrive and Power Automate with this copy. Thanks
It’s independent of Power BI. Its included in Microsoft 365 but there are premium connections like SQL . learn.microsoft.com/en-us/power-platform/admin/power-automate-licensing/types
Question about Power BI (PBI) app integration in MS Teams. Haven't tried it yet. My team at work uses Teams to collaborate (Messages, Excel files. screenshots, etc..) Hope you can share some ideas on how to push PBI reports on Teams? I have PBI Pro. Good stuff from you as always. Thanks.
This video is a little out of date and some screens have changed but my technique these days is Create App, during which process you should tick “install app automatically” and put the Team name in the new “Audience” section. ua-cam.com/video/fIuikN-IKUU/v-deo.html
Thanks for the great video, Wynn. I'm pretty new with the Power Automate and have a case to solve, probably very simple for most of you :) So, in my case, I need to refresh the pbi when 2 different files are added into different folders on different times. Can anyone help me? Thanks :)
@@AccessAnalytic Thank you so much for the quick response! When I get more into it, I understand it better :) In my case, everyday two new excel files are added into SharePoint. File1 into SubfolderA and File2 into SubfolderB. When both files are added, the pbi refresh should be run. The adding time of these files is changing. I mean, sometimes the File1 is added first and sometimes the File2. Thanks again for any help/support!
Just started implementing this a couple of week ago with the added step of refreshing a datfaflow and when that is done, refreshing the dataset. Works great!
Nice one, yeah the dataflow refresh is a nice feature too
I use this! I get spreadsheets sent to me as attachments, use Power Automate to save the attachment to SPOL, and refresh PBI. Saves lots of time 🙂
Fantastic. Good to know
This has just solved an issue I've been looking at for a week. Awesome, thank you.
Glad it helped!
Epic as always! Thanks for making this easier Wynn 😎
Thank you Neil !
A very helpful content. way to go, Sir! Thank you for making this video.
I appreciate you taking the time to let me know you found it useful
Bloody brilliant! But my "Data source credentials" is greyed out... How to solve this?!
Where’s you data source saved. If on your network you’ll need to set up a Power BI gateway.
Thanks for the tip! Downloaded the suggested gateway and it worked just fine :) Thanks! @@AccessAnalytic
thank you. What happens if your files on the folder have a lot of rows? I mean like more than 2Million combined... Does it refresh only the new file or does it refresh the new and the other 2million rows? I wonder if there is a way to refresh that new file without taking +2hours... help!
You could maybe try this incremental refresh approach. (see warning in the notes)
ua-cam.com/video/6Uy59RsqgrM/v-deo.html
With many million row files it’s really a point where you need to invest in a sql database.
GREAT STUFF! What a game changer for me.
Glad it was helpful, thanks for taking time to let me know
Can you show an example of what your excel file looks like? I am able to get the power automate flow to work when a document is added, however, it is not adding the new data even though the table structure in the excel workbook is the same. Maybe it could be how I am bringing in the data in the query in the Transform Data editor on PBI desktop? Thank you in advance for your assistance!
Are you connecting to the online version of the Excel folder using from SharePoint folder?
@@AccessAnalytic thank you so much for your response!
@@AccessAnalytic I figured it out! I had Month and Year columns on the table. I converted to the date format and the new data automatically added to the table! Thanks again for your video and feedback! Extremely helpful!
You’re welcome.
Hello what do i do it the option „data source credentials“ are grey and not clickable?
I crated the dataset with power bi desktop but only use onedrive documents of the same company account.
When you connected to the OneDrive files did you use from Web connector? Or are you connecting the synced files on your computer?
Nice, but it si myFlow, whe I leave Firm, my account will be shutdown, and all Flows also. How can set Flow per Department? Then it will work always.
You need to share the Flow with at least one other colleague so they have easy access to take over. Same goes for access to the SharePoint folder and Power BI workspace
Will this work if the previous files have been edited in power query? As in will the added file include the edits from power query?
A Power BI refresh pulls in all the files from the folder again. I’m not sure I understand your question sorry.
I'm facing a similar issue, so let me try to rephrase the question. Let's say I applied some transformation steps to the first file while creating the dashboard. If a new file is added to the SharePoint list, will those same transformation steps be applied to the new file as well? The dashboard is based on the transformed structure, so the new file coming in through Power Automate needs to have those same Power Query steps applied to ensure the structure remains consistent.
@maazahmad6897 - yes the power query transformation steps run each time you refresh.
@maazahmad6897 - checkout this explainer ua-cam.com/video/nPlrQUbEn4o/v-deo.htmlsi=bUbye_v6gqbd7rDY
Thank you 🙏 !! I would like to do the same with 2 folders with different files - do you know how to do it?
Not sure, do you mean only refresh once a file has been added to both folders?
@@AccessAnalytic I would like to refresh power bi with 2 different files - in you presentation it just one file
It should be a case of just repeating the process for the 2nd file
@@AccessAnalytic , no unfortunately, the second file does not update the PowerBI if the first file has not been updated : you could test.
Power Automate just refreshes the Power BI dataset, so if it’s connected to both fines it will pull in new data from both files
Hi, I made a similar "script" but mine sends a message out via Teams to a specific group aka "subscribers" to notify them about fresh data.
Great work!
I recently started to use power automate , don’t know why I didn’t learn about it before
I use it for dataflow refresh then when my dataflow is refreshed it goes on to refresh my dataset
Yeah that’s a great use case that I use too
Do we need this? If the user refresh the power bi report and that power bi is connected to SharePoint files, that should refresh the data right? Why do we need a trigger from power automate?
Users can't refresh Power BI reports, only the report owners can refresh or schedule refresh. This is to force the refresh when a user adds a new file to the folder. So the report will update for them within a few minutes
@@AccessAnalytic understood thank you
No worries
data source credentials not active in power bi, why is that. I have the folder in SharePoint and wok great in Bi Desktop but in power BI service data source credentials not active so I can't chose or do anything.
There's normally a prompt somewhere to enter your credentials to give Power BI service access to your SharePoint folder
How do we do this if the PowerBI file has Mutiple excel files as data sources connected to the same file?
Same process, it’s the dataset that refreshes pulling from all data sources
I’ve a use for this Wyn 👌
Excellent Martin 👍🏼
Can I do this for the same if the file is locally in a shared drive? I assume I need to configure the gateway for this. if that's the case is this free that comes under the normal M365 license?
I don’t think there’s a trigger for local drives.
Can this be used with Power Query to a folder on your computer ( Not SharePoint)? Thank you!
I don’t think there’s a trigger to detect that happening, even if there was you’d then need the gateway software installed to allow power bi to refresh. Can you sync your folder with SharePoint / OneDrive?
Can we again see January report back? For example in March if want to see Feb & Jan reports, is there any way?
Normally you load multiple months and years of data into Power BI, so in this scenario you just add multiple files of months into the folder.
Ok, got it but can we see the list of files in the Power BI slicer/filter that we added in to the folder? & by just searching we can see the particular report?
We can add a slicer to the page for the file names. Then selecting a particular file name will filter the data on the page for that file.
Hi, this was very useful, I have a specific requirement if the new file is added how can powerBI display the dashboard for that particular file, without merging the data. That is, when you did it merged Jan and Feb but what if I want to just see the Feb data, and if I upload the March file, it should only display march data not combined. Thanks for the video!
You can apply a filter to just bring in the latest month
Will definitely use this… but still struggling with connecting to a folder with credentials errors!
Sometimes you have to go to clear out existing credentials via the Transform Data drop down - data source settings - and clear permissions on any SharePoint connections. Then try again making sure you only use the root folder.
And make sure you can actually access all levels of the folder structure.
Beautiful , can this work for excel files i.e. changes to an excel file ?
There is a trigger “when a SharePoint file is updated”. That includes Excel files.
@@AccessAnalytic What if that Excel file I have read access to belongs to another owner in the same organization? Do I need edit access? Do I have to be co-owner of that file? Thanks.
@@txreal2 , I'm not sure if you can set up the Power Automate if you don't have read access to the folder, but it may be possible.
@@AccessAnalytic I have read access only (no edit access) Or should I manually download a copy each time to my OneDrive and Power Automate with this copy. Thanks
@@txreal2 Read access should work I think
Great as usual! Can you make one with refreshing dataflows/datasets based on condition (after dataflow > dataset). Thanks.
Thanks 😀. Exactly the same process, just extra steps in middle where you choose refresh Dataflow then choose When dataflow finishes trigger
amazing thanks for sharing!! 💯
You’re welcome
Would this work ok with large data sets with 1 million + rows?
Yep, but the refresh will be slow.
Does the Power Automate cost anything extra or is it included in Power BI Pro license?
It’s independent of Power BI. Its included in Microsoft 365 but there are premium connections like SQL . learn.microsoft.com/en-us/power-platform/admin/power-automate-licensing/types
Thanks a lot!
You’re welcome
Question about Power BI (PBI) app integration in MS Teams. Haven't tried it yet.
My team at work uses Teams to collaborate (Messages, Excel files. screenshots, etc..)
Hope you can share some ideas on how to push PBI reports on Teams? I have PBI Pro.
Good stuff from you as always. Thanks.
This video is a little out of date and some screens have changed but my technique these days is Create App, during which process you should tick “install app automatically” and put the Team name in the new “Audience” section. ua-cam.com/video/fIuikN-IKUU/v-deo.html
Like this clckless solution.
Thanks
👍
🙂
This didn't help me and idk why
I’d suggest posting the issue to community.powerbi.com/t5/Desktop/bd-p/power-bi-designer
Or
www.reddit.com/r/PowerBI/
Thanks for the great video, Wynn.
I'm pretty new with the Power Automate and have a case to solve, probably very simple for most of you :)
So, in my case, I need to refresh the pbi when 2 different files are added into different folders on different times.
Can anyone help me? Thanks :)
That’s one I’d post to www.reddit.com/r/PowerBI/ or a power automate forum. Not sure what your logic would be to check
@@AccessAnalytic Thank you so much for the quick response! When I get more into it, I understand it better :)
In my case, everyday two new excel files are added into SharePoint. File1 into SubfolderA and File2 into SubfolderB. When both files are added, the pbi refresh should be run. The adding time of these files is changing. I mean, sometimes the File1 is added first and sometimes the File2.
Thanks again for any help/support!
I can’t think of a way to do that sorry
@@AccessAnalytic thank you so much, Wyn, for your quick support! Greetings from Munich!