The best way to connect to a SharePoint Folder to speed up your Excel and Power BI data refresh

Поділитися
Вставка
  • Опубліковано 1 жов 2024
  • How to consolidate multiple files from a SharePoint folder using Power Query in Excel and Power BI.
    🔽 More Info below PLUS warning 🔽
    Warning: to use SharePoint.Contents the user must hace access to to all levels of the SharePoint site.
    Additional technique to speed up refresh using incremental refresh
    • Faster SharePoint fold...
    Sadly the button is not included in 365 for Business . However you can still use the code
    = SharePoint.Contents("YOURPATH/", [ApiVersion = 15])
    Video I mention explaining the consolidation helper queries
    • Combining Multiple Fil...
    The team and I at Access Analytic develop Power BI and Excel solutions for clients in Australia and deliver training around the World. accessanalytic...
    Did you know I've written a book "Power BI for the Excel Analyst"?
    pbi.guide/book/
    Connect with me
    wyn.bio.link/

КОМЕНТАРІ • 628

  • @Fonzyrr
    @Fonzyrr Рік тому +125

    This video is a genuine service to humanity

    • @AccessAnalytic
      @AccessAnalytic  Рік тому +2

      😂 - made me smile - thanks!

    • @robm1010
      @robm1010 Рік тому +1

      I agree 1000%. This video is gold and is something I never want to lose.

    • @AccessAnalytic
      @AccessAnalytic  Рік тому

      Thank you 😀

    • @Fonzyrr
      @Fonzyrr Рік тому

      @Access Analytic question, have you ever set up a "SharePoint" Server? Meaning you have a SharePoint dedicated to running queries that are aggregating from forms you created for your company on another SharePoint site. You can then query to this "SharePoint Server" site to get reports from?

    • @arisaleh1980
      @arisaleh1980 Рік тому +1

      I am just speechless. What an unbelivably timesaving workaround.

  • @jamieashton660
    @jamieashton660 7 місяців тому +16

    To be honest this video has just paid for my year's UA-cam subscription. Can you imagine what the world would be like if every video was this informative. I had practically given up on trying to get files out of Shitepoint until now.

    • @AccessAnalytic
      @AccessAnalytic  7 місяців тому

      Very kind, I appreciate you taking the time to let me know you found it useful

  • @juanramon8652
    @juanramon8652 4 місяці тому +8

    Even in 2024 this Video still makes me say : you are the Master !!!

  • @joaovaltergirardi9709
    @joaovaltergirardi9709 Рік тому +7

    You are the only person who came with a decent solution that really works. Thanks!

  • @Danny-Do-It
    @Danny-Do-It 14 годин тому +1

    This video is excellent - the way you explain things is perfectly digestible, helped me alot!

    • @AccessAnalytic
      @AccessAnalytic  Годину тому

      You’re welcome. Thanks for taking the time to leave a kind comment

  • @ChrisSmithFW
    @ChrisSmithFW Місяць тому +2

    Love the column size and contents hack! I've been scrolling all along. So glad I stopped down on this. Thanks so much.

    • @AccessAnalytic
      @AccessAnalytic  Місяць тому +1

      You’re welcome. I appreciate you taking the time to let me know you found it useful

  • @BhaskarGorthi
    @BhaskarGorthi 7 годин тому +1

    Thanks for the video. It's informative and usefull.

    • @AccessAnalytic
      @AccessAnalytic  Годину тому

      I appreciate you taking the time to let me know you found it useful

  • @ninadsonavane9271
    @ninadsonavane9271 Рік тому +1

    Hi,
    Is there any way to consolidate two excel sheets coming on a day per week and importing to powerbi so that after refresh there's the new date added on the dashboard?

    • @AccessAnalytic
      @AccessAnalytic  Рік тому

      Does this video help ua-cam.com/video/sLW3NbeGDy8/v-deo.html

  • @jimbeverley
    @jimbeverley 11 місяців тому +2

    What an awesome hack! I can't believe Microsoft hasn't already baked the SharePoint.Contents functionality into their PQ menus. Thank you!!!

    • @AccessAnalytic
      @AccessAnalytic  11 місяців тому

      You’re welcome. I appreciate you taking the time to let me know you found it useful

  • @EngineerHarris
    @EngineerHarris 6 місяців тому +1

    This is AMAZING! Thank you. This has been driving me absolutely insane!
    Question: If I have CSV files grouped by different folders - those folders act as categories or groups. I followed your steps and can easily get to what I want for a Single Folder (that contains CSV Files) but what about if also want to repeat the transform for all the other folders.
    Do I have to keep duplicating the steps you went through here to get all the queries in the same Excel File for all the folders of interest? Or is there a simpler/better way?
    The data (CSVs) in each folder will get their own Sheet in excel.
    Thanks!

    • @AccessAnalytic
      @AccessAnalytic  6 місяців тому

      If you’re wanting to consolidate files from sub-folders then try out Imke’s solution per this video ua-cam.com/video/mgVnk4R79ac/v-deo.htmlsi=uq_bCTMHiYoLD8Lf

  • @shanejansevanrensburg9461
    @shanejansevanrensburg9461 20 днів тому +1

    HI Wyn, Thanks for the various videos and for this one. I tried using the Contents option you show but then when I try creating the Query I get an error stating my file format is not correct. I tried it several times with the same error. I used a hybrid of the Contents version to navigate to the correct folder, filtered by its location and then went back and changed Contents back to file. I have looked high and low and cannot find the reason for the error despite all the files being xlsx - any ideas how to fix this? Thanks
    Shane

    • @AccessAnalytic
      @AccessAnalytic  20 днів тому +1

      Odd. I’d manually create a couple of files with a little bit of data and put them in a folder and try it.

  • @okmr7706
    @okmr7706 4 місяці тому +1

    Very good video, helped me on import data from Excel and csv files hosted on Sharepoint folder. Appreciate it very much.
    However, this video is misleading to me as the formats of my Excel and csv files are different so do need to be consolidated.
    So I suggest you change the title to add "consolidate" in it as quite some contents in this video is about "consolid" your 3 excel files.
    Again, thank you for your video, expecially the tricks in it.

    • @AccessAnalytic
      @AccessAnalytic  4 місяці тому +1

      If you’re connecting to individual files I’d recommend ua-cam.com/video/vPV67RLGoOg/v-deo.htmlsi=whWP7aSIWmeKw_4x

  • @platocplx4993
    @platocplx4993 Місяць тому +1

    One thing to note when I was doing this. Datflows Power Query it doesnt show binary vs tables, So what I did was do the base function in excel then copy and finish work in Dataflows

    • @AccessAnalytic
      @AccessAnalytic  Місяць тому +1

      Yes it's an odd bug that I reported to Microsoft in April.
      The hack fix is to add one more step (e.g. uppercase a column ) and hey presto the binaries appear!!

  • @chinedumjoseph9875
    @chinedumjoseph9875 2 роки тому +5

    You have saved my life! I wish I could give you a million likes. Thanks a lot for your clear and detailed explanation. Well done!

    • @AccessAnalytic
      @AccessAnalytic  2 роки тому

      Glad to help Chinedum, thanks for taking the time to let me know it helped you. Hopefully you’ll let others know about this channel 😀

  • @freedomdst
    @freedomdst 6 місяців тому +1

    Nice, but its still dumb that you need to connect thousand of files (possibly) and to navigate or filter a sub folder, they havent improved this?

  • @marcoslopez9997
    @marcoslopez9997 2 місяці тому +2

    How can I like this video many more times? Thank you for it!

  • @JudgeYuri
    @JudgeYuri Рік тому +2

    Thank you so much, this has been bothering me for such a long time. I don't understand why MS does not just allow you to connect to the subfolder directly instead of only allowing you to conect to the main Sharepoint site.

    • @AccessAnalytic
      @AccessAnalytic  Рік тому

      You're welcome, hopefully they'll improve it soon

  • @hagopbozawglanian2428
    @hagopbozawglanian2428 10 місяців тому +1

    This is awesome, but I am trying to pull in thousands of files in with this and I get an error for: The remote server returned an error: (500) Internal Server Error. (The attempted operation is prohibited because it exceeds the list view threshold.), would you happen to know how to deal with this?

  • @abdulbasitbello2381
    @abdulbasitbello2381 4 місяці тому +1

    Thank you so much for this video! Quick question, what if why my sharepoint folder contains multiple excel docs with multiple sheets and i want to extract all of them? What do i do? Once i get to the Combine wizard it makes me pick one sheet out of all the sheets and only extracts that sheet out of all the excel documents.

    • @AccessAnalytic
      @AccessAnalytic  4 місяці тому

      Check out Mynda’s video ua-cam.com/video/sLW3NbeGDy8/v-deo.htmlsi=hYz_scSKDlcWAB5z

  • @bhuvandesai1
    @bhuvandesai1 Рік тому +1

    Thanks for nice and simple way of explaining it. How can I dynamically pass SharePoint Link and Folder as a parameters so that we do not end-up rebuilding query every year or if same wants to use by multiple department but map with different SharePoint Site and Folder

    • @AccessAnalytic
      @AccessAnalytic  Рік тому

      Technically you can add a Parameters in Power Query (there's a button and wizard to create a parameter) then just replace the hard coded paths with the folder names. The difficulty with the SharePoint.Contents approach is there is an unknown number of folders to drill through so that will be a problem.

  • @chyntiaoktavia7158
    @chyntiaoktavia7158 11 місяців тому +1

    thank you so much!!! I wish you get good & blessing karma because of your very useful knowledge!!

  • @aliceliger1007
    @aliceliger1007 5 місяців тому +1

    Thanks a lot for all your videos, incredibly clear and helpfull !
    I was wondering, if I need to import only one or two files on a sharepoint, should I use preferably this connection to the sharepoint folder method or the simple web connection to the file directly? which one is the more efficient? thanks:)

    • @AccessAnalytic
      @AccessAnalytic  5 місяців тому +1

      You’re welcome. Use from web when connecting to 1 file.

  • @alistaircabral3330
    @alistaircabral3330 2 роки тому +1

    Hi thanks for this. I am doing all this and have the data currently connected to my report. However I am having an issue where when I refresh the data on PowerBI online it is not refreshing the data despite it being successful (no errors). Do you have any suggestions for why this may be?

    • @AccessAnalytic
      @AccessAnalytic  2 роки тому

      Any filters on your Power Query or Report that would limit what data is appearing. And you are refreshing your dataset in your workspace?

  • @hginhajecnemmelc7638
    @hginhajecnemmelc7638 6 місяців тому +1

    Great Vid. So when u load say April and May, would the source update with a refresh?

  • @gautamkulkarni7049
    @gautamkulkarni7049 14 днів тому +1

    The solution is super elegant. Thank you so much !!!

    • @AccessAnalytic
      @AccessAnalytic  13 днів тому

      You're welcome. Thanks for taking the time to comment.

  • @neilthackeray181
    @neilthackeray181 Рік тому +4

    MY GOD!!! Amazing! spent ages getting errors using other methods, love the simple exceptionally clear step by step presentation - Thank you!

    • @AccessAnalytic
      @AccessAnalytic  Рік тому +1

      You’re welcome Neil. Glad it helped and thanks for taking the time to leave a kind comment

  • @NosheenKumar
    @NosheenKumar 8 місяців тому +1

    ur videos are so cool! QQ: how do I read an excel file in SharePoint using SSIS?

  • @jennybaquero443
    @jennybaquero443 2 роки тому +1

    I dont have the sharepoint option how can I fix that?

    • @AccessAnalytic
      @AccessAnalytic  2 роки тому +1

      Create a blank query and add this code:
      = SharePoint.Contents("YOURPATH/", [ApiVersion = 15])

  • @dhikisatriawan5794
    @dhikisatriawan5794 3 місяці тому +1

    Amazing! This is what I want. You saved my lifee haha

  • @nataliatomczyk377
    @nataliatomczyk377 Рік тому +1

    Thank you a lot for this video. I have applied the same steps but in my case I need to delete the old files from the folder and paste new ones with different names (all of them have the same format) with refreshed data in the connected folder. Every time the Power Query shows an error because it refers to an old file name and I have to change it manually to the new file name every time, is there a way to automate this?

    • @AccessAnalytic
      @AccessAnalytic  Рік тому

      Technically it shouldn’t happen so you’ll need to look through your applied steps in Power Query and see which one refers to a file name and remove / alter that step

  • @anmolarora5193
    @anmolarora5193 20 днів тому +1

    Thankyou so much , you saved countless hours!!!!!

    • @AccessAnalytic
      @AccessAnalytic  20 днів тому

      Great to hear! Thanks for taking the time to let me know

  • @platocplx4993
    @platocplx4993 Місяць тому +1

    Amazing. Insane they dont use those connector instead of .files no idea why they use the older one its slow if there is a ton of data.

    • @AccessAnalytic
      @AccessAnalytic  Місяць тому +1

      The main limitation with .contents is you need full SharePoint path access all the way to root folder.

  • @paulskelton8799
    @paulskelton8799 5 місяців тому +1

    Thank you so much for sharing this took some finding and several other methods are not so effective

  • @imax8307
    @imax8307 9 місяців тому +1

    This really useful however I found the data incorrect. It appears my report keeps brining in the wrong file versions from SharePoint.

    • @AccessAnalytic
      @AccessAnalytic  9 місяців тому

      I’ve never come across that. If you go to SharePoint online and open the files there are they not the same ones used in the report.

    • @imax8307
      @imax8307 9 місяців тому +1

      @@AccessAnalytic Thanks for the reply but ignore my query. I misdiagnosed the issue. There are time based calculations in the Excel files. Clearly correct at the time they were saved, which is what BI is bringing back but what the file is opened the calculation updates and shows a different result. I'm now using the file modified date to calculate the offset 👍

  • @alexkim7270
    @alexkim7270 2 роки тому +5

    Wow. This is a neat workaround. Thanks for sharing this! I would generally avoid this method because the "drill down" isn't expanded and my worry is it isn't shown in Applied Steps. I guess by breaking them like what you showed here does the trick! So now whenever the folder path changes in future, I can go to that step and edit!

    • @AccessAnalytic
      @AccessAnalytic  2 роки тому

      Absolutely Alex, I used to feel the same way

  • @YounessElkhaddar
    @YounessElkhaddar 2 місяці тому +1

    Thank you so much tha was so helpful i solve my problem , love you man

  • @djaurit
    @djaurit 6 місяців тому +2

    Agree with so many other comments! Thank you for sharing your knowledge in such a clear way! Many thanks!

    • @AccessAnalytic
      @AccessAnalytic  6 місяців тому

      You’re very welcome. Thanks for taking the time to leave a kind comment

  • @olivierspeckert4635
    @olivierspeckert4635 5 місяців тому +1

    this video just saved my day. though i am wondering, is there any way to make sure, that the first two rows (headlines) of each file will not be included, so that there will be only one sort of headline, which is basically identical in all files.

    • @AccessAnalytic
      @AccessAnalytic  5 місяців тому +1

      Great. Yes you edit the transform sample file query that shows up around 5:10
      Also I mention this video that goes into an explanation of those steps
      ua-cam.com/video/nPlrQUbEn4o/v-deo.html

    • @olivierspeckert4635
      @olivierspeckert4635 5 місяців тому +1

      @@AccessAnalytic must've skipped this part, thank you!

  • @aarongarcia4439
    @aarongarcia4439 11 місяців тому +1

    Very helpful! Thank you very much.
    Quick question, before moving my file to SharePoint. I was able to copy the file to a new folder, and the queries would automatically update the data source as it referenced the file path. ex. =Folder.Files(FolderPath) is there any such way to automate this by referencing the Sharepoint file path? Or will I have to go in and manually update the "SharePointFolder" each time I move the file?

    • @AccessAnalytic
      @AccessAnalytic  11 місяців тому +1

      I wasn’t aware of power Query auto updating when source files were moved. You will need to manually update it.

    • @aarongarcia4439
      @aarongarcia4439 11 місяців тому

      @@AccessAnalytic Apologies, I may not have explained that well, I am a beginner. Basically, I was copying the binary file to a new folder each week. (New folder contains the same number of files in the exact same format with the exact same name but with new data) Refreshing would pull in the new data without issue. The source for my sample file, and export query were set to the folder path of wherever the binary file is saved, so the source was updated each week just by saving the file to a new location. That does not work now that we moved to Share Point.
      However, following your video, I had no issue adding a share point folder source, it would just be nice to not have to go in and update the share point folder source each week.

    • @AccessAnalytic
      @AccessAnalytic  11 місяців тому

      @aarongarcia4439 ah.. so do you have a formula in the Excel file to identify the path it’s saved, and then Power Query uses that reference?
      Potentially you can do the same thing if everyone who refreshes first syncs the files to their local machine, otherwise I’m not sure if it’s possible to reference the SharePoint path when you open the file locally to refresh.

  • @kunalpunjabi6362
    @kunalpunjabi6362 6 місяців тому +2

    thank you ! :D

  • @tadilah16
    @tadilah16 3 місяці тому +1

    Hello and thanks for the super useful video. I tried to replace files by content as you proposed, but the authenfication window appeared (I could still download the sharepoint folder without issue) and no way to authentify myself

    • @AccessAnalytic
      @AccessAnalytic  3 місяці тому

      Do you have access to the full SharePoint path? Is the refresh still working or not?

    • @tadilah16
      @tadilah16 3 місяці тому +1

      @@AccessAnalytic I found the solution: I needed to have entire access to the onedrive/sharepoint, so my boss gave me full site collection owners authorisation
      Thanks for the reply!

    • @AccessAnalytic
      @AccessAnalytic  3 місяці тому

      All good

  • @KonstantinAushev
    @KonstantinAushev 7 місяців тому +2

    Finally! It was so hard to find such elegant solution to the problem of slow working with SPO folders...

  • @Honest-Guy
    @Honest-Guy 19 днів тому +1

    This video save my time and money. Many Thanks!

  • @josiahbiles4466
    @josiahbiles4466 Рік тому +4

    Great video! I am experiencing a problem though. when I try and combine files, I get an error which reads "we didn't recognize the format of your first file type (). Please filter the list so it contains only supported file types." My files are all .xlsx just like yours, so it should be working. Any ideas on why this is happening to me? Thanks again for the video!!

    • @AccessAnalytic
      @AccessAnalytic  Рік тому +1

      4th Feb 2023 update:
      Hey all I’m now getting the same error with xlsx and it’s a bug that’s being looked into
      Original reply:
      Not sure, maybe a hidden system file in the folder. Try copying the first few files to a different folder and try there to see if the problem goes away

    • @vishwasgoswami2991
      @vishwasgoswami2991 Рік тому

      Hey I am getting the same error, did you find any solution for this or any lead? I am searching for the solution for days now.

    • @AccessAnalytic
      @AccessAnalytic  Рік тому +1

      4th Feb 2023 update:
      4th Feb 2023 update:
      Hey all I’m now getting the same error with xlsx and it’s a bug that’s being looked into

    • @brentl4985
      @brentl4985 Рік тому +1

      @@AccessAnalytic I experienced the same thing with .xlsx files. I changed the files to .csv and it worked like a charm.

    • @AccessAnalytic
      @AccessAnalytic  Рік тому +1

      Hey all I’m now getting the same error with xlsx and it’s a bug that’s being looked into

  • @cwnmaster
    @cwnmaster Рік тому +1

    Thank you so much. Is there any means we could keep a sharepoint EXCEL file in connection with Desktop EXCEL file in both directions so that a change in data reflects in Sharepoint file and vice versa.

    • @AccessAnalytic
      @AccessAnalytic  Рік тому +1

      Hi, the normal approach is to Sync your SharePoint file or folder so the files are then essentially the same file

    • @cwnmaster
      @cwnmaster Рік тому

      @@AccessAnalytic Thanks. I will try. I do not know whether it will capture the changes make by other team members in real time.

    • @AccessAnalytic
      @AccessAnalytic  Рік тому

      Yea it will, just make sure everyone has Autosave on. support.microsoft.com/en-us/office/collaborate-on-excel-workbooks-at-the-same-time-with-co-authoring-7152aa8b-b791-414c-a3bb-3024e46fb104?WT.mc_id=M365-MVP-5002589

  •  8 місяців тому +1

    Very helpful video! thank you

  • @pranjalagrawal4167
    @pranjalagrawal4167 3 місяці тому +1

    Worked like a charm. Thank you sir.

    • @AccessAnalytic
      @AccessAnalytic  3 місяці тому

      I appreciate you taking the time to let me know you found it useful

  • @aaronurzua4719
    @aaronurzua4719 2 роки тому +1

    Thanks for the amazing tip! Is there any way to get the 'Modified by' column?

    • @AccessAnalytic
      @AccessAnalytic  2 роки тому

      Hi Aaron, doesn't appear so, Date Modified yes, Modified by, no. If you find a way come back and let us know

  • @ksperder4035
    @ksperder4035 9 місяців тому +1

    Hi, this content is awesome! Thank you.
    I wonder if there is some kind of limit in how many files can Power BI can fetch and consolidate from a folder.
    I may have a scenario where the client uploads like 40 different files a day to be used in a report.

    • @AccessAnalytic
      @AccessAnalytic  9 місяців тому +1

      Technically not, but the refresh will take longer and longer to refresh. You could do staged refreshes where a few months worth is stored in a dataflow for example and then added to the consolidation but really a database is a better option.

    • @ksperder4035
      @ksperder4035 9 місяців тому

      @@AccessAnalytic thank you very much for your response! We are checking if we could use Power Automate to consolidate these daily files into one excel file or a SharePoint list to prevent this.
      Thanks again for the suggestion and happy new year!

    • @AccessAnalytic
      @AccessAnalytic  9 місяців тому

      @ksperder4035 no worries. Something like this might give a few ideas ua-cam.com/video/g4oZ0pOpn-4/v-deo.htmlsi=42QsVit7ieSVJdzo

  • @Oprimaita
    @Oprimaita 21 день тому +1

    Such a good tutorial ! Thanks a lot !

    • @AccessAnalytic
      @AccessAnalytic  21 день тому

      You’re welcome. I appreciate you taking the time to let me know you found it useful

  • @jjsambac
    @jjsambac Рік тому +1

    This worked marvelously for me the first few times then I tried again months later only to get this error message: "We didn't recognize the format of your first file (). Please filter the list of files so it contains only supported types (Text, CSV, Excel workbooks, etc.) and try again." The folder only contains .xlsx files so I'm loss. anyone else having this issue? As a workaround, I used an older file and changed the source location to the new folder within the same file path and it worked.

    • @AccessAnalytic
      @AccessAnalytic  Рік тому

      Yep it's a bug Microsoft are fixing. No ETA at this time

  • @Brooklyn-NYLatina
    @Brooklyn-NYLatina Рік тому +1

    This is a great video! Exactly what I was trying to do. Question if I delete data on my PBI will it remove it from the sharepoint file?

    • @AccessAnalytic
      @AccessAnalytic  Рік тому +1

      Thanks. Power BI is read-only so filtering out any data in Power Query will have no impact on your SharePoint files

    • @Brooklyn-NYLatina
      @Brooklyn-NYLatina Рік тому

      One of the spreadsheets had a table under the other. Now, in PBI I have two different data in one query. Can I remove half of the table into a new query, and would it keep its connection?

    • @AccessAnalytic
      @AccessAnalytic  Рік тому +1

      Difficult to answer without going into more detail but you can right-click reference a query and build other queries off it.

  • @paser2
    @paser2 Рік тому +2

    Absolutely brilliant! Thank you so much. Finding subfolders in SP has been a killer for me until now. Much appreciated.

    • @AccessAnalytic
      @AccessAnalytic  Рік тому

      You’re welcome. I appreciate you taking the time to let me know you found it useful

  • @davidtc3373
    @davidtc3373 2 години тому +1

    Perfect!!! Thanks

  • @martinargimon730
    @martinargimon730 2 роки тому +1

    Great Video.! My only comment is that pretty soon we will need to go thru' a Master's degree course to be able to use Excel. !!! they are making things more and more complicated that the ordinary man in the street will NOT be able to handle. That man is me, although my knowlwdge is quite good , which includes VBA programming and other areas... and the other nightmare is the 'Permissions' set up in sharepoint ( which again) you need to be an 'expert' to understand this.. MS is going overboard,,, Pretty soon very few people are going to be able to use Excel and Power BI I'm afraid ! But anyhow thanks for sharing your knowledge. Thanks Wyn

    • @AccessAnalytic
      @AccessAnalytic  2 роки тому +1

      You’re welcome Martin. The are certainly many things that Microsoft could simplify. They do listen a lot more to feedback these days and are much more proactive in fixing up issues.
      The pace of change over the last few years has been incredible. As a full time Excel and Power BI consultant even I struggle to keep up

  • @francispaulonicomedes7748
    @francispaulonicomedes7748 Рік тому +1

    Can anyone that has sharepoint access can refresh the file?

  • @andrewmackenzie2638
    @andrewmackenzie2638 Рік тому +1

    This is so much cleaner than my "filter 'ends with'" hack
    Also seems to load waaaay faster, which is my biggest gripe with PowerX and SharePoint

    • @AccessAnalytic
      @AccessAnalytic  Рік тому

      Yes, definitely quicker as t doesn't have to navigate all that meta-data

  • @toppanam611
    @toppanam611 2 роки тому +2

    Thanks for the wonderful tips. Could you also show how to get all the data if the Excel files contain multiple worksheets? Thanks

    • @AccessAnalytic
      @AccessAnalytic  2 роки тому +1

      Consolidating multiple sheets from one file is here : ua-cam.com/video/cPN24NK3_68/v-deo.html
      Consolidating multiple sheets from multiple files is tricky. Likely multiple “ from folder “ queries or the use of custom functions

    • @toppanam611
      @toppanam611 2 роки тому +1

      @@AccessAnalytic Thanks for the quick reply and appreciated the info.

    • @AccessAnalytic
      @AccessAnalytic  2 роки тому

      No worries

  • @99022
    @99022 5 місяців тому +1

    Awesome! :D

  • @julianmitchell3914
    @julianmitchell3914 Рік тому +2

    Excellent video and clearly explained. Thank you

    • @AccessAnalytic
      @AccessAnalytic  Рік тому

      You’re welcome. Thanks for taking the time to leave a kind comment

  • @PranayPawar1991
    @PranayPawar1991 6 місяців тому +1

    Excellent demonstration 😅

  • @xjuliussx
    @xjuliussx Рік тому +1

    Great video, put's light in a very complicated mechanism to access excel files. once again this proves how bad this non-feature was implemented from PowerBI point of view. The casual player will never figure out this. It has no explanation why power bi developers and sharepoint developers didn't manage to find a simple and easy way to access each specific folder !

    • @AccessAnalytic
      @AccessAnalytic  Рік тому

      Agreed. In the next 6 months I expect to see the dataflow UI hit power bi desktop and that has a better connector experience

  • @Qhuy02
    @Qhuy02 Рік тому +1

    Thank you so much sir, this video help me a lot in my job. I didn't know what to do with SharePoint folder when my boos asked.

    • @AccessAnalytic
      @AccessAnalytic  Рік тому +1

      You are welcome. I appreciate you taking the time to let me know you found it useful

  • @mc20117
    @mc20117 5 місяців тому +1

    Thanks, brilliant guide. You mentioned scheduled refreshes, but that isn't working for me. The credentials don't save to allow a scheduled refresh in PowerBI. Any tips ?

    • @AccessAnalytic
      @AccessAnalytic  5 місяців тому +1

      Make sure you select OAuth2 when entering your credentials

    • @mc20117
      @mc20117 5 місяців тому +1

      @@AccessAnalytic Thanks, I just got it to work by entering credentials as OAuth2 on the data settings.

    • @mc20117
      @mc20117 5 місяців тому

      @@AccessAnalytic Arggh, and my previous method, using a Web endpoint for Sharepoint files (while it works for PowerBI desktop) doesn't allow OAuth2 when published online.

    • @AccessAnalytic
      @AccessAnalytic  5 місяців тому

      If you use From Web to connect to SharePoint files OAuth2 works

    • @mc20117
      @mc20117 5 місяців тому +1

      @@AccessAnalytic wow, yes, you're right. I got to the bottom of my previous problems with the Web method, looks like you cannot enter OAuth2 creds for a Private Teams Channel, however a standard Teams Channel worked flawlessly. Thanks again for your video, got me on the right track. The web method also seems to work better for sites with lots of Excel Documents, I spent an hour navigating through SharePoint.Contents("path") and eventually gave up. By that stage you'd helped me diagnose the Web issue, thanks again.

  • @superlils100
    @superlils100 Рік тому +1

    I've been trying to solve performance issues for a week!! I'd LOVE this video if I could

    • @AccessAnalytic
      @AccessAnalytic  Рік тому

      Glad to help, thanks for taking the time to leave a kind comment

  • @user-gd2bd7gh5o
    @user-gd2bd7gh5o 5 місяців тому +1

    Thank you for posting a better/quicker way to connect to sharepoint folder! It worked very well for me!

  • @matsiengboyz
    @matsiengboyz 8 місяців тому +1

    Amazing, thank you!

  • @bjrnkrogh9768
    @bjrnkrogh9768 Рік тому +1

    Holy c... - the speed on this solution is Amazing !!!! Instead of 5 minutes - I'm getting data in 30 seconds - Thank you very much !!!!!

    • @AccessAnalytic
      @AccessAnalytic  Рік тому

      You’re very welcome and thanks for confirming the speed gains

  • @craiggibson8547
    @craiggibson8547 18 днів тому +1

    Thank you sir. You are a saint

  • @TheMetaModel
    @TheMetaModel Рік тому +1

    Thank you, thank you, thank you for making this video, so incredibly helpful!

  • @Matheus-tr9jf
    @Matheus-tr9jf Рік тому +1

    Really, thanks for sharing your knowledge. You saved my day here. Was trying for 2 hours how to link it. The Power BI/EXCEL in app information is horrible for this. This video/tutorial deserves an OSCAR.

  • @Girhofamily
    @Girhofamily Рік тому +1

    Thanks for solving puzzles for me. Love you man. You are great 👍

  • @Danny-Do-It
    @Danny-Do-It 14 годин тому

    I get a message "We didnt recognize the format of your first file" (both files are .xlsx files?

    • @AccessAnalytic
      @AccessAnalytic  Годину тому

      I have heard of that happening with no obvious reason. Try creating a couple of your own Excel files in another folder and see if you can get that to work.
      Also are the excel files exports from a system and are they showing xlsx extension and not xls

  • @dimitriosg
    @dimitriosg 2 роки тому +2

    That's quite useful. Thanks for sharing :)
    In my case, I'm looking for something else: like using the CELL function within Excel with a SharePoint folder so it can be loaded in PQ. I know this is possible with the folder path but not with SP folder.
    Have you any idea how you can do it? :)

    • @AccessAnalytic
      @AccessAnalytic  2 роки тому

      I’ll ask around but I know it’s a source of frustration for many. Can you give me a bit more detail around what you want to be able to do with this?

    • @dimitriosg
      @dimitriosg 2 роки тому

      @@AccessAnalytic Indeed it is.
      Sure! I have created a Dashboard where I have the KPI of agents in a call center - very useful, very handy and very visual - and I update it once a week with the weekly KPIs and MTD.
      When new reports are ready, I add the new data to the folder I have for my DB. Then, I simply hit 'refresh' and PQ does the job - very easy! :)
      Anyone can add new data to the folders. Meanwhile, when someone else wants to hit 'refresh' in Excel in order for the PQ to work, it won't work?
      Why? Because the path in the source if my computer's. So, the other users have to change the path everytime they want to refresh the DB (or ask me to do it, which is not convenient at all). Therefore, the path is changed everytime a new user wants to refresh it.
      It is tedious!
      If the files were not in SharePoint (as the company requires), that would be different - not shareable, but different - by usinge the CELL function and creating a variable in PQ. However, while having the file in a SP folder, it shows an URL (and sadly I cannot work with that :( maybe I dunno how yet).
      If you are able to share some idea, or at least make a video so it can be shared with everyone, that would be super awesome :)
      Thanks again, and have a great day ahead :)

    • @AccessAnalytic
      @AccessAnalytic  2 роки тому

      But if the source is SharePoint and everyone has access to the SharePoint folder then it should work for them?

  • @johnrussell8524
    @johnrussell8524 2 роки тому +1

    Thanks for this it will save me so much time! If the resulting file is to be shared by a group of people (within the same organization) do they all have to do the 'sign in' step? It seems unnecessary and inconvenient since they can already access the documents in sharepoint. Is there no way around it?

    • @AccessAnalytic
      @AccessAnalytic  2 роки тому

      No worries John. Yes they all have to sign in, I know what you mean though.

  •  2 роки тому +1

    Hi Nice video!! I'll try this later. Do you Know if theres any Kind of limitation about how many files can be imported from sharepoint folder?. Again, great video, im learning a lot since i found your channel

    • @AccessAnalytic
      @AccessAnalytic  2 роки тому +1

      Thanks Christian. I don't know of a technical limit, I've certainly see 100 done. But the more files you add and the more data there is, and the more complex the transformations there are then the slower it gets. I have staged queries in Excel in the past e.g. 1 consolidation per 6 months of data for example. If using Power BI keep an eye out for my Dataflow demo

  • @manishkotecha9476
    @manishkotecha9476 7 місяців тому +1

    Thank you so much - amazing

  • @frankwestphal2883
    @frankwestphal2883 2 роки тому +1

    Thanks for sharing. You made my day. With standard method it is a pain if a SharePoint has 10000s of files....

  • @twiggyinc1
    @twiggyinc1 Рік тому +1

    I wish I could give a x100 thumbs up. So useful for my job. Thanks

  • @MicaelaJoieB.Fajardo
    @MicaelaJoieB.Fajardo 6 місяців тому +1

    This helps! Thank you!

  • @habibabdulla3122
    @habibabdulla3122 Рік тому

    Thanks for the video.
    I am using M365 Business Premium and when click on "Get Data" >> "From File" Can't find "From SharePoint Folder" !! Can you please advise on this

    • @AccessAnalytic
      @AccessAnalytic  Рік тому

      Bizarrely Business version doesn’t have the SharePoint button but the following code will work even though Business Version doesn't have the SharePoint Folder button
      = SharePoint.Contents("YOURTOP LEVELFOLDERPATH/", [ApiVersion = 15])
      If you create a blank query and then replace the Source Step formula with this code it should work, then you get a list of Tables and click on the word Table next to Documents (normally around Row 6) and then keep on clicking each Table against each Folder to get to the right folder. Finally click on the double down arrow on the the first column called Content (when you can see all your files listed). That should trigger the folder consolidation.
      Note that your TOPLEVELFOLDERPATH will be something like mycomany.sharepoint.com/ with maybe one subsite name after the /. It's not the entire URL from your sharepoint folder.

  • @srivibish
    @srivibish 11 місяців тому

    Nice video. One quick question. I tried combining files from SharePoint folder using PBI desktop. However, the same when tried with the PBI services, I don't get the combine file option at the last step rather I can see the expand table option. Any work around required while doing on PBI services?

  • @landk8625
    @landk8625 Рік тому

    Hi, SharePoint Folder does not appear in my Excel. I had Office 365 for Business. Please advise! Thank you.

    • @AccessAnalytic
      @AccessAnalytic  Рік тому +1

      Sadly the button is not included in 365 for Business . However you can still use the code =SharePoint.Contents or use Power BI desktop ( free ) and then copy the query to Excel

  • @bacerlona79
    @bacerlona79 3 місяці тому

    How about if my excel doesn’t have sharepoint folder in my excel function.

  • @shahgul78
    @shahgul78 Рік тому +1

    Very helpful! Can you explain how to combine Source and Navigation in one step and add to parameter as source

    • @AccessAnalytic
      @AccessAnalytic  Рік тому

      Thanks, you’d need to go into the advanced editor for that and combine the 2 steps into 1 and replace the path with a word like SourcePath, then create a parameter ( via parameter button ) called SourcePath

  • @KatharinaJeczawitz
    @KatharinaJeczawitz 10 місяців тому

    Hi,
    my date in the CSV Files (5 inside the sharepoint folder I connected w PowerBi) isn´t uploading fully. what did I potentially do wrong?

    • @AccessAnalytic
      @AccessAnalytic  10 місяців тому

      Hi, I’d suggest posting some screenshots and detailed description to techcommunity.microsoft.com/t5/microsoft-excel/ct-p/Excel_Cat?WT.mc_id=M365-MVP-5002589
      Or
      community.powerbi.com/t5/Power-Query/bd-p/power-bi-services

  • @月真花子
    @月真花子 9 місяців тому +1

    Thank you so much for the detailed tutorial! Your explanation makes it easy to understand!

  • @melissaflottman6474
    @melissaflottman6474 Рік тому

    I'm not sure what I'm doing wrong, but after I change the code to "SharePoint.Contents" and click on the "Table" link that I want, the "Content" header is just a drop-down menu. It does not have the two arrows to expand the contents. Any advice? Thanks!

    • @AccessAnalytic
      @AccessAnalytic  Рік тому

      Potentially a different table for that first click. It might be Shared Documents or could be something else

  • @TheWeteyezz
    @TheWeteyezz Рік тому +1

    Freaking Awesome! Thank you. As a beginner this is extremely helpful

  • @idafisker6645
    @idafisker6645 Рік тому +1

    This video helped me save many hours of waiting! Thanks!

    • @AccessAnalytic
      @AccessAnalytic  Рік тому

      You’re welcome Ida. Thanks for letting me know it helped

  • @sreenithyatayi2791
    @sreenithyatayi2791 2 місяці тому

    Hi, I have a question. If we have two or more root folders from which the data needs to be combined, how do we need to go for it?? Can you please explain the procedure for the same. Thanks!

    • @AccessAnalytic
      @AccessAnalytic  2 місяці тому

      This video may help :
      Easily enter a File Path to Combine Files from SharePoint folder including sub folder option
      ua-cam.com/video/mgVnk4R79ac/v-deo.html

  • @agoes9983
    @agoes9983 Рік тому +1

    Great..., this is what i'm looking for, Thank you

  •  Рік тому

    This is so nice. My problem however is I am using the dynamically created path - each day the Power Query has to look to different location. The link is generated in excel and passed to power query. Power query then filters the folder. How I would get to the certain folder using SharePoint.Contents please?

    • @AccessAnalytic
      @AccessAnalytic  Рік тому

      I don’t really understand sorry. What determines the folder change?

  • @virginiacosta2798
    @virginiacosta2798 Рік тому +1

    Great!

  • @syedabu7685
    @syedabu7685 Рік тому +1

    Awesome contribution. you saved my tons of hours. Thank you soo much

    • @AccessAnalytic
      @AccessAnalytic  Рік тому

      I appreciate you taking the time to let me know you found it useful

  • @tigere3528
    @tigere3528 2 роки тому +1

    Man!! Lifesaver - I was using previous method - in our company we have a preservation hold folder that is bloated, so it was taking forever to load a file from one of the other folders because it has to first load all data from the other folders before I can filter for what I want

  • @antoniofelez4674
    @antoniofelez4674 2 місяці тому

    Great video!! But what if each file has multiple sheets and I only want to combine a specific sheet from each file based on sheet name. Kind of like when you go the SharePoint.files route and use excel.workbook then filter based on sheet name.

    • @AccessAnalytic
      @AccessAnalytic  2 місяці тому

      One of the first steps is to pick the sheet you want to consolidate

  • @balrajvirdee1087
    @balrajvirdee1087 Рік тому +1

    Brilliant, just brilliant thanks so much 👍🏽👍🏽

  • @percysalazardr
    @percysalazardr 6 місяців тому +1

    Awesome!! Thanks!

  • @felipesignorellireis7839
    @felipesignorellireis7839 Рік тому +1

    Save my life. First time using sharepoint folder.