It's good that you've split it out like this, Damo. I often did this with solutions in the community. Whilst we know that we can smoosh a lot of these into one expression, it doesn't provide the easy path to learn that.
I really love 💖 your videos. please keep sharing the knowledge. this is another great example where we can perform group by with in the Power Automate.👏👏👏
Thank you so much! I have learnt heaps and will apply to many of my flows which create custom reports from Dataverse tables. Greatly appreciate your generously sharing your knowledge to assist others
Thank you for the reminder that I REALLY need to sit down and learn/get comfortable with xpath. I've been working with more flows that need to "post-process" data pulled in from SharePoint or Excel and the "filter array" action doesn't always do what I want.
I really feel for newcomers to Power Automate who will have no idea about the classic designer but also that will have no chance at figuring their way around all the bugs in the new editor. It's difficult enough to determine the issue when you know what you're doing! That said, this video was excellent. Avoiding unnecessary loops is so important, not least because of consumption but also because it's so much faster! Scheduling overheads can add minutes to a flow because of a loop before any actions even take place, which can even be exacerbated by other Microsoft customers' use of the multi-tenant environment 😞
It’s definitely not an easy time to jump into Power Automate with both classic and new designer on the go and new having so many quirky bugs - agreed. I’m not a personal fan of Copilot in Power Automate either with so much of the automation incomplete but it will improve no doubt. I’ll keep sharing ideas on the new designer and hopefully folk can return to these videos. The concept won’t change and hopefully the video stands the test of time. I am planning on some newbie content 🤞 Just got to find the time as this is really just a hobby, albeit one I enjoy.
Hi Damien. Your video is super-informative and pretty easy for a layman like me to understand. I followed it step-by-step, except in my case I am running a query against a Power BI dataset. I'm certainly not an expert and I mimicked your flow as closely as possible but, I think that my attempt is failing because I can't seem to get the grouped categories into the same structure as your in the XML output. My output looks like this: [ { "Category": "" }, { "Category": "- ACC CLOSED" }, { "Category": "- ADD INCOME" }, { "Category": "- INTERNAL" }, { "Category": "* CASH 1 _DEL Mon - INV Fri - CALL Thu" }, { "Category": "* CASH 2 _DEL Tue - INV Mon - CALL Fri" }, { "Category": "* CASH 3 _DEL Wed - INV Tue - CALL Mon" }, { "Category": "* CASH 4 _DEL Thu - INV Wed - CALL Tue" }, { "Category": "* CASH 5 _DEL Fri - INV Thu - CALL Wed" }, { "Category": "* EFT 1 _DEL Mon - INV Fri - CALL Thu" }, { "Category": "* EFT 2 _DEL Tue - INV Mon - CALL Fri" }, { "Category": "* EFT 3 _DEL Wed - INV Tue - CALL Mon" }, { "Category": "* EFT 4 _DEL Thu - INV Wed - CALL Tue" } ] As you can see, my output contains all of the squiggly brackets { } and I can only guess that it is this that is the stumbling block for later flow steps. I get this message at the Compose XML step "This XML file does not appear to have any style information associated with it. The document tree is shown below." 72 DEGREES BAKERY & FROZEN FOODS 0 0 2314.5 0 0 2314.5 I'm very inexperienced and not entirely sure that I have identified the actual error but it is the one thing that stands out for me. I'd really appreciate it if you could point me in the right direction. It will save me bucket loads of time if I can get the desired result. I've spent so much time on this and I'm super keen to get a positive result. Many thanks for your assistance, Andrew
Thanks! This provided a great way to handle large invoicing and accounting materials with efficiency. I´d really like to see how you would handle something that is large enough to require paging.
@@DamoBird365 Yes, I suppose I meant paging a source and in general I´m especially interested in handling a large number of rows in just about any setting. Did not find paging behind that link, but if you have such a video, I´ll find it eventually 🙈 Thanks for you blog and videos 👍👍👍
Oooops, wrong link apologies 👉 Boost Your Power Automate Skills with Complex Arrays, Select, XML, and Join Techniques ua-cam.com/video/afqvGAb20Dw/v-deo.html
Thanks for this excellent video! It works perfectly for me, but I have one issue (on my end...). I've been looking at some of your other videos and cannot quite sort out how to query the values of the select array. In other words, when I look at the output of the final "select," I see each of the records with indivdual SUMs (I modified yours somewhat) and I need to find a way to query that data to find the records with that SUM > 1. Any help would be greatly appreciated.
@@DamoBird365 Thanks for your reply! I tried that, acutally, and my syntax must be wrong... I am returning 6 values with the Select - but just two of them are SUM'd values. I'm getting ... "The evaluation of 'query' action 'where' expression '@greater(item('TotalHCAllocation'), 1)' failed: 'The template language function 'item' must not have any parameters.'. (TotalHCAllocation is the first SUM'd value). " .... too bad I can't add a screenshot here.
Hi Damo, thank you for sharing this great video. This is exactly what I'm looking for. However, I want to ask how about the calculated columns? Is it possible to use this also? I'm sorry I am new to Power Automate.
In theory yes, but what you need to look at is the history of get items. Run the flow, check the history, can you see the calculated column value in output history. If yes, the logic is the same.
@@DamoBird365 Hi Damo, yes, I can see the calculated columns now. For many days I did a lot of searching online for this. I'm happy I found your channel.
By the way, can you help me on how to call this flow from another Sharepoint List? I have second SP List with a column for the sum (by employee) of the calculated column from first SP list. I am not sure if you have video regarding this, but I'm trying to watch all your videos one by one. If you have, please share with me here the link... Thank you so much.
I have a similar list, with a column called County and Status and I want to 1.) go through the list and count the number of items grouped by the county name and be provided totals and then 2.) I have another column called status that’s a choice column and then I want to count the number of Active, Closed, and Pending statuses also by the county and be given totals. Would your demonstration work with what I am looking to do as well?
Does xpath in this context support string lookups instead of integers? For example, lets say you wanted to to use John Smith instead. "//values[Name="John Smith"]/Expense[1]/text()"
This is very useful. Can I ask how you would build the XPath expression with the sum() inside this xpath(outputs('Compose_XML), concat('(//values[EmployeeNumber=',item(),']/Email)[1]/text()'))). ?
thanks for this excellent video, I just have a question, how can I add number format on the xpath function in order to summarize the costs? I tried with formatNumber(Item()?['AmountLocalCurrency'],'N2') on the initial table, however the sum result that I receive is NAN, hope you can help me
I wonder if your currency is a string? You could try float() around the item()?[‘currency’]. The history will let you see if number is in quotes (a string) or not (a number).
Thank you for the lovely video Damien. Leart a lot. I had one question for you on the xpath expression - The name in the map of is the name that you have given; however in the expression, are those the internal names of the columns. Also want to know would that be same if I am trying to get the count of data from a choice column in SP.
The easiest way to find the name is to look at the output history. SharePoint might have field1,2,3 etc if you’ve created a list from an import. Good luck 👍
I use power query and VBA to do this, but i can see that this might be useful in conjunction with power apps to return some data for the user. Any other use cases where this technique is better than power query/bi/vba ? (VBA is no bigger lift than flows or apps IMO).
There are definitely other products / platforms that can do this but some folk work in the low code space and have this requirement. An apply to each and a variable is not an efficient way of doing this. Office Scripts could achieve this easily I bet. But some orgs don’t have Office Scripts. Good to have options.
Yes this technique has a lot of gems in it for other processes too. If they have power platform they have Excel also, and i find greater trust and acceptance with excel solutions in my area (especially because they can edit the email before sending, decide not to send one or more, etc) than just having emails come automagically (as one friend calls it). But I can see a use in a power app I'm thinking of for sure!
Why does this PA editor work for you and not for me. It does not save the parameters I add (like xpath strings, etc.) so I have to save them out to notepad every time I write one.
I got almost there but when I went from the specific value to try and use the concat to get the count the flow failed (telling me the format was off). Would love some assistance if anyone sees what I did wrong. Works for single value formula: xpath(outputs('Compose_-_Convert_to_XML'),'count(//Values[Score=""]/Score[1])') But Fails: xpath(outputs('Compose_-_Convert_to_XML'),concat('count(//Values[Score=',item(),']/Score[1])'))
@@klebermedeiros8742 Hi Kleber, what do you mean by inserting "before"? I am having the same issue. The field I am using to find the xml value is a string (very long, indeed), and I noticed using the xpather, it cannot find elements. Do you have any clue?
thank you so much. very clear explanation. this is what i am looking for.
I applied this technique today at work. What a thrill it was when it did exactly what it was supposed to do! Thank you again Damien ❤
Cheers James 😍
It's good that you've split it out like this, Damo.
I often did this with solutions in the community. Whilst we know that we can smoosh a lot of these into one expression, it doesn't provide the easy path to learn that.
I really love 💖 your videos. please keep sharing the knowledge. this is another great example where we can perform group by with in the Power Automate.👏👏👏
Simply AMAZING! very easy to follow what could've otherwise been a complicated process. Thank You Damo
Glad you enjoyed it!
Thank you so much! I have learnt heaps and will apply to many of my flows which create custom reports from Dataverse tables. Greatly appreciate your generously sharing your knowledge to assist others
Thanks Wendy 👍
Thank you for the reminder that I REALLY need to sit down and learn/get comfortable with xpath. I've been working with more flows that need to "post-process" data pulled in from SharePoint or Excel and the "filter array" action doesn't always do what I want.
I was just reading your old post from 2021 on this topic with a hack using length function. Excellent vid as usual. Thank you for sharing!
thank you for the demo. i constructed a similar usecase using a loads of loops. i should use this from now on!
Wow. Excellent video, Damien! You made xpath seem more approachable
I really feel for newcomers to Power Automate who will have no idea about the classic designer but also that will have no chance at figuring their way around all the bugs in the new editor. It's difficult enough to determine the issue when you know what you're doing!
That said, this video was excellent. Avoiding unnecessary loops is so important, not least because of consumption but also because it's so much faster! Scheduling overheads can add minutes to a flow because of a loop before any actions even take place, which can even be exacerbated by other Microsoft customers' use of the multi-tenant environment 😞
It’s definitely not an easy time to jump into Power Automate with both classic and new designer on the go and new having so many quirky bugs - agreed. I’m not a personal fan of Copilot in Power Automate either with so much of the automation incomplete but it will improve no doubt. I’ll keep sharing ideas on the new designer and hopefully folk can return to these videos. The concept won’t change and hopefully the video stands the test of time. I am planning on some newbie content 🤞 Just got to find the time as this is really just a hobby, albeit one I enjoy.
Hi Damien. Your video is super-informative and pretty easy for a layman like me to understand. I followed it step-by-step, except in my case I am running a query against a Power BI dataset. I'm certainly not an expert and I mimicked your flow as closely as possible but, I think that my attempt is failing because I can't seem to get the grouped categories into the same structure as your in the XML output. My output looks like this:
[
{
"Category": ""
},
{
"Category": "- ACC CLOSED"
},
{
"Category": "- ADD INCOME"
},
{
"Category": "- INTERNAL"
},
{
"Category": "* CASH 1 _DEL Mon - INV Fri - CALL Thu"
},
{
"Category": "* CASH 2 _DEL Tue - INV Mon - CALL Fri"
},
{
"Category": "* CASH 3 _DEL Wed - INV Tue - CALL Mon"
},
{
"Category": "* CASH 4 _DEL Thu - INV Wed - CALL Tue"
},
{
"Category": "* CASH 5 _DEL Fri - INV Thu - CALL Wed"
},
{
"Category": "* EFT 1 _DEL Mon - INV Fri - CALL Thu"
},
{
"Category": "* EFT 2 _DEL Tue - INV Mon - CALL Fri"
},
{
"Category": "* EFT 3 _DEL Wed - INV Tue - CALL Mon"
},
{
"Category": "* EFT 4 _DEL Thu - INV Wed - CALL Tue"
}
]
As you can see, my output contains all of the squiggly brackets { } and I can only guess that it is this that is the stumbling block for later flow steps. I get this message at the Compose XML step "This XML file does not appear to have any style information associated with it. The document tree is shown below."
72 DEGREES BAKERY & FROZEN FOODS
0
0
2314.5
0
0
2314.5
I'm very inexperienced and not entirely sure that I have identified the actual error but it is the one thing that stands out for me. I'd really appreciate it if you could point me in the right direction. It will save me bucket loads of time if I can get the desired result. I've spent so much time on this and I'm super keen to get a positive result.
Many thanks for your assistance,
Andrew
"Old friend classic designer" FTW :) Great demo Damo again. 👍💡🥳
Ah yes. I’m working hard to feedback my findings with PG. It will get there.
😂😂😂
Thank you! I had no idea xpath was so powerful. 😲
Glad it was helpful!
GOAT
Thanks, I’ll take that.
Thanks this method is what I was looking
OOOOOH ... xpather is LUSH.
Awesome!!!
Thanks! This provided a great way to handle large invoicing and accounting materials with efficiency. I´d really like to see how you would handle something that is large enough to require paging.
Paging from the data source? Or something else? I’ve got graph api paging here ua-cam.com/video/4IphRdADJBc/v-deo.htmlsi=jTbBHRjpUY68veTW
@@DamoBird365 Yes, I suppose I meant paging a source and in general I´m especially interested in handling a large number of rows in just about any setting. Did not find paging behind that link, but if you have such a video, I´ll find it eventually 🙈 Thanks for you blog and videos 👍👍👍
Oooops, wrong link apologies 👉 Boost Your Power Automate Skills with Complex Arrays, Select, XML, and Join Techniques
ua-cam.com/video/afqvGAb20Dw/v-deo.html
Great Video as always.
Great video! Thanks a lot 👍
Cheers Artur 👍
Thanks for this excellent video! It works perfectly for me, but I have one issue (on my end...). I've been looking at some of your other videos and cannot quite sort out how to query the values of the select array. In other words, when I look at the output of the final "select," I see each of the records with indivdual SUMs (I modified yours somewhat) and I need to find a way to query that data to find the records with that SUM > 1. Any help would be greatly appreciated.
@@mikepsychles just use a filter array on the body output of the select where the item()?[‘sum’] greater than 1 👍
@@DamoBird365 Thanks for your reply! I tried that, acutally, and my syntax must be wrong... I am returning 6 values with the Select - but just two of them are SUM'd values. I'm getting ... "The evaluation of 'query' action 'where' expression '@greater(item('TotalHCAllocation'), 1)' failed: 'The template language function 'item' must not have any parameters.'. (TotalHCAllocation is the first SUM'd value). " .... too bad I can't add a screenshot here.
Hi Damo, thank you for sharing this great video. This is exactly what I'm looking for. However, I want to ask how about the calculated columns? Is it possible to use this also? I'm sorry I am new to Power Automate.
In theory yes, but what you need to look at is the history of get items. Run the flow, check the history, can you see the calculated column value in output history. If yes, the logic is the same.
@@DamoBird365 Hi Damo, yes, I can see the calculated columns now. For many days I did a lot of searching online for this. I'm happy I found your channel.
By the way, can you help me on how to call this flow from another Sharepoint List? I have second SP List with a column for the sum (by employee) of the calculated column from first SP list. I am not sure if you have video regarding this, but I'm trying to watch all your videos one by one. If you have, please share with me here the link... Thank you so much.
Very good. Is it possible to get a max value, using a expression like sum?
There is a max expression learn.microsoft.com/en-us/azure/logic-apps/workflow-definition-language-functions-reference#max
I have a similar list, with a column called County and Status and I want to 1.) go through the list and count the number of items grouped by the county name and be provided totals and then 2.) I have another column called status that’s a choice column and then I want to count the number of Active, Closed, and Pending statuses also by the county and be given totals. Would your demonstration work with what I am looking to do as well?
It would certainly help you with most of your requirements 👍
Does xpath in this context support string lookups instead of integers? For example, lets say you wanted to to use John Smith instead. "//values[Name="John Smith"]/Expense[1]/text()"
It does indeed. 👍
This is very useful. Can I ask how you would build the XPath expression with the sum() inside this xpath(outputs('Compose_XML), concat('(//values[EmployeeNumber=',item(),']/Email)[1]/text()'))). ?
thanks for this excellent video, I just have a question, how can I add number format on the xpath function in order to summarize the costs? I tried with formatNumber(Item()?['AmountLocalCurrency'],'N2') on the initial table, however the sum result that I receive is NAN, hope you can help me
I wonder if your currency is a string? You could try float() around the item()?[‘currency’]. The history will let you see if number is in quotes (a string) or not (a number).
Thank you for the lovely video Damien. Leart a lot. I had one question for you on the xpath expression - The name in the map of is the name that you have given; however in the expression, are those the internal names of the columns. Also want to know would that be same if I am trying to get the count of data from a choice column in SP.
The easiest way to find the name is to look at the output history. SharePoint might have field1,2,3 etc if you’ve created a list from an import. Good luck 👍
Thank you so much. I was able to create a flow which is working perfectly fine. Appreciate your help.
Can you make the same video in classic ui? Or maybe provide a zip copy of the flow?
I’ve not got plans to do videos in both designer. But the video should give you everything you need.
I use power query and VBA to do this, but i can see that this might be useful in conjunction with power apps to return some data for the user.
Any other use cases where this technique is better than power query/bi/vba ? (VBA is no bigger lift than flows or apps IMO).
There are definitely other products / platforms that can do this but some folk work in the low code space and have this requirement. An apply to each and a variable is not an efficient way of doing this. Office Scripts could achieve this easily I bet. But some orgs don’t have Office Scripts. Good to have options.
Yes this technique has a lot of gems in it for other processes too.
If they have power platform they have Excel also, and i find greater trust and acceptance with excel solutions in my area (especially because they can edit the email before sending, decide not to send one or more, etc) than just having emails come automagically (as one friend calls it).
But I can see a use in a power app I'm thinking of for sure!
@@McIlravyInc nice 👍 let me know how you get on.
Why does this PA editor work for you and not for me. It does not save the parameters I add (like xpath strings, etc.) so I have to save them out to notepad every time I write one.
I got almost there but when I went from the specific value to try and use the concat to get the count the flow failed (telling me the format was off). Would love some assistance if anyone sees what I did wrong.
Works for single value formula: xpath(outputs('Compose_-_Convert_to_XML'),'count(//Values[Score=""]/Score[1])')
But Fails: xpath(outputs('Compose_-_Convert_to_XML'),concat('count(//Values[Score=',item(),']/Score[1])'))
My flow gives an error when the dynamic item has letters and numbers together. What can it be?
It worked when I inserting " before '.
Glad you worked it out ok 👍
@@klebermedeiros8742 Hi Kleber, what do you mean by inserting "before"? I am having the same issue. The field I am using to find the xml value is a string (very long, indeed), and I noticed using the xpather, it cannot find elements. Do you have any clue?