Extract Multiple Web Pages with Power Automate Desktop - Full Tutorial

Поділитися
Вставка
  • Опубліковано 3 гру 2024

КОМЕНТАРІ • 101

  • @andersjensenorg
    @andersjensenorg  2 роки тому +3

    Thanks for all your questions and comments 🥰
    I've created a Discord, where we can help each other with RPA and network around our careers: discord.gg/iloveautomation

    • @wallyrogers7501
      @wallyrogers7501 9 місяців тому

      I joined. Easy to get lost in there. Need an AI to find the right topic.

  • @VitorReis-rn8ho
    @VitorReis-rn8ho Рік тому +1

    I have struggled a lot, but, thanks to your instructions, I managed to adapt small parts of the script to my needs.
    I already knew your work teaching autohotkey. Your teaching is fantastic!!! Thank you very much!

    • @andersjensenorg
      @andersjensenorg  Рік тому

      Hey VitorReis, thanks a lot - Have you seen my discord (link in the description)? We're 8000 RPA developers helping each other, and it's of course free. Kind regards, Anders

  • @sergiobarros5541
    @sergiobarros5541 Рік тому +1

    Mr. Jensen, you rock! Thank you for this wonderful tutorial. Greetings from Brazil!

    • @andersjensenorg
      @andersjensenorg  Рік тому +1

      My pleasure, thanks for the nice comment 🥰 Kind regards, Anders

  • @glennganey6217
    @glennganey6217 2 роки тому +1

    Thanks for another great tutorial. The dynamic selector was elegant.
    I am still scratching my head over doing a google search for a refrigerator part (DA47-00322B). I go through the standard selector UI assignments for the results title and for the body of text, sometimes the part number will not appear in the title but does appear in the body of text. When I run PAD it picks up only nine of the thirteen results. Using your tip (F-12) I look at the code, but I am no web programmer, and do see a significant number of differences between some of the results.
    The object of the exercise is to write a URL & part number if the part number is explicitly found in either the title of body of text and of course save the results in excel. I do believe this would make for a good tutorial since so many people use google searches. Thanks for any incite you can shed.

  • @kaushik9gohil
    @kaushik9gohil Рік тому +3

    I learned something new, was able implement in actual real life requirement. Thank you very much for making it so easy and simple.

    • @andersjensenorg
      @andersjensenorg  Рік тому

      Hey @kaushik9gohil. Thanks a lot 😊 Have a great day. You're more than welcome at my Discord, where we're 8000+ RPA developers networking and solving problems: ua-cam.com/video/xWFz-S96XGo/v-deo.html Kind regards, Anders

  • @thehspace
    @thehspace Рік тому +1

    Very helpful. Thank you!

    • @andersjensenorg
      @andersjensenorg  Рік тому

      Hey @thehspace. Thanks a lot 😊 Have a great day. You're more than welcome at my Discord, where we're 8000+ RPA developers networking and solving problems: ua-cam.com/video/xWFz-S96XGo/v-deo.html Kind regards, Anders

  • @chandermohanaggarwal2838
    @chandermohanaggarwal2838 2 місяці тому +1

    Thank you for wonderdful video

  • @sujitbhowmick9517
    @sujitbhowmick9517 2 роки тому +2

    Love from India ❣️👌

  • @Chime-In-CelebQuotes
    @Chime-In-CelebQuotes Рік тому +1

    Thank you Anders !! this is very helpful :)

    • @andersjensenorg
      @andersjensenorg  Рік тому

      You're very welcome, Neha Puri - your support helps me a lot 😍 You're more than welcome at my Discord, where we're 6000+ RPA developers networking and solving problems: ua-cam.com/video/xWFz-S96XGo/v-deo.html

  • @agamenon1953
    @agamenon1953 Рік тому +1

    Thank you for such a great video Anders. I wonder if you can post a video explaining how to scrape web pages with infinite scroll.

  • @adenilsonx.franco5287
    @adenilsonx.franco5287 2 роки тому +1

    Thank you very much for the tutorial that prepared Mr. Anders Jensen, it will help me a lot, I will use it in other researches, because I can use your techniques.

    • @andersjensenorg
      @andersjensenorg  2 роки тому

      Thanks a lot, Adenilson 😊 I'm so happy, that I could help you - have a great day. Kind regards, Anders

  • @duesenberger
    @duesenberger 10 днів тому +1

    Thx for this video. I was looking for another one where You showed how to extract detail data from a second page. Can You point me to the video?

    • @andersjensenorg
      @andersjensenorg  9 днів тому +1

      Sure, it's here: ua-cam.com/users/live4zmviNtOFwA Kind regards, Anders 😊🙌

  • @missnlahi
    @missnlahi Рік тому +1

    Thanks I'll try it. I think this addresses why my script was only working for the 1st page of data

    • @andersjensenorg
      @andersjensenorg  Рік тому

      Nice to hear, please let me know if it worked 🙂

  • @happy9955
    @happy9955 Рік тому +1

    great teaching

  • @manjunathreddy4320
    @manjunathreddy4320 11 місяців тому +1

    Thanks for awsome content!
    Could not see advanced settings option in add ui element in the Power automate desktop, and I am using latest vestion.

    • @andersjensenorg
      @andersjensenorg  11 місяців тому

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 10,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ua-cam.com/video/xWFz-S96XGo/v-deo.html Kind regards, Anders

  • @Taxita
    @Taxita 2 роки тому +1

    Thanks for doing this. I was wondering how to do that.

  • @stanTrX
    @stanTrX Рік тому +1

    Thanks. There is also set pager property for the next pages, does that work as well?

    • @andersjensenorg
      @andersjensenorg  Рік тому

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 9000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ua-cam.com/video/xWFz-S96XGo/v-deo.html Kind regards, Anders

  • @BrainUpp
    @BrainUpp 2 роки тому +1

    Also scrape data from inside from every link multiple data upto multiple pages

    • @andersjensenorg
      @andersjensenorg  2 роки тому

      Hey Brain Up. Please check this: ua-cam.com/video/4zmviNtOFwA/v-deo.html Kind regards, Anders

    • @BrainUpp
      @BrainUpp 2 роки тому

      @@andersjensenorg yes i saw this you have extrated only one item i mean to say to scrape multiple items

  • @freeacademy701
    @freeacademy701 2 роки тому +1

    Great video, can power automate open multiple webpages or tabs at the same time and filling forms or performing clicks on every tab at the same time?

    • @andersjensenorg
      @andersjensenorg  2 роки тому

      Hey Free. Yes 100%, but not 100% at the same time, but right after each other. Kind regards, Anders

  • @Hungry_kitchen777
    @Hungry_kitchen777 2 роки тому +1

    Hi Anders thanks for the great video, may I know how to scroll down and extract the entire table from web page in PAD, Iam trying but able to get only the one's displayed on the screen, hope to see the repl soon😊

    • @andersjensenorg
      @andersjensenorg  2 роки тому

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 4500+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ua-cam.com/video/xWFz-S96XGo/v-deo.html Kind regards, Anders

  • @fanisz5331
    @fanisz5331 11 місяців тому +1

    Mr Jensen thank you very much for you valuable support.
    I have a quick question about regex. If got the return value is lets say 1000,00 € and I want to retrieve only "1000", what regex should I type ?

    • @andersjensenorg
      @andersjensenorg  11 місяців тому

      My pleasure, you can try with this: \d+(?=,)
      Kind regards, Anders

    • @fanisz5331
      @fanisz5331 11 місяців тому

      @@andersjensenorg Thank you so much for you response. I forgot to mention that the data has a . . It's 1.000,00€ . I noticed that this regex does remove data after comma but it also removes data before dot. It returns 000 Is there a regex that returns 1.000 ?

    • @andersjensenorg
      @andersjensenorg  11 місяців тому +1

      @@fanisz5331 Oh, then you can try: [\d.]+(?=,) 🙂

    • @fanisz5331
      @fanisz5331 11 місяців тому

      @@andersjensenorg thank you so much! Works like a charm!!!

  • @Palmakify
    @Palmakify 2 роки тому +1

    Thank you for the video, always helpful.
    I have a question: When I try to extract the list of HRef from a website, I only get 2 results written into my excel, but on the preview extraction, it shows me more than 2 results. It's a bit strange that the preview results and the actual extracted results are different.

    • @andersjensenorg
      @andersjensenorg  2 роки тому

      Thanks a ton, CP. Can you link to the site? 😊

  • @dDse7en
    @dDse7en 10 місяців тому +1

    thank you very much for this video, but i have a question, why is your data in excel is separate nicely from value scrap from web into each individual cell, meanwhile mine is all the data scrap from the web is lump into a single cell

    • @andersjensenorg
      @andersjensenorg  10 місяців тому

      Thanks a lot 👍😊 How does your DataTable with the scraped data look like? If one cell, you scraped wrong. You're more than welcome to post the problem on my discord :) It's 100% free and the link is in the video description. Kind regards, Anders

  • @syedimtiaz3558
    @syedimtiaz3558 Рік тому +1

    Hi Anders, Thanks for your video. What if you had to run an inner loop for each employee to get some info from his/her profile and then come to the root page which has pagination? Is there any workaround for a scenario this?

    • @andersjensenorg
      @andersjensenorg  Рік тому +1

      My pleasure, Syed. It's almost the approach I take here (just with cars): ua-cam.com/users/live4zmviNtOFwA Kind regards, Anders

  • @suraj_singh321
    @suraj_singh321 2 роки тому

    Kudos Anders Sir Make a video on Working with CMD Sessions operations from basic to advance in Power Automate Desktop

    • @andersjensenorg
      @andersjensenorg  2 роки тому +1

      Hey RPA_Enthusiast Thanks a lot for writing. I'm getting more than 50 questions/comments every day and having difficulty answering everyone - but I try my best. I've created my Discord, where we're 4300+ RPA Developers networking and solving problems. You're very welcome: andersjensen.org/#community Kind regards, Anders

  • @choiboix
    @choiboix 2 роки тому +1

    Can you do a tutorial of scraping similar formatted tables from multiple PDF's to a excel data table? I know you did a powerAI one extracting fields and tables from PDF but that was kind of vague near the end and confusing with the coding stuff. Is there a simpler and more straight forward to set a flow?

    • @andersjensenorg
      @andersjensenorg  2 роки тому

      Hey Michael. Are they text or image PDFs? 😊

    • @choiboix
      @choiboix 2 роки тому

      @@andersjensenorg Texts. I believe the PDF was converted from Excel as it has a table format like Excel.

  • @JoelNove
    @JoelNove Рік тому

    Thank you for your video. I'm creating a flow that extracts my banking information and saves the data to a SharePoint list. I was curious, do I need to keep Power Automate desktop open on my laptop at all times or can the flow be triggered and run on the cloud while laptop is shutdown? Trying to avoid going python rout. Thanks!

    • @andersjensenorg
      @andersjensenorg  Рік тому

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 8000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ua-cam.com/video/xWFz-S96XGo/v-deo.html Kind regards, Anders

  • @suraj_singh321
    @suraj_singh321 2 роки тому +1

    Hii Anders Sir make a seperate video on Regex what is Regex how we can build Regex and use in uipath and power Automate desktop

    • @andersjensenorg
      @andersjensenorg  2 роки тому +1

      Hey Suraj. I will do my best, but have you seen this: ua-cam.com/video/TmeGaxksrUA/v-deo.html Kind regards, Anders

  • @suraj_singh321
    @suraj_singh321 2 роки тому +1

    Make a use case different challenging scenarios of Selectors to make Dynamic using power Automate Desktop

  • @matusklubica1256
    @matusklubica1256 8 місяців тому +1

    Hello im struggling with the third part of your video, i cant make it work, my source code looks different and I cant deal with it, i would really like to master it, thank you for your help, love your videos :)

    • @andersjensenorg
      @andersjensenorg  8 місяців тому

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 11,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ua-cam.com/video/xWFz-S96XGo/v-deo.html Kind regards, Anders

  • @faridrosli7814
    @faridrosli7814 27 днів тому +1

    Can i know why we must put that [0][0]?

    • @andersjensenorg
      @andersjensenorg  26 днів тому +1

      Sure, first row - first column in the DataTable (it's zero-indexed meaning the first item is index 0). Kind regards, Anders

    • @faridrosli7814
      @faridrosli7814 26 днів тому

      @andersjensenorg thanks for the reply, I appreciate it 👍

  • @wallyrogers7501
    @wallyrogers7501 9 місяців тому

    I did pretty good until Create the Dynamic Selector. My code in Inspect properties looked nothing like yours. It would be great to add on the Power Automate version of that step in addition to the developer tools.

    • @andersjensenorg
      @andersjensenorg  7 місяців тому

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 12,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ua-cam.com/video/xWFz-S96XGo/v-deo.html Kind regards, Anders

  • @billiedwong6982
    @billiedwong6982 Рік тому

    great video and sharing! thanks! I tried to run multiple-pages based on your example, I got error: div[id="paginacao"]>div[class="paginationjs"]>div[class="paginationjs-pages"]>ul>li[data-num=16] or 6..not found. any advice?

    • @andersjensenorg
      @andersjensenorg  Рік тому +1

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 9000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ua-cam.com/video/xWFz-S96XGo/v-deo.html Kind regards, Anders

  • @Nataliegaskell-p7k
    @Nataliegaskell-p7k Рік тому +1

    Hi, i am trying to gather data from a website that has further links on the page. So i need to click on the link extract that data, go back click on the next and so on. There are multiple pages as well. I cant seem loop it through correctly. Can someone provide a step by step guide on how to do this i am new to power automate.

    • @andersjensenorg
      @andersjensenorg  Рік тому

      Of course. Kindly see this: ua-cam.com/users/live4zmviNtOFwA 😊 Anders

  • @none1615
    @none1615 2 роки тому +1

    after 30 seconds, I subscribed , What a wonderful channel and content , thanks for sharing with the community .. I am looking for a simple solution to copy all contents of OneDrive including Folders and subfolders and files beneath them and copy/move to sharepoint location .... That scenerio somehow not covered anywhere yet , all examples I've seen were based on file copy / move but none of them showing how to do deal with folder or subfolder creations .. If you read this message and think that would be valuable to the rest community and make short video , that would be greatly appreciated .:)

    • @andersjensenorg
      @andersjensenorg  2 роки тому

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 4900+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ua-cam.com/video/xWFz-S96XGo/v-deo.html Kind regards, Anders

  • @benfrankie6936
    @benfrankie6936 2 роки тому

    how can we automate scraping from sub/inner pages of each profile and scrape phone numbers or emails of each one if available?
    thanks

    • @andersjensenorg
      @andersjensenorg  2 роки тому

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 4500+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ua-cam.com/video/xWFz-S96XGo/v-deo.html Kind regards, Anders

  • @Philbnyc
    @Philbnyc 10 місяців тому

    I want to take a screenshot for websites from an excel url list , and save the screenshots in a directory with the url name ..possible ?

    • @andersjensenorg
      @andersjensenorg  10 місяців тому +1

      Thanks a lot, @philborrero592 🤗 Your feedback helps me immensely. You're more than welcome at my Discord, where we're 11,000+ RPA developers networking and solving problems: ua-cam.com/video/xWFz-S96XGo/v-deo.html Kind regards, Anders

  • @bbbbbbbbrb
    @bbbbbbbbrb Рік тому

    hi if we dont know the last page instead i could see next button on screen for mulitiple data extraction

    • @andersjensenorg
      @andersjensenorg  Рік тому

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 5800+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ua-cam.com/video/xWFz-S96XGo/v-deo.html Kind regards, Anders

  • @mariavlogs327
    @mariavlogs327 8 місяців тому

    Is there a way to do this on a "Load More" button?

    • @andersjensenorg
      @andersjensenorg  8 місяців тому

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 11,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ua-cam.com/video/xWFz-S96XGo/v-deo.html Kind regards, Anders

  • @revanth_kanteerava
    @revanth_kanteerava 7 місяців тому

    I want to extract removing the string : Your answer is correct I tried using below:
    (?

    • @andersjensenorg
      @andersjensenorg  6 місяців тому

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 12,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ua-cam.com/video/xWFz-S96XGo/v-deo.html Kind regards, Anders

  • @hossameldinelsayed2689
    @hossameldinelsayed2689 7 місяців тому

    What if i need a scrapper to run everyday and extract html table, the thing is the page count changes every day, when i am trying the pager option it keeps triggering the next button and ends up with an error failed to extract the data

    • @andersjensenorg
      @andersjensenorg  7 місяців тому

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 12,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ua-cam.com/video/xWFz-S96XGo/v-deo.html Kind regards, Anders

  • @TTtipsforlife
    @TTtipsforlife 3 місяці тому

    hi there, is there a way i can download multiple PDF from a webpage? The challenge is that the PDF changes regularly but luckily on the same web page. I need the automation to be able to dynamically select the new PDF and download. Tried a number of searches but no success. Any support will be much appreciated

    • @andersjensenorg
      @andersjensenorg  Місяць тому

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 14,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ua-cam.com/video/xWFz-S96XGo/v-deo.html Kind regards, Anders

  • @18hourscold87
    @18hourscold87 2 місяці тому

    i have multiple links in excel and i want the power automate to open each link and extract the data

    • @andersjensenorg
      @andersjensenorg  Місяць тому +1

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 13,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ua-cam.com/video/xWFz-S96XGo/v-deo.html Kind regards, Anders

  • @myworshipresources
    @myworshipresources Рік тому

    I want to scrape for the scenario below:
    Scenario: A website has listed 10 articles' titles on each 1/50 pages. The full article can only be viewed when the article's title is clicked which would navigate to the full article page.
    Now, I want to perform this task.
    Step 1: Open the website page 1/50
    Step 2: Scrape the article title 1/10 of page 1/50
    Step 3: Click on the article title 1 to navigate to the full article page
    Step 4: Scrape the whole article from full article view page
    Step 5: Repeat Step 1 - 4 untill all data have been scraped from all 1/50 pages.
    Please solve this. This is very challenging.

    • @andersjensenorg
      @andersjensenorg  Рік тому

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 5800+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ua-cam.com/video/xWFz-S96XGo/v-deo.html Kind regards, Anders

  • @aydika1
    @aydika1 Рік тому

    Had anyone else had a problem that not all of the elements got selected and later transfered into excel? I only have 1 page but only first 21 names got into excel

    • @andersjensenorg
      @andersjensenorg  Рік тому

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 8000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ua-cam.com/video/xWFz-S96XGo/v-deo.html Kind regards, Anders

  • @shaolin60
    @shaolin60 Рік тому +2

    Thank you for [0][0]

  • @bandb1047
    @bandb1047 Рік тому

    please can u see easy way?

    • @andersjensenorg
      @andersjensenorg  11 місяців тому

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 10,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ua-cam.com/video/xWFz-S96XGo/v-deo.html Kind regards, Anders

  • @ALVINMAN452
    @ALVINMAN452 10 місяців тому +1

    Very very important video for we all.
    You should made a video only about REGEX it will be nice .
    Many thanks Anders Jensen .
    Obrigado.
    👍👍👍👍👍👍👍👍👍👍👍

    • @andersjensenorg
      @andersjensenorg  9 місяців тому

      Hey Alvin, thank you so much and RegEx for PAD is on my to-do 😊 Kind regards, Anders