You need not write a callback function to wait the page. There is a waitfor function in which you can pass miliseconds to wait the page. Like - page.waitFor(5000) Then it wait for 5 sec. Before close the browser.
thank you, sir, apse Mai bahut inspire Hua hu, main web development chorna chahta tha, apke videos dekh karke bahut kuch sikhnane aur janne ko milta hai, thanks you for teaching us. love from Chhattisgarh😘😘
Don't try to web scrap popular websites(fb, twitter, LinkedIn). They'll ban your ip and you can even get into trouble for scraping data. Scraping comes with a lot of risk. And there is nothing to worry about scraping publicly available data on the internet or from websites not configured properly.
Great tutorial. I like the way you demonstrate the flexibility of puppeteer and explain the documentation. I actually have a running start on how to scrape web pages in JS. Way more dynamic than python scraping. Thanks!
Its crisp video I loved,it will be great if architecture is explained along with how it works which already explained beautifully Thank you very much Could you please take CodeceptJS as next topic
Hey @Hitesh Choudhary, nice tutorial! Got stuck, how do I do this - 1. Open a webpage (you see list of items) 2. Click an item - you go inside item detail page 3. Extract data from the detail page (like name, desc, images...) 4. Now store all this data as a markdown file (.md) with the item name as the file name 5. Repeat the same for 300+ items P.S. the class names are complex(with weird names and numbers). How do I use the same with XPATH? Thanks in advance!
Hey Hitesh, the video is slightly down (noisy, to be precise). May be camera settings are not good. Have a look. And apart from that, the content is on the infinite quality. Thanks for this great work!!!
i'm having some issues. first off all: "throw new errors.TypeError('ERR_INVALID_ARG_TYPE', 'original', 'function');" TypeError [ERR_INVALID_ARG_TYPE]: The "original" argument must be of type function
I'm curious how to set multiple threads (browsers) in Puppeteer Stealth. Also how do I load resources as variables so i can fill out sign up forms with those variables?
Can we make some file manager with it , that copy and move file to certain folder when our work done. I think that's interesting and useful for small automation projects too.
Hey Hitesh I saw your UA-cam video about Web automation in python for beginners. It was very interesting but what I want to do is open windows clicking a link then clicking for a specific item and every time I click that link the item is in another spot so I might even have to go to the next page to find it. I do this a lot but it’s a lot of work, if you could show me how to automate it that would be awesome!
Dear sir, is puppeteer good or selenium is good for web automation / web scrapping? Please reply to my question. I did not listen selenium in your videos. I have listen lot of your videos.
Awesome. I request you do deep webscraping with this and save that to database please. That's my request for next video . Thank you Sir and it's always great stuff from you
Please anybody can help,, for example i have login to a website thant shows certain data in javascript tabel,, ini the dropdownlist menu,, there are only three option of number of showing data, which are 10, 50, and 100. How to for example i want to show all the data not only 100 data. But all the data that i search with certain criteria. Thanks
im stuck at the first bit, i run the code for getting a snapshot of wiki but it just says Error: Cannot find module 'puppeteer' EDIT: NVM im an idiot and installed puppeteer core instead of of puppeteer
Well it's funny that I am watching this video at 3 am after trying multiple applications that actually didn't work. All I need is to automate several actions, I have tried iMacros, CAB and UI.Automation, maybe I'm just too stupid to use them properly lol. So, I have a question. I have a web page, I need to copy the information from one field (it doesn't look like a field, just one or two words) to another field, I have thousands of such pages (every time I need to copy and paste different information) and I want to automate these actions, because they are very time consuming. Maybe you can recommend me a good tutorial based on JS? I am have 0 coding skills, about 2 years ago I just tried to learn something in JS lol.
If you create an application with this code, will it not be really weird for a user to see some browser open and close very quickly? It is headless, but I think users will notice something happening?
I have used puppeteer to generate PDF in node js for my college project . It's really nice to work with.
I love coding and You helped me to fall in love with coding.
Bro, he is an example of a true teacher!!! (DRONACHARYA)
Make more video on Automation Testing
me also
Usage examples:
> Array.from(document.querySelectorAll('.mw-headline')).map( h => h.innerText);
> [...document.querySelectorAll('.mw-headline')].map( h => h.innerText);
what is the name of the outro song
Need to learn more of this stuff. 99.99% of my job can literally be automated.
You need not write a callback function to wait the page. There is a waitfor function in which you can pass miliseconds to wait the page.
Like - page.waitFor(5000)
Then it wait for 5 sec. Before close the browser.
Thanks
@@HiteshCodeLab or you can just remove browser close function
Nice introduction!
10:55 doing $$(".mw-headline").map(h => h.innerText) can get you there quicker.
Wow -- that sample wikipedia page aged pretty well.
lol for real !
आपका बहुत बहुत धन्यवाद ,हितेश जी वीडियो बनाने के लिए।
Wow covid19 in feb 2020 - def look more into this - wise words, wish more people did this one year ago !!!
thank you, sir, apse Mai bahut inspire Hua hu, main web development chorna chahta tha, apke videos dekh karke bahut kuch sikhnane aur janne ko milta hai, thanks you for teaching us. love from Chhattisgarh😘😘
Don't try to web scrap popular websites(fb, twitter, LinkedIn). They'll ban your ip and you can even get into trouble for scraping data. Scraping comes with a lot of risk. And there is nothing to worry about scraping publicly available data on the internet or from websites not configured properly.
Thanks for valuable information.
@@HiteshCodeLab :)
Very Good to hear automation related stuff through you.. Hitesh garu .. Keep posting..
Lovely content
A small trick for youtubers: go to the end of the video and play restart to avoid ads.
And yeah "You are welcome" 😅😜
just use a adblocker instead and what's the name of the outro song
This guy won't get any revenue tho :(
Great tutorial. I like the way you demonstrate the flexibility of puppeteer and explain the documentation. I actually have a running start on how to scrape web pages in JS. Way more dynamic than python scraping. Thanks!
For sure more videos on Puppeteer.
That was great tutorial you don’t need to be criticise yourself your doing great!
Which theme are you using in VS code?
Its crisp video I loved,it will be great if architecture is explained along with how it works which already explained beautifully Thank you very much
Could you please take CodeceptJS as next topic
Yes please create series on Puppeteer. Will be waiting for same.
Please continue your videos with web automation
Woah, today I decided to learn puppeteer and was going through docs, and guess what, your video notification pops up. Jinx
That explanation was rlly great
Ahh, good ole Corona in February 2020. Good times, good times.
Yes I want more video like this.
This was an amazing video.
You did an amazing job!
Thank you Hitesh, very helpful!
Which vscode theme are you using ?
Same thing i need to know
I have used puppeteer for my eCommerce website scraping project. It is an amazing library.❤️
More such videos sir please
I want more videos on JavaScript and NodeJs.
Hey @Hitesh Choudhary, nice tutorial!
Got stuck, how do I do this -
1. Open a webpage (you see list of items)
2. Click an item - you go inside item detail page
3. Extract data from the detail page (like name, desc, images...)
4. Now store all this data as a markdown file (.md) with the item name as the file name
5. Repeat the same for 300+ items
P.S. the class names are complex(with weird names and numbers). How do I use the same with XPATH?
Thanks in advance!
You're really a great teacher!
Thanks for your presentation about puppeteer, please make more videos on the same
Hey Hitesh, the video is slightly down (noisy, to be precise). May be camera settings are not good. Have a look. And apart from that, the content is on the infinite quality. Thanks for this great work!!!
Thanks for comment. Can you please let me know the time of noise.
Is it in screen recording part or intro part.
I will surely fix it
@@HiteshCodeLab The screen recording is a bit blurry & the Normal full screen video (intro) have a little bit of noise.
@@HiteshCodeLab i just realized that, there's no quality down noticed in mobile view, but when we switch to 1080p monitor it seems to be as described.
Informative video.thanks for sharing
Awesome! Thanks very much.
You're the best!!! thank you thank you thank you!!
Video on integrating payment gateway in the website
i'm having some issues.
first off all: "throw new errors.TypeError('ERR_INVALID_ARG_TYPE', 'original', 'function');"
TypeError [ERR_INVALID_ARG_TYPE]: The "original" argument must be of type function
please help
Amazing.. Please make more such videos
1-Web scraping is illegal?
2-puppeteer is written (made) in pure JavaScript code? or it's written in other languages like python?
Great tutorial! Thank you.
Thanks for this video. Help me much. Keep it up man
nice one, but why didnt you use selenium, here, since it is popular for automation. which one is better "puppeter" or "selenium"
I'm curious how to set multiple threads (browsers) in Puppeteer Stealth. Also how do I load resources as variables so i can fill out sign up forms with those variables?
Can we make some file manager with it , that copy and move file to certain folder when our work done. I think that's interesting and useful for small automation projects too.
amazing explanation
I run it and the screenshot is not working, i coped exactly what you did, i am just learning node and puppeteer, and would like help?
I really enjoyed your lesson 😊🙏
Is it possible to check data from server by Jest and Puppeteer ?
Hey Hitesh I saw your UA-cam video about Web automation in python for beginners. It was very interesting but what I want to do is open windows clicking a link then clicking for a specific item and every time I click that link the item is in another spot so I might even have to go to the next page to find it. I do this a lot but it’s a lot of work, if you could show me how to automate it that would be awesome!
Yes.. More videos on Web Automation are welcome.
Nice video. love from Bangladesh
Dear sir, is puppeteer good or selenium is good for web automation / web scrapping? Please reply to my question. I did not listen selenium in your videos. I have listen lot of your videos.
Awesome. I request you do deep webscraping with this and save that to database please. That's my request for next video . Thank you Sir and it's always great stuff from you
if we will delete whole folder i-e youtubefun then we will install puppeteer again?
Thank you very much! this video summerized the Puppeteer idea for a beginner.
for each new project we will have to write npm init -y
and npm install puppeteer for once?
nice job bhai
is there a way to access that page variable from another function?
Sir, please make full course on AngularJs.
How much node do you have to know to make full use of Puppeteer?
yes plz make more videos on it
Nice
Please anybody can help,, for example i have login to a website thant shows certain data in javascript tabel,, ini the dropdownlist menu,, there are only three option of number of showing data, which are 10, 50, and 100. How to for example i want to show all the data not only 100 data. But all the data that i search with certain criteria. Thanks
Sir do u have Playlist for this?pls provide link of this series
Amazing👍🏻😍
Love from Nepal❤
Hey Hitesh, please make a video on ML using JavaScript.
Please do open and search youtube channel using puppeteer like u did using selenium.
How can you run that from the browser?
Thanks for the video. Is it possible to automate reading of browser bookmarks???????
How do I pass this information to an HTML page to display?
Hey dude! Please mention that vs code theme and font
It's horrible
Thank you excellent video!
Which theme u r using ?
What theme are u using in vs code
im stuck at the first bit, i run the code for getting a snapshot of wiki but it just says Error: Cannot find module 'puppeteer'
EDIT: NVM im an idiot and installed puppeteer core instead of of puppeteer
Yeah Definitely web scraping. Thanks
Do more python automation projects and web scraping using python with stocks
Can I login in any website using curl???
please need videos for login and registration page with puppeteer automation
is there any library like this in PHP?
Can you do a tutorial to use puppeteer to scrape data from a password protected page
We want more videos on automation
Sir can I use selenium in JavaScript as I want the use of x path
Fantastic Sir !!!!
Please do a video on Socket.io with NodeJs
Please make a video on tenserflow
With this tool i can Make thinks similar like in jmeter?
Sir I was looking forward for this kind of video.. your way of explaining is very easy to grasp
Can I use puppeteer for my backend server?
Sir please guide more on Web automation using JS
I want to know that what are the career opportunities in puppeteer?.
Well it's funny that I am watching this video at 3 am after trying multiple applications that actually didn't work. All I need is to automate several actions, I have tried iMacros, CAB and UI.Automation, maybe I'm just too stupid to use them properly lol. So, I have a question. I have a web page, I need to copy the information from one field (it doesn't look like a field, just one or two words) to another field, I have thousands of such pages (every time I need to copy and paste different information) and I want to automate these actions, because they are very time consuming. Maybe you can recommend me a good tutorial based on JS? I am have 0 coding skills, about 2 years ago I just tried to learn something in JS lol.
when i take Screen short i get it as this web site currently not available in your region
I am getting an error saying that chrome is being controlled by an automated software, can someone please help me out
Sir, Thanks for this video, How can we auto fill captcha using same tech stack????
Great video.👍🏻
If possible then More videos for automation please 🙂
If you create an application with this code, will it not be really weird for a user to see some browser open and close very quickly? It is headless, but I think users will notice something happening?
do you know what headless means?
Love from Egypt 💗❤💗
please make more video on that