@@codeRECODE Sir I'm using python and waiting for the next tutorial. Your teaching method is very easy to understand. Please upload the next video of this tutorial series.
Very very very good explanation. You have convinced me to switch to playwright. Scrapy + playwright is a deadly combo and thank you for such a beautiful explanation
Absolutely great videos. I been following along for quite few videos now and am very grateful for your teachings... would definitely be interested on seeing more videos like this. (about scraping dynamics webpages)
I just love your content ❤️ you make it look so simple 😅 I've done no professional course of python yet I'm using scrapy to scrape sites and doing automation just because of your videos I've learnt alot ❤️ thank you and please keep up the good work.
As a user of both Selenium and Playwright at work, I must say Playwright is far superior, much faster, better documentation, and a lot less flaky. Once the Playwright community grows, it will become the industry standard without a doubt.
I've done scraping the contents on the first page and all the next pages but what to do when we need to store the scraped data. Do I need to use another library for that or playwright has inbuilt storing in different format commands??
Would’ve been helpful to mention why someone might use this over selenium, it’s advantages and disadvantages. Saying one is interesting doesn’t explain much. Thanks for the video.
Selenium miss match the time of selectors in headless it is so much easy with playwright and fast.. also we need to use explicit wait in each element find in selenium but in playwright we can simple pass the wait with so much ease... I will definitely go with playwright
I am getting error: It looks like you are using Playwright Sync API inside the asyncio loop. Please use the Async API instead. I tried async calls too but still error. Any idea how to solve this? I am using jupyter notebook.
Web scraping with Go is a good idea. Not sure about Go with Playwright. There is a Playwright for Go - pkg.go.dev/github.com/mxschmitt/playwright-go It's not official though. Officially supported languages are JS, Python, Java and C#
Nice video bro. When installing pip install playwright browser in vscode, i'm getting failed error which says "failed install chromium v100 and unable to get local issuer certificate" in my company laptop. Do you have any suggestion?
I did a google search with your error and this is what I got: 1. Reported here github.com/microsoft/playwright/issues/5636 2. Solution here: playwright.dev/docs/browsers#install-behind-a-firewall-or-a-proxy
Hello Sir, I have watched your Scrapy selenium tutorial and tried to implement the same procedure with Scrapy-Playwright. When I tried to run the script "raise Error( playwright._impl._api_types.Error: It looks like you are using Playwright Sync API inside the asyncio loop. Please use the Async API instead." this error is raised every time. Why this thing is happening? By the way, eagerly waiting for your scrapy playwright tutorial.
Hi how can we do this with playwright or if is it even possible? in Scrapy response.replace(body=webdriver.page_source) using selenium, how can we do this with playwright, i tried response.replace(body=page.content()) but this doesn't work, kindly help!
Why replace the response? You can create a new selector object from scrapy.selector import Selector s = Selector(text=page.content()) s.xpath('').get()
@@sheikhakbar2067 use any vpn. I recommend vyprvpn because it's cheap. VPN is not at browser level but machine level. Once you connect to VPN, all apps including selenium will use VPN
It is complex. You need to know how websites work and then every website has it's own challenge :-) You need to spend time to learn, or hire someone else to do that for you!
My system does not show browser even if i have set timeout to page.wait_for_timeout(50000) simply terminal shows [Done] exited with code=0 in 0.175 seconds, headless=False
Run this and see if this works - github.com/coderecode-com/playwright_sync_api_intro/blob/main/quotes.py If this doesn't work, try another browser. For example, for firefox, change line 6 to the following ``` browser = p.firefox.launch(headless=False) ```
![Code [RE] Code](http://yt3.ggpht.com/egxpMo3Rdbr2eIHscL0XaiaA5WXvlZtQ9AADpLW-dPSCaO8QBzvjog4dQKpO61T_B3q2iZcCyA=s48-c-k-c0x00ffffff-no-rj)
![⚡The Fastest Python Linter for PLAYWRIGHT + PYTHON [Ruff]](/img/n.gif)
I just recently switched to playwright from selenium and I must say I am impressed, I vote for more playwright videos please 😁
Happy to hear that! So you are using Python OR JS?
@@codeRECODE Sir I'm using python and waiting for the next tutorial. Your teaching method is very easy to understand. Please upload the next video of this tutorial series.
@@Pylogicx Thank you :-)
Uploading one today.
Very quick and clear. Going to now watch your scrapy+playwright video. I'm glad I found your channel.
Awesome, thank you!
Thank you for the initiative.
It was a really great hands-on session.
Would request you to make a playlist on Playwright.
Yes, I need to get to it soon. Thanks for sharing your interest :-)
Very very very good explanation. You have convinced me to switch to playwright. Scrapy + playwright is a deadly combo and thank you for such a beautiful explanation
Great to hear!
Concise video. Thanks. Please do more in-depth web scraping project videos.
Absolutely great videos. I been following along for quite few videos now and am very grateful for your teachings... would definitely be interested on seeing more videos like this. (about scraping dynamics webpages)
Yeah, it's looking very interesting.
Waiting for more detail videos on playwright.
More to come soon.
Loved the video!
Please make this a series🙏
I am seriously considering this. Thanks for the feedback 🙂
I just love your content ❤️ you make it look so simple 😅 I've done no professional course of python yet I'm using scrapy to scrape sites and doing automation just because of your videos I've learnt alot ❤️ thank you and please keep up the good work.
Thank you so much for your kind words. This is exactly why I make these videos. 🙂
@@codeRECODE please if possible create some tutorials for scrapy and playeright together.
🔥🔥🔥🔥🔥🔥 so easy and fast. Great video. I would love to see more in depth videos about playwright from you.
Noted!
great tutorial - thanks for demonstrating the different selector choices
Glad it was helpful!
Nice tutorial. Expecting more videos in playwright-python series.
Wonder and great teaching. I want from beginer level playwright with java videos
Interesting! Good to see interest in Java 😃
Love to see new content
Can you guide on how we can use playwright with scrappy?
Will post this soon 🙂
We want more videos on playwright. Also a video on Why playwright is better than selenium
thanks, will give playwright a try today...
Best of luck!
This is an awesome! new subscriber here!😃
As a user of both Selenium and Playwright at work, I must say Playwright is far superior, much faster, better documentation, and a lot less flaky. Once the Playwright community grows, it will become the industry standard without a doubt.
I've done scraping the contents on the first page and all the next pages but what to do when we need to store the scraped data. Do I need to use another library for that or playwright has inbuilt storing in different format commands??
Use usual python libraries like csv, etc.
Would’ve been helpful to mention why someone might use this over selenium, it’s advantages and disadvantages. Saying one is interesting doesn’t explain much. Thanks for the video.
Great point! I will post another video with a detailed comparison.
Hope it will be a good Selenium alternative. Thanks for this addition.💖
This is definitely a good alternative, especially for those who don't know JS and for those who need multiple Browsers support.
Thank you for the video. Maybe be you can try the scrapy-playwright package.
Sure.
i see that ti has been 4 months withouth a new video in the list..will you continue this list? its a goog one , thanks
Yeah! I do plan to continue this. Thanks for the reminder :-)
Great Video Sir🙏
Thank you 🙂
Can we see more website interactions, it is much more interesting 👌 want to learn more about it 🙏
Sure. More videos coming up soon
Selenium miss match the time of selectors in headless it is so much easy with playwright and fast.. also we need to use explicit wait in each element find in selenium but in playwright we can simple pass the wait with so much ease... I will definitely go with playwright
True!
I am getting error:
It looks like you are using Playwright Sync API inside the asyncio loop.
Please use the Async API instead.
I tried async calls too but still error. Any idea how to solve this? I am using jupyter notebook.
how to find multiple elements using python? which locator or selector should i need?
A selector matches all elements - so if the selector is div.alert it will match all divs that have this class.
Great video. Could you make a Go version of this video please?
Web scraping with Go is a good idea. Not sure about Go with Playwright.
There is a Playwright for Go - pkg.go.dev/github.com/mxschmitt/playwright-go
It's not official though. Officially supported languages are JS, Python, Java and C#
@@codeRECODE I was able to start using Playwright with Go by translating your Python code to Go.
Please make more videos on python playwright
Sir please make more videos on scrapy playwright Thanks !
Sure I will
great sir... waiting for next video
Very Soon.
What are the benefits of Playwright over Selenium?
Playwright is much faster than selenium. That's the most important point. I will post another video with detailed comparison.
Thanks for the great video !
Glad you liked it!
Nice video bro. When installing pip install playwright browser in vscode, i'm getting failed error which says "failed install chromium v100 and unable to get local issuer certificate" in my company laptop. Do you have any suggestion?
I did a google search with your error and this is what I got:
1. Reported here github.com/microsoft/playwright/issues/5636
2. Solution here: playwright.dev/docs/browsers#install-behind-a-firewall-or-a-proxy
How can I export to playwright exe pyinstaller does not work
Hello Sir,
I have watched your Scrapy selenium tutorial and tried to implement the same procedure with Scrapy-Playwright. When I tried to run the script "raise Error(
playwright._impl._api_types.Error: It looks like you are using Playwright Sync API inside the asyncio loop.
Please use the Async API instead." this error is raised every time. Why this thing is happening?
By the way, eagerly waiting for your scrapy playwright tutorial.
The error is obvious but I did not cover async API. Will create a video on async api to help you understand the concept.
@@codeRECODE sir waiting for your video on that. I am badly stuck here.
Hi how can we do this with playwright or if is it even possible? in Scrapy response.replace(body=webdriver.page_source) using selenium, how can we do this with playwright, i tried response.replace(body=page.content()) but this doesn't work, kindly help!
Why replace the response? You can create a new selector object
from scrapy.selector import Selector
s = Selector(text=page.content())
s.xpath('').get()
very good tutorial :)
How to click on "logout"? it doesn't look like button in html although it is. I am confused with that
Hey! Somehow missed your comment. Are you asking about the website in this video or something else?
if this is on Window O/S, can it use Webkit??
Yes
Somehow missed replying to this. Yes, webkit does work on Windows.
Can you try next a tutorial on Playwright with Scrapy?
Thanks for the specific suggestion.
Yes, I have more tutorials planned around this subject.
I think Selenium is still interesting enough because i can use VPN and proxy at the same time to scrape any sites i want
Hi, could you direct me to a tutorial explaining how to use VPN with Selenium? I am scraping a website that's blocked in my country! 🙁
Proxies can be used with Playwright. VPN would be at OS level. The biggest win for Selenium is the community support.
@@sheikhakbar2067 use any vpn. I recommend vyprvpn because it's cheap.
VPN is not at browser level but machine level. Once you connect to VPN, all apps including selenium will use VPN
@@sheikhakbar2067 www.vyprvpn.com/buy-vpn
Less than 2$ a month if you take long term plan.
Selenium is like Vikram Rathore from Jawaan
🙂
which theme are you running on vs code ?
Monokai Contrast with colors further customized in Settings
Why does webscraping look so complex?
I don't understand a thing.
It is complex. You need to know how websites work and then every website has it's own challenge :-)
You need to spend time to learn, or hire someone else to do that for you!
More
Definitely! More to come soon 🙂
My system does not show browser even if i have set timeout to page.wait_for_timeout(50000) simply terminal shows [Done] exited with code=0 in 0.175 seconds, headless=False
Run this and see if this works - github.com/coderecode-com/playwright_sync_api_intro/blob/main/quotes.py
If this doesn't work, try another browser. For example, for firefox, change line 6 to the following
```
browser = p.firefox.launch(headless=False)
```