The 3rd UC Mode video tutorial is now on UA-cam: ua-cam.com/video/-EpZlhGWo9k/v-deo.html (Contains lots of important updates due to changes in CAPTCHAs and handling them.)
Love You Alott.. you save my lot of time. i was facing this issue from many days and your video was just show up and save my lot of time. thanks a lot please don't stop and keep up your work sir. Love from Pakistan
Love your work! Would be cool to have a module that sets the geolocation based off the IP. This would be really useful with those using residential rotating proxies.
Hello Michael, Thank you for the amazing work, just one small note: UC mode works fine in MacOS but linux (ubuntu) it doesn't bypass cloudflare bot checks , I tested it today
Are you using a Linux machine on a shared IP Address space, such as AWS, GCP, Azure, GH Actions, etc? Those IP ranges have already been identified as non-human web traffic, so you'll get blocked for using them unless you connect to a proxy server. I've tested on regular Linux (Ubuntu), and it's working successfully with the correct configuration.
Hello Michael... I just want to use a proxy with seleniumbase. But in the Driver object there is no keyword called 'options'.. So how do I add proxies here? Please reply
Hi Michael. I have been using your SeleniumBase and I think that your work is superb, thank you for all your hard work. As my Github account can't open issue or comment on your Github, which is weird for me, so I want to ask my question here. I currently using UC mode and i have successfully import the extension. But the extension need to click on the extension icon in the chrome taskbar to active the extension and I want to use SeleniumBase on headless mode. Is there any possible fix for this? ( I know that I can simply make a find element and click, but is there any other way or should it be implement to the SB code? ). Also, I want to export the website content to json, is that possible? Sorry but I'm a new guy to this, hope my questions aren't too stupid. Thank you.
Hey Michael, do u have any tips for bypassing cloudfare turnstile? as weird as it might sound im trying to checkout in some web shop by the help of a script. The button on the web shop used for going to the checkout screen is protected by cloudfare turnstile does seleniumbase avoid this problem already?
That's what SeleniumBase UC Mode is for. Read the docs: github.com/seleniumbase/SeleniumBase/blob/master/help_docs/uc_mode.md (The examples in GitHub are kept up-to-date.)
I cannot explain how useful your work is. Both the software and the videos. I love your video style and way of thinking. I hope you don't stop making useful bypasses 🫡
there is only one frame after switching to that I applied sb.driver.uc_click("span.mark") but this element is not existing there. for finding the element i gone through the page source but can't find. please help
The Cloudflare Turnstile checkbox selector changed from `span.mark` to just `span`. I mentioned that in the description, and also here: github.com/seleniumbase/SeleniumBase/issues/2766
This is amazing. Thank you :) Short question, I'm trying to create a browser automation using the --uc mode. The automation is via a website that requires 2FA. Now, assuming I don't want to cancel the 2FA. How would you approach this?
The automation can enter the 2FA code using the pyotp library that’s included in SeleniumBase methods. Example: github.com/seleniumbase/SeleniumBase/blob/master/examples/test_mfa_login.py
It's a lot easier to bypass CAPTCHAs with Selenium. Selenium includes the built-in method: "driver.service.stop()", which prevents websites from detecting Selenium until the service has been brought back up. 18:26
Hi Michael, thanks for the great software! I have a question related to how we can save cookies and load them. Is it the same way as the original Selenium? Thanks!
Hello. I started adding subtitles to my past videos. UC Mode Video 3 has them now: ua-cam.com/video/-EpZlhGWo9k/v-deo.html (Other videos like this one will have them soon.)
I used this "sb.switch_to_frame('[title*="challenge"]') sb.click("span")" and it clicked and solved the captcha and started verify but just before completing of verification again asked for to click on the captcha. What to do??
Really appreciate Your guidance. scraping data from a infinitely scrolling page with XHR available in network tab using selenium-wire. But with cdp I am not sure the data is showing up.
The 3rd UC Mode video tutorial is now on UA-cam: ua-cam.com/video/-EpZlhGWo9k/v-deo.html (Contains lots of important updates due to changes in CAPTCHAs and handling them.)
You are doing great work man.... would like to contribute to this repo sometime in future may be....great work man
I love this. Thank you so much for your time and effort. We are lucky to have you! Also... I love the humor.
you really saved my butt with this. I was afraid the API wasnt compatible with vanilla Selenium, but it is. Life saver.
Once again, amazing job! I always enjoy watching your videos, I learn something new every time! The video clips are fun! Thanks for sharing! 😎
SeleniumBase and UC mode makes web scraping fun again ( and you look good on the job! ). Thank you Michael!
Thank for amazing work! SeleniumBase is the most powerful and comprehensive framework I have ever used.
I’m your 1,000th subscriber. Thanks for all your dedication and hard work!
Stand by us against the giant organizations! Thank you, genius!
Educative and fun video as usual :)
Thanks again for all thoses tips, really useful !!!
Bro, crazy work, completely amazed
Love You Alott.. you save my lot of time. i was facing this issue from many days and your video was just show up and save my lot of time. thanks a lot please don't stop and keep up your work sir. Love from Pakistan
Love your work!
Would be cool to have a module that sets the geolocation based off the IP. This would be really useful with those using residential rotating proxies.
^ I think this combined with a mixed device fingerprint user agent would largely outsmart Google
Something with mouse / device touch & scrolling would also make it look more human.
Excellent! Great content, explanation is exceptional! Keep it up!
Well done! Thank for all the hard work!
Hello Michael, Thank you for the amazing work, just one small note: UC mode works fine in MacOS but linux (ubuntu) it doesn't bypass cloudflare bot checks , I tested it today
Are you using a Linux machine on a shared IP Address space, such as AWS, GCP, Azure, GH Actions, etc? Those IP ranges have already been identified as non-human web traffic, so you'll get blocked for using them unless you connect to a proxy server. I've tested on regular Linux (Ubuntu), and it's working successfully with the correct configuration.
I can't add an extension with extension_zip when UC mode is enabled... Does someone has a solution ?
Must be unzipped to a folder first and added via `extension_dir`. See github.com/seleniumbase/SeleniumBase/discussions/2763#discussioncomment-9385078
@@MichaelMintz Thank you very much, it works fine 🙏
I'm definitely entertained!
Hello Michael...
I just want to use a proxy with seleniumbase. But in the Driver object there is no keyword called 'options'.. So how do I add proxies here?
Please reply
Use the `proxy` arg. `user:pass@ip:port` or `ip:port`.
Hi Michael. I have been using your SeleniumBase and I think that your work is superb, thank you for all your hard work. As my Github account can't open issue or comment on your Github, which is weird for me, so I want to ask my question here. I currently using UC mode and i have successfully import the extension. But the extension need to click on the extension icon in the chrome taskbar to active the extension and I want to use SeleniumBase on headless mode. Is there any possible fix for this? ( I know that I can simply make a find element and click, but is there any other way or should it be implement to the SB code? ). Also, I want to export the website content to json, is that possible? Sorry but I'm a new guy to this, hope my questions aren't too stupid. Thank you.
UC Mode won’t work in Headless Mode. You can use BeautifulSoup to parse things from the page source.
Hey Michael, do u have any tips for bypassing cloudfare turnstile? as weird as it might sound im trying to checkout in some web shop by the help of a script. The button on the web shop used for going to the checkout screen is protected by cloudfare turnstile
does seleniumbase avoid this problem already?
That's what SeleniumBase UC Mode is for. Read the docs: github.com/seleniumbase/SeleniumBase/blob/master/help_docs/uc_mode.md (The examples in GitHub are kept up-to-date.)
Man You Are Amazing !!! Really You are an amazing
You're such a cool dude! I wish could do what you do and be that chilled! Good Vibes \m__
Michael, thank you so much! SeleniumBase is really good. I've used it for several months.
I cannot explain how useful your work is. Both the software and the videos. I love your video style and way of thinking. I hope you don't stop making useful bypasses 🫡
there is only one frame after switching to that I applied sb.driver.uc_click("span.mark") but this element is not existing there. for finding the element i gone through the page source but can't find. please help
The Cloudflare Turnstile checkbox selector changed from `span.mark` to just `span`. I mentioned that in the description, and also here: github.com/seleniumbase/SeleniumBase/issues/2766
@@MichaelMintz ya i tried this and as you said span is visible but for clicking I got the error " ElementClickInterceptedException"
This is amazing.
Thank you :)
Short question,
I'm trying to create a browser automation using the --uc mode.
The automation is via a website that requires 2FA.
Now, assuming I don't want to cancel the 2FA.
How would you approach this?
The automation can enter the 2FA code using the pyotp library that’s included in SeleniumBase methods. Example: github.com/seleniumbase/SeleniumBase/blob/master/examples/test_mfa_login.py
Also, upgrade to 4.28.3 or newer if using Windows. (4.28.2 had a Windows bug)
@@MichaelMintz awesome. thanks
why did you choose selenium over playwright for example ? thanks
It's a lot easier to bypass CAPTCHAs with Selenium. Selenium includes the built-in method: "driver.service.stop()", which prevents websites from detecting Selenium until the service has been brought back up. 18:26
@@MichaelMintz ok thanks a lot, I'll try to convert the playwright code to selenium then 😀 with the help of chatgpt maybe ❤️
love it! thanks. but the clips are sometimes too long. btw, how do you that circle magnifying glass thing? looks cool.
The magnifying glass comes from the Logitech Spotlight Presentation Remote.
Hi Michael, thanks for the great software! I have a question related to how we can save cookies and load them. Is it the same way as the original Selenium? Thanks!
github.com/seleniumbase/SeleniumBase/discussions/2705#discussioncomment-9176117
@@MichaelMintz Awesome stuff Subbed!
how can i use proxies with auth please
Set the `proxy` arg. Format: "USER:PASS@SERVER:PORT"
AMAZING!
How does it handle cookies that need to be set on the domain like lax or strict mode?
There's a section on that: github.com/seleniumbase/SeleniumBase/discussions/2705#discussioncomment-9176117
Thank you !!! Great job 👍, thank you again . What about tutorial how manage working process of test execution in some program like a Jenkins .
The Jenkins tutorial will probably come in another video later. Stay tuned!
thank you sir, but i really want to show us how to bypass google recaptcha next time !
github.com/seleniumbase/SeleniumBase/issues/2755#issuecomment-2096803883
the humour is actually good ngl xD
pyautogui could be a solution for local systems but what about running in baremetal server??
You're the GOAT
Did work with minimize window?
UC Mode needs a regular window.
love the work youre doing but TBH, the clips are on the heavy side. could definitely tone them down a bit
Dear Boston boy, why are there no subtitles
Hello. I started adding subtitles to my past videos. UC Mode Video 3 has them now: ua-cam.com/video/-EpZlhGWo9k/v-deo.html (Other videos like this one will have them soon.)
I used this "sb.switch_to_frame('[title*="challenge"]')
sb.click("span")" and it clicked and solved the captcha and started verify but just before completing of verification again asked for to click on the captcha. What to do??
where is 18:45 from? ai?
I personally selected all video clips from things I've watched before. That one is from Star Trek: The Next Generation: "The Next Phase".
Hello,I need a way to implement wire and undetected together.
Guys who want it please Give a like.
github.com/seleniumbase/SeleniumBase/issues/2145
Really appreciate Your guidance.
scraping data from a infinitely scrolling page with XHR available in network tab using selenium-wire.
But with cdp I am not sure the data is showing up.
CDP-specific info can be found in the CDP Docs, such as chromedevtools.github.io/devtools-protocol/tot/Network/#event-requestWillBeSentExtraInfo
Thanks Mate. Will give it a try.
Thanks alot
that's freakin awesome , could it be possible one day doing that with playwright
Playwright currently doesn't allow people to bypass CAPTCHAs: github.com/microsoft/playwright/issues/23884#issuecomment-1606877360
@@MichaelMintz I know there is a stealth mode like pupeteer but not if it's up to date
The clips make me lose my concentration. By the time a clip is done, i forgot what I learned before it. 😢
how do i make a bot that skips offtopic content in a video? lmao joking
hi how can i contact you