Django Project Preview: Build a web scraper with Selenium, Celery and more.
Вставка
- Опубліковано 29 вер 2024
- In this video, I talk about a new course/project on JustDjango. We teach how to build an automated web scraper with Django, Selenium, and Celery. There are a lot of technologies being used in this course, making it really good for learners who haven't deployed complex applications.
If you're interested in learning how to build and deploy a project like this, go to:
👉 justdjango.com
✌️ Stay in touch
Facebook: / justdjangocode
Instagram: / justdjangocode
Twitter: / justdjangocode
Email: matt@justdjango.com
Thank you for watching and don't forget to subscribe :)
Amazing! Congratulations! Looking forward to the full course. Thank you so much
Is he going to upload it to yt?
when is this coming out? :D
I love your content please keep going
Hello, is it possible to use extensions in the headless browser?
I really need to use the Tampermonkey extension, but unfortunately headless chrome can't handle extensions ...
Bro... Could you tell me what VSCODE extension you are using.
I really want to know the extension or configuration to have intellisense for Django in VSCODE.
It's cool
I love the tutorials that you make. I've learnt sooo much from this channel! Thank you so much!
I have been looking for something like this but with Scrapy, it seems a bit hard to integrate Django with Scrapy.
Where is this full course???
Where can i get the source code ?
and where the link to your code?! com'n I just spent 20 mins of my time to watch your video
Hi Matthew! Could you please make some tutorials about making appointments (doctor, teachers, whatever) ? There is not a lot of resources on that. Some people recommend to use a package such as django-schedule, but there is not videos or examples on how to implement that.
If you look on stackoverflow or reddit, a lot of begginers like me are facing the same problem.
Thanks for your amazing content!
Yes, wee need that kind of videos
Thanks for your cool videos. Some weeks ago I almost finished a Selenium project but I had trouble deploying it to Heroku or Pythoneverywere because of incompatibilities with chromedriver. I've used Docker and Django before, I don't know how I couldn't come up with this solution.
Thanks again!
buddy where is the tutorial i am waiting
Ready to start 💻 🗺
This is so awesome. The CapRover stuff at the end is a game changer for me. Thank you for taking the time to share this 🙏🏻
hi,, I want to webscrap from my django and webscrapping will take around 30 minutes. How can i Do this ? I dont want to wait user for 30 minutes
Is this course only going to be available on your site by paying regularly 25$ a month (certainly not going to do that!)? Or can I buy it for instance through Udemy? Well, I'd love to see it here on yt ;)
i have one doubt about ReactJs course.I m full stack django developer but i m much curious about React and how it works with django web and i want to do full course on React.if i will do some course on Reactjs and after doing it can i m able to jump to my django project directly to use react or i have to do some other course to use react in my django project?pls suggest it will be appreciable.
i looked your website but i cant see any words "django web scrapy". could you gve me link or more details ths project. actualy i need sample project like this. where am i look ?
Hey bro. You are really awesome. You helped me a lot . I will always be thankful to you. I have a video series request. If you can make videos on making a blog app which have which admin panel would be like wordpress. Actually I was doing that this project .but I am facing some problems. If you can't no problem. You already helped a lot .thank you so much
This is amazing! I have so many issues with celery’s reactor in twisted... waiting for full course)
Hey, I'm following the tutorial on your site and encountered some errors immediately after cloning the project from your github. I wanted to mention what I did to get it running:
1. Moved settings.env into the same folder as settings.py, newsscraper and renamed it '.env'
2. added the line environ.Env.read_env() to settings.py
3. generated my own secret key and added it to the .env file (I guess this is standard practice when cloning a django site)
Bro, can you please add how to build multi-tenant sites? like custoemer.example.com or customer.com > pointed to our Django saas? i would love to learn about it .
Sir, It would be great if you make a video on how to use Django-autocomplete-light 3.5.0 to add a searchable drop-down menu to Django forms via models. Thank you in advance.
That's exactly what I was looking for, I will take this course. Thanks
Sir, can you show how can we add a pdf button in django admin.
That in admin if i have user details, i need to convert them as pdf. can you please show how to do that?
Hi , could you take that in mind and do some tutorials for using vimeo or wistia to upload and retrieve videos for .. like in courses web and lesson videos we need some thing dynamic so we could retrieve each lesson video and render them to our template , really appreciated best django developer ❤️
What about scrapy, can we use that in place of selenium?
Also, as selenium require chrome drive and we need to pass the directory of the installed driver in the code so how we can deploy it?
Hello mentor... will u provide us this series ???? or provide us a tutorial with Django rest framework.
Pleeeeease! Stop deleting your awesome videos! All advanced django series is gone(((((
Check the console network log! Always, always, always! Cannot emphasize it enough. The data is most likely there, commonly in an easily accessed API! In this case, e.g., we can plainly see that on searching, the data is made available by easily following the request: (dev.to/search/feed_content?per_page=60&page=0&search_fields=asdf). It does not get any easier than that! In summation, web scraping very, very rarely actually requires a browser replication tool such as selenium, which is often a huge overhead and waste of time.
This of course does not take away from the usefulness of this tutorial. Thanks JD for taking time to review django packages. Super refreshing after wading through endless "Build a blog" intro starter Django series.
Are you okay just django we haven't heard you verylongtime
Can a video chat app be created using django
thanks a lot for Building this YT channel that is focusing in Django
Sir pls make a playlist on djnago multitanant app
It sounds really nice! I'd like to ask a question: I have a Django project in which I am using web scraping and takes very long time because of the time the source page i am scraping is loaded. It takes almost 1 minute for the view action to finish because of that scraping. Also I have to finish this project in less than 2 weeks.
My question: will this course help me to solve my problem with that big timing?
Did you pay?
Nice. I'm waiting for this
Good day bro
Pls I need some advise, I just completed the basics of python and I understand OOP as well.
But I struggle to solve simple problems on hackerrank for that reason, I don’t know if I can start learning Django or what do you suggest pls ?
yes you can start django, please note that learning algorithms and data structures is a long journey. you will get better by time. start learning django and keep working on you Algo /DS skills.
Don't overthink, start building projects immediately.
hope the best for you.
I agree with @Tito Rat but will also say this; having a good understanding of OOP will help you a lot moving into Django. So I wouldn't be too concerned with algorithms, and rather focus on OOP concepts.
Thanks a lot guys for the response.
I’m Optimistic and excited about the future.
God bless 🙌🏾
Love it
When u give tutorial of this project
This course is available on our website.
😍
Do you sell just this course?
No there are a lot of other courses available with it at learn.justdjango.com
Teacher ~ I just want to ask you something. In case of ReactJS, "debugger;" while coding If you type, the web loading is paused. If you input the name of a specific object in the web console in that state, you can see everything in the object. but in Django, as i know, "debugger;" command doesn't work. is there any way to do that in django?