I liked how you explained everything end-to-end. I hope more projects like this will come. Have you scraped any code documentation before? Do you know if there are any ways to automate scraping for code and documentation?
@@erentorlak7522 Scraping fish the API I used would work fine for this - but you would need to parse the HTML coming out. You could use an LLM (a smaller one) to convert the HTML into yaml/json for your use. If you want to do it all yourself then yourself you could use selenium for doing the scraping which uses a local firefox/chrome driver to render locally, then you could use an LLM to extract the information that you need. Good luck - let me know how it goes!
Wow this is such a goldmine of information! I instantly subscribed, looking forward to your next videos!!!
@@franknillard Thanks so much bro!
Great video brother. Easy to understand
So glad you liked it! What kinda stuff are you interested in?
@ww_dot Please make a video on customer support bot. Like Agent will collect information from conversation
@@pycoder8233 ah gotcha - collecting information about the customer? What type of info do you mean?
@@WW_AI_Adventures For example: Amazon shopping bot. Bot should collect Fulle name, Loaction, Issue person facing with the product etc.
I liked how you explained everything end-to-end. I hope more projects like this will come. Have you scraped any code documentation before? Do you know if there are any ways to automate scraping for code and documentation?
@@erentorlak7522 Scraping fish the API I used would work fine for this - but you would need to parse the HTML coming out. You could use an LLM (a smaller one) to convert the HTML into yaml/json for your use.
If you want to do it all yourself then yourself you could use selenium for doing the scraping which uses a local firefox/chrome driver to render locally, then you could use an LLM to extract the information that you need.
Good luck - let me know how it goes!
@@WW_AI_Adventures Thanks !
Very useful and well presented! Pydantic AI?
Yeah I use pydantic for the structured output - I love it.