Scraping Dark Web Sites with Python

Поділитися
Вставка
  • Опубліковано 21 лис 2024

КОМЕНТАРІ •

  • @xp__d4600
    @xp__d4600 7 місяців тому +33

    Respect ngl, this man took his full setup to a hotel across a long trip just to make this video available for us.

    • @kyleheaney3734
      @kyleheaney3734 7 місяців тому +5

      His full setup equalling a laptop and microphone?

    • @xp__d4600
      @xp__d4600 7 місяців тому +1

      @@kyleheaney3734 laptop, mouse, microphone, camera

    • @randommofo123
      @randommofo123 5 місяців тому

      Id imagine he didn't want to do this on his own wifi lol

  • @home1250
    @home1250 7 місяців тому +8

    By far my favorite channel for authentically practical guidance
    Thank you .

  • @MarkParkTech
    @MarkParkTech 7 місяців тому +26

    You shouldn't recommend torpy since it only supports v2 addresses... which haven't been supported on tor since July of 2021, and they haven't had a new commit in 3 years. Essentially, torpy will not or should not work with tor anymore and until they start updating the project ( unlikely ) or someone forks it, it shouldn't be promoted.

    • @samswag7243
      @samswag7243 7 місяців тому +4

      Damn 2021 was 3 years ago

  • @Sam_Bent
    @Sam_Bent 7 місяців тому +59

    (Here from linkedin btw) This is badass. Great work on the video, seriously.
    Definitely work that subscribe (I already was), and a thumbs up!!!! 👍👍

    • @GreatAllen-p4m
      @GreatAllen-p4m 7 місяців тому +3

      collab w bro

    • @Sam_Bent
      @Sam_Bent 7 місяців тому

      I'd love to. Dudes a legend. @@GreatAllen-p4m

    • @Indra-bc9xn
      @Indra-bc9xn 7 місяців тому

      @@GreatAllen-p4m dp

  • @netizenwatch
    @netizenwatch 7 місяців тому +13

    This is an amazing video, and the hotel room was the perfect fit for a darkweb video. 🙌🙌

  • @DBonacich
    @DBonacich 5 місяців тому +1

    Hey John, not sure if anyone's told you this recently, but... you're awesome. That is all.

  • @DouweHummeling
    @DouweHummeling 7 місяців тому +178

    Here, have a like for the hotelroom video.

    • @pa32779
      @pa32779 7 місяців тому +4

      Dislike button ⬇️

  • @dadamnmayne
    @dadamnmayne 7 місяців тому +8

    sponsor transition smooth, on point and relevant

    • @neutrino2211_
      @neutrino2211_ 7 місяців тому

      Had this on my second screen. There was a Sponsor?!

    • @dadamnmayne
      @dadamnmayne 7 місяців тому

      @@neutrino2211_ mans becoming a smooth operator

  • @GeorgeAlexanderTrebek
    @GeorgeAlexanderTrebek 7 місяців тому +1

    More videos like this! This is extremely useful and really applicable to many things. Love basic concepts that can be applied to many things.

  • @User-o5l2w
    @User-o5l2w 7 місяців тому +1

    This dude is a genius.

  • @Crysal
    @Crysal 7 місяців тому +4

    All you ever need it a for loop and curl

  • @AB-nv6fh
    @AB-nv6fh 7 місяців тому

    Amazing vid u could use libraries aswell like selenium or beautifulsoap

  • @khanabdulmuhammad5625
    @khanabdulmuhammad5625 7 місяців тому +40

    00:04 Automating web scraping of dark web sites using Tor
    02:15 Enabling control port and authentication methods for security.
    04:24 Monitoring dark web for security threats and data exposure
    06:32 Scraping dark web sites can provide valuable information for businesses and individuals.
    08:35 Using Python to scrape dark web sites
    10:47 Accessing dark web sites using Python Requests library.
    13:00 Exploring a ransomware gang's exit scam and law enforcement operation on a dark web site.
    14:57 Scraping Dark Web Sites with Python
    16:52 Configuring control Port for authentication and IP manipulation
    18:37 Explore dark web marketplaces for insights.

    • @KwiatekMiki
      @KwiatekMiki 7 місяців тому +3

      Did you use some sort of website or an AI to write this? It's weird that you did it in around 3 minutes for a 19:28 minute video.

    • @NyaryanUwUrrior
      @NyaryanUwUrrior 7 місяців тому +2

      ​@@KwiatekMikiObviously.

    • @khanabdulmuhammad5625
      @khanabdulmuhammad5625 7 місяців тому +1

      @@KwiatekMiki speed matter

    • @t-ree
      @t-ree 7 місяців тому

      AI

    • @5803mark
      @5803mark 2 місяці тому

      Yes. People think they are necessary. They are not. Lol.​@@KwiatekMiki

  • @tetttettamilli6761
    @tetttettamilli6761 7 місяців тому +1

    @JH - Excellent information 👏👏👏. I can use this Python "web scraping" utility right now.

  • @jmr
    @jmr 7 місяців тому +5

    Sadly this isn't practical for the dark sites I want to read. They get hammered and have too many anti bot protections. I'd love to keep up in an RSS reader or something.

  • @redarrowgaming4700
    @redarrowgaming4700 7 місяців тому +1

    My issues are with finding all the different onion links that could be used to scrape, tor links themselves are hard to find, is there anyway of automatically crawling for onion links to scrape?

  • @mrgammaray343448
    @mrgammaray343448 7 місяців тому +3

    Absolutely love this. Really am grateful for helping me expand the knowledge and projects ideas 🙏🏼

  • @VaibhavShewale
    @VaibhavShewale 7 місяців тому +1

    at first i was confused on how to scrape the or site but after watching it i got it

  • @angrybirds2472
    @angrybirds2472 5 місяців тому

    omg if you add a voice obfuscator to your demeanor, i see a different david bombals special guest but since i love it i wont be spilling anyones beans today. after all not all of us need a alter ego that lives on the other side of the fence but for some it helps tremendously. now for the word ubiquitous, can we pick a new word this year finally>? everyone has played it out.

  • @SplitUnknown
    @SplitUnknown 7 місяців тому +1

    Looks like john is recording somewhere else.
    Thank you for the video 😄

  • @rogerioabreu3081
    @rogerioabreu3081 7 місяців тому +3

    Great Work John! When are you coming to Germany?

  • @sorrefly
    @sorrefly 7 місяців тому

    How do I know the python library is not injected with malicious code?

  • @axelbruv
    @axelbruv 7 місяців тому

    Love your videos.

  • @RandomGeometryDashStuff
    @RandomGeometryDashStuff 7 місяців тому +1

    11:18 why RequestsTor needs cport=9051 but there was no 9051 in curl command (08:40)?

    • @oriyadid
      @oriyadid 7 місяців тому +5

      As he explained at 8:40 curl does not care about that port, it is not where the proxy resides. cports stands for control ports, and that's what 9051 is for.
      Curl only needs the proxy, which is on port 9050, and at 11:18 he indeed did give RequestsTor port 9050 as the proxy port.
      Edit: as for why RequestsTor even needs the control port, no clue

  • @ambroserapose5082
    @ambroserapose5082 7 місяців тому

    Hey John, I am a victim of someone hacking my multiple accounts gmail microsoft Facebook twitter etc maybe through my phone or somehow they got access to my Google password manager, Is there any safety steps I can take other than changing password and adding 2 factor authenticator app? Any help is appreciated.

    • @paralies1276
      @paralies1276 7 місяців тому

      Use a password manager like keepassxc to store passwords and generate random ones, don’t re use passwords

  • @hafizroslee2211
    @hafizroslee2211 Місяць тому

    possible to download DLS contents using this method?

  • @KwiatekMiki
    @KwiatekMiki 7 місяців тому

    Here after the video and it was good.

  • @LateralNW
    @LateralNW 7 місяців тому

    Great info thanks.

  • @DccToon
    @DccToon 7 місяців тому +1

    were you sponsored by flare or did you like flare

    • @xuxusito
      @xuxusito 7 місяців тому

      Of course he were sponsored.

  • @Billblackvip
    @Billblackvip 7 місяців тому +12

    Man sad, man see video, man happy

  • @gjkrisa
    @gjkrisa 7 місяців тому

    i’d like to have a tor crawler to index all the sites and their pages. then that could lead to the rest

  • @كرةالمحترفين-ت2ث
    @كرةالمحترفين-ت2ث 7 місяців тому

    Can you explain activating ssh with proxy on the victim’s device to configure the firewall?

  • @ravetime8394
    @ravetime8394 7 місяців тому

    How would this work when darkmarkets require captcha to view there site? Thank you in advance

  • @ReneSanchez6502
    @ReneSanchez6502 7 місяців тому +3

    bro i got like 30 ads in this video what's going on

    • @NeroCat9999vr
      @NeroCat9999vr 7 місяців тому +2

      That’s called “UA-cam.”

    • @آرمجيدونجيشالشام
      @آرمجيدونجيشالشام 7 місяців тому +6

      I got zero its called "ad blocker"

    • @NeroCat9999vr
      @NeroCat9999vr 7 місяців тому

      @@CoffeeWarriorXXX No. They *can* select when. I didn’t get that many ads in this video which proves the creator made zero input on when, where, and how many ads would play on this video. It was UA-cam doing typical UA-cam shit.

  • @successtv360
    @successtv360 7 місяців тому

    Hi. I want to extract the data (result history) on a virtual gaming site. can you help me?

  • @ChrisLeftBlank
    @ChrisLeftBlank 7 місяців тому

    not going to lie - i relate better with legacy setup pf john hammond, +1

  • @wahakadd5181
    @wahakadd5181 7 місяців тому +1

    Enjoy your trip and don’t forget to visit Morocco you going to like it 👍👍👍👍 🇲🇦🇲🇦🇲🇦

  • @seethekek4647
    @seethekek4647 6 місяців тому +1

    Bro really making a tutorial on how to make a dark web crawler to find illegal websites

  • @makouru9598
    @makouru9598 7 місяців тому

    would it be possible to write a scraper, where you feed it with an adress and he is searching for adresses in this adress and stores them in a data base besides a bunch of information. At the beginning you manually feed it with links and later it is just constandly running and storing links in its database... and here we go.. torch 2.0? Is it more or less working like this? A search engine?

    • @alanndea7032
      @alanndea7032 Місяць тому

      that's more a crawler than a scrapper

  • @uuu12343
    @uuu12343 7 місяців тому +2

    Hotel room videos feel oddly relatable...

  • @hedikintheoriginal
    @hedikintheoriginal 7 місяців тому +1

    upvote for a bathroom video next :D

  • @loudsquad2324
    @loudsquad2324 7 місяців тому +1

    In a hotel, might as well do some darkweb work ;) lmao

  • @timecop1983Two
    @timecop1983Two 7 місяців тому

    You set it to zero so the police won't show up at your door right?

  • @Chic_Ken
    @Chic_Ken 5 місяців тому

    Pythons scare me

  • @bettergamingseat3171
    @bettergamingseat3171 7 місяців тому

    Scraping mhm

  • @hgvhjfcjdudrsxhxj
    @hgvhjfcjdudrsxhxj 7 місяців тому

    nice new darkweb video

  • @conan1231
    @conan1231 7 місяців тому

    The "Torpy" Project seems pretty dead to me. Sad.

  • @LamiyaTaghiyeva
    @LamiyaTaghiyeva 7 місяців тому

    Hello. Could this technically be used as a free proxy?

  • @wtfdoiputhere
    @wtfdoiputhere 7 місяців тому

    John notice me before I leak your public IP 🥺

  • @David-ce1ux
    @David-ce1ux 6 місяців тому

    Would Microsoft Defender for Endpoint do the same job as Flare or better?

  • @avs_4u
    @avs_4u 7 місяців тому

    Sorry for a millisecond though of Seth Rogen

  • @Sprinkles-r5y
    @Sprinkles-r5y 7 місяців тому

    Interesting video. Great advertisement Segway. Incredibly useful info, dreading what you could actually do with this.

  • @ThushyCyber
    @ThushyCyber 7 місяців тому

    GREAT WORK

  • @sgotach_7581
    @sgotach_7581 7 місяців тому

    I immediately know people gonna use this for ummm Effed up means 🤢💀

  • @hamedranaee5641
    @hamedranaee5641 7 місяців тому

    Oh I missed the first like :( , anyway I love you John :D

  • @hedgehogform
    @hedgehogform 7 місяців тому +1

    Say bye bye to that hotels wifi network.

  • @wheeldollabeel
    @wheeldollabeel 5 місяців тому

    seth rogans long lost brother

  • @Ruhgtfo
    @Ruhgtfo 7 місяців тому

    Pm tranquilizer

  • @hacking4good
    @hacking4good 7 місяців тому +2

    Super duper 420 eyes 😂

  • @us_f4rmer
    @us_f4rmer 7 місяців тому

    Nice one UA-cam, changing the bell to either ALL or PERSONALIZED automatically defaults back to NONE. At least with Edge, maybe try a different browser though.

  • @bettergamingseat3171
    @bettergamingseat3171 7 місяців тому +1

    Don’t use flare it will leak more info from you and gather it and pin it to you and you don’t want that don’t fall for this use your own infosec tools

  • @sdvcs-o2v
    @sdvcs-o2v 5 місяців тому

    do some I2P shit

  • @digitalcivilulydighed
    @digitalcivilulydighed 7 місяців тому

    Totally not hateing u!

  • @darkheart8961
    @darkheart8961 7 місяців тому

    This is soo old school

  • @tojo1598
    @tojo1598 7 місяців тому

    Websocket ko bina authentication ke kaise implement kare? Mujhi 403 error de rha hai maise /ws ko permitAll kiya tha

  • @ChristopherBruns-o7o
    @ChristopherBruns-o7o 7 місяців тому

    so not trying to be buzzkill but mine didnt work

  • @idontexist-satoshi
    @idontexist-satoshi 7 місяців тому +1

    LOL you are wild showing people this. You know what's within that. Now you're going to get some little kid like "Let's go get the bad guys" and accidentally come a cross a site which will scar them for life. Well done. HAHA.

  • @Mmmmmaaa640
    @Mmmmmaaa640 7 місяців тому

    Dm

  • @LuvVortex
    @LuvVortex 7 місяців тому

    I really don't like y'all nsa ...... I will be getting biofuels release record

  • @Toxic_Talons
    @Toxic_Talons 7 місяців тому

    damn

  • @Slim-d7q
    @Slim-d7q 7 місяців тому

    Old market of edg ppl y can by weapons womens any thing y can build empire with it...😂😂like the real map of world y know map lead to treasure sow they give the wrong map😂😂😂evwn earth map

  • @Dylan_thebrand_slayer_Mulveiny
    @Dylan_thebrand_slayer_Mulveiny 5 місяців тому

    The dark web has CP. Scraping means taking content off of. So by the title, this guy is admitting to dl'ing CP off the dark web.

  • @bfx8185
    @bfx8185 7 місяців тому

    Please stop it! Advertising on you channel is overwhelming and even though I was considering being a member I considering to put you channel on my black list in the end.

  • @shakibbro2
    @shakibbro2 7 місяців тому

    please 1 video how to hacked gmail password please please new video
    🙏🙏🙏🙏🙏🙏

  • @KellyMahlangu
    @KellyMahlangu 7 місяців тому

    Hello, I want to get into the the software engineering but because of financial sitiations I am having issues paying for tuition
    So if there is anyone who is willing to help by offering to pay for small tasks so I can afford to pay monthly payments for a student loan please let me know

  • @kalp_it
    @kalp_it 7 місяців тому

    use vim instead of nano if you have balls.

  • @toinfinityandyourmom2219
    @toinfinityandyourmom2219 7 місяців тому

    And now millions of script kiddies are going to waste tor bandwidth... nice.

  • @razdingz
    @razdingz 7 місяців тому

    i like woman_SytsOnMyFayce