Explaining Big Data

Поділитися
Вставка
  • Опубліковано 23 жов 2024

КОМЕНТАРІ • 309

  • @ExplainingComputers
    @ExplainingComputers  12 років тому +3

    Many thanks -- I'm glad this video is finished. It has been in production (and rendering) for ages . . .

  • @GarretSlarrity
    @GarretSlarrity 11 років тому

    Thank you. For being one of the very few people on the planet who know how to explain something well without oversimplification.

  • @leilaalielusha
    @leilaalielusha 8 років тому +19

    i came here for big data but i will come to master britain's accent :D
    Thank you efficient video
    Leila.

  • @ExplainingComputers
    @ExplainingComputers  11 років тому +2

    The 3D graphics are created using LightWave. All compositing of 3D elements, chromakey and motion graphics (like animated bullet lists) are done in Adobe After Effects. Photoshop is used to create image files and textures used in both! Audio editing takes place in Adobe Audition, while I edit the videos in Premiere Pro. Oh, and I also use Camtasia for screen captures. I would add that this particular video was a rather complex project! Sometimes I get away with pointing a camera at something. :)

  • @samuelgray3953
    @samuelgray3953 4 роки тому +32

    Here he is talking about pandemics at 7:14 in 2012, and here I am looking at Covid-19 in 2020 haha

  • @Znowprince
    @Znowprince 12 років тому +1

    This man surely explains things much better then any other.
    Plus i never get tired of hearing him talk about things :)

  • @NoahAndABadger
    @NoahAndABadger 8 років тому +22

    Good video, I have an interview tomorrow for data engineer. Wish me luck

    • @ExplainingComputers
      @ExplainingComputers  8 років тому

      +Tessa from retail Good Luck! :)

    • @NoahAndABadger
      @NoahAndABadger 8 років тому

      +ExplainingComputers thank you!

    • @anubhavsiddharth
      @anubhavsiddharth 8 років тому

      so how was your interview?

    • @NoahAndABadger
      @NoahAndABadger 8 років тому +5

      +anubhav siddharth haha not well. I actually suffer a lot of fatigue and was extra tired in the interview. They actually didn't ask any data questions o sits a grad role. It was a tech startup, not typical interview style questions etc thank you for asking!

    • @grandeotos
      @grandeotos 8 років тому

      how are you

  • @crystalsantiful2362
    @crystalsantiful2362 8 років тому +3

    This video was great, helping me write my paper for my Management Information Systems class on "Big Data" thank you!

    • @ExplainingComputers
      @ExplainingComputers  8 років тому +1

      +Crystal Santiful Excellent! Good luck with your paper. :)

  • @patrickjohnson723
    @patrickjohnson723 8 років тому +2

    great presentation. I have used a lot of your presentations with my A'level computer science and BTEC IT students. they are clear, informative and comprehensive

  • @ivankatnite9096
    @ivankatnite9096 4 роки тому +7

    help me I've been trapped in a room playing nothing but this video for the past 7 years

    • @Uni_Iris_1
      @Uni_Iris_1 4 роки тому +3

      A fate worse than death

  • @ExplainingComputers
    @ExplainingComputers  11 років тому

    It means that, if hardware fails, the software just sorts itself out and continues OK (just like the Internet does if hardware fails). This is very different to a traditional database, where the failure of disk or server would just result in a crash.

  • @ExplainingComputers
    @ExplainingComputers  11 років тому

    Yes, I would be happy to do this. You can find my e-mail address for sending the file on the explainingcomputers website -- I don't think that UA-cam let me include it here.

  • @TacoBell5DollarBox
    @TacoBell5DollarBox 10 років тому +1

    Thanks. I work IT for hedge funds and constantly see big data mentioned at these offices.

  • @toniatrivett
    @toniatrivett 11 років тому

    Great summary for people still struggling with understanding what big data is.

  • @shaunbrowne3963
    @shaunbrowne3963 6 років тому +2

    Big Data reminds me of the film "Minority Report," certainly a terrifying look at the future. In the film, people are arrested for just thinking about a crime. With Google capable of listening to every conversation, sold as a benefit to users, facial recognition in stores, etc., leads us to a future alluded in the film. Pandemics? Predicting civil unrest?

  • @ExplainingComputers
    @ExplainingComputers  12 років тому

    Here is one sentence: "Big Data generates value from the storage and processing of very large quantities of digital information that cannot be analyzed with traditional computing techniques." This is from my Big Data page on my ExplainingComputers website -- you can find more words there! :-)

  • @tjeulink
    @tjeulink 8 років тому +1

    this video looks quite labour intensive with the many animations. do you all model and make them yourself?

  • @ExplainingComputers
    @ExplainingComputers  12 років тому

    This used to be the case on some motherboards many years ago -- running one monitor from onboard, and the other from a separate graphics card. However, I don't know if this is still possible on modern boards, as many graphics cards are now multi-head anyway.

  • @helgeandreasvuolab605
    @helgeandreasvuolab605 5 років тому +2

    Hi, Christopher. I wish you could make video about cluster computing with Raspberry pi's. Explaining why you need cluster and what you can use it for.

    • @ExplainingComputers
      @ExplainingComputers  5 років тому +3

      A Pi/SBC cluster is in my -- long -- video production list! :)

  • @richardmakthon4427
    @richardmakthon4427 2 роки тому

    Practical and friendly teaching
    Thanks !!

  • @CrimsonHawkArts
    @CrimsonHawkArts 12 років тому +2

    A lot of this went over my head, although it was still very insightful and a joy to watch. Well done.

  • @ExplainingComputers
    @ExplainingComputers  12 років тому

    Yes, I think you are right -- their new "APU" (rather than CPU) chips support this.

  • @Bender4411
    @Bender4411 12 років тому +2

    Thanks for being so smart and explaining stuff to us! I can see that you put a lot of work into your videos and it's greatly appreciated.

  • @sebbe239
    @sebbe239 6 років тому +9

    Remember its not how big your data is, but how you use it!

  • @philliu5418
    @philliu5418 9 років тому +1

    Privacy is a hot legal issue in big data. Is there any other legal issues deserving our notice? What do you think is the largest legal risk for big data business?

  • @ExplainingComputers
    @ExplainingComputers  12 років тому +1

    Wow! Big Data on SSDs. Your job sounds cool! :)

  • @JimLucke
    @JimLucke 11 років тому

    What do you use to create your graphics and short videos? They really help make the topic interesting

  • @19nicos29
    @19nicos29 8 років тому

    Great video; good introduction into big data.
    4.8 zettabytes per year is a little overestimated. Now they estimate at the end of 2016 that the global internet traffic will have reached 2 zettabytes for that full year.

  • @DheepJoyMampillyDJ
    @DheepJoyMampillyDJ 10 років тому +1

    Thank you very much for this beautiful primer on Big Data.

  • @amsinan680
    @amsinan680 10 років тому

    You missed Windows Azure as a platform for Big Data analysis as well. Nice work.

  • @mahira936
    @mahira936 9 років тому

    I am a data analyst working on ARBUTUS tool.the experience of mine will be counted or not if i am going for BIG DATA or HADOOP DEVELOPER.looking for your favourable response.

  • @yimenkanj5137
    @yimenkanj5137 5 років тому +2

    this is truly beneficial, thank you explained well

  • @ashchatur
    @ashchatur 10 років тому

    Very nicely explained! Keep sharing more please....

  • @berrec
    @berrec 11 років тому +1

    Outstanding, excellent delivery, graphics and structure. Seen many delivery’s on Big Data over the years and I rate this as the most informative 101 presentation on Big Data I have ever viewed. Many thanks on behalf of all You Tube viewers for your time and dedication to this presentation. Cheers and keep them coming!

  •  10 років тому +11

    Great video, very informative, with great visualizations. Thanks!

    • @goph999
      @goph999 10 років тому +3

      What is so great about it? Please explain.

  • @manualofenglishlanguage1553
    @manualofenglishlanguage1553 6 років тому +1

    i m thinking of going for a master in Big data analytics, what do u think? is it good?

    • @ExplainingComputers
      @ExplainingComputers  6 років тому +1

      I think it is a great areas to specialize in, which will present you with lots of opportunites in the job market. Try and make sure you do some AI/ML stuff within the course if possible.

  • @ariyodavid4410
    @ariyodavid4410 4 роки тому +3

    Me too here he is talking about pandemics at 7:14 in 2012, and here I am looking at Covid-19 in 2020 haha

  • @thesh0m0kh
    @thesh0m0kh 11 років тому

    Hey Chris.. am supposed to write a scientific paper and abstract about big data "as it's the next big thing".. i have a data-set from captured network traffic in the size of 4 GB.. can you help on how to approach it!
    this is the first time i see your channel.. but you are really awesome.. you are doing a great help for us.. big thanks from Sudan! :D

  • @confused6526
    @confused6526 7 років тому +1

    Excellent Animation!
    Thanks for sharing your animation with us.

  • @flybeep1661
    @flybeep1661 7 років тому

    8:00 Cisco was a bit off with 4.8 zetabytes a year. In 2016, according to Cisco, it was 1.2 ZB per year.
    Source: www.cisco.com/c/en/us/solutions/collateral/service-provider/visual-networking-index-vni/vni-hyperconnectivity-wp.html

  • @omarsalem5832
    @omarsalem5832 12 років тому +2

    his voice is so calm.

  • @PawnozTV
    @PawnozTV 12 років тому

    Great job, you should have your own show on science or discovery channel.

  • @khoolcoolboy
    @khoolcoolboy 11 років тому

    Am i right to say this is gonna be a big support to the aviation industry to hold millions of records and customer surveys etc. ? Or could you tell me how this is gonna help the aviation industry please?

  • @Iam1nsane
    @Iam1nsane 11 років тому

    Hi, your video is very informative. I have a question though. The apache hadoop software, can i use it on a normal desktop for small data as in for demonstration purposes of what can be achieved through big data. Even my data is very small. 500 records. This is a project work i am doing. TY.

  • @rasembo
    @rasembo 10 років тому

    This is a great video that is very informative and captivating, Kindly let me know which software you used to create the graphics.
    Thank you

    • @ExplainingComputers
      @ExplainingComputers  10 років тому

      All of the 3D graphics were produced in LightWave, with compositing in Adobe After Effects. You can learn/see more in my recent "Making Of" video here: The Making of Resources from Space

  • @eversunnyguy
    @eversunnyguy 10 років тому

    Fantastic visuals. Solid overview of business case for Big data. Big deal

  • @Ajithkumarm107
    @Ajithkumarm107 7 років тому

    Big data is a new technlogy that deals with analysis and processing of large amout of data that is useful for many purpose. Hadoop is offering Bigdata services to Customer around the globe by storing large amount of data in different servers and rearranging them with a summary....am i correct...??? i think i understand it clearly...

  • @JoonasNakiVaivaa
    @JoonasNakiVaivaa 12 років тому

    I don't know why I find these videos interesting but I do.

  • @bourntecsolutions4824
    @bourntecsolutions4824 11 років тому

    Very precise and clear.

  • @galacula
    @galacula 2 роки тому +2

    Well...I guess leveraging Big Data for future pandemics was put towards the bottom of the list...

    • @ExplainingComputers
      @ExplainingComputers  2 роки тому

      Sadly so, at least initially. Although it came into play with the rapid development of the current vaccines.

  • @2DeCipher
    @2DeCipher 11 років тому

    Another great video - one of the best yet. Nice use of cgi and a complex topic covered really well.

  • @roy1693
    @roy1693 11 років тому

    Hi Chris you mentioned that " Hadoop detects and compensates for hardware failures or other system problems at the application level" can you simplify the sentence, like what do you mean by application level here, thankyou

  • @dasa1043
    @dasa1043 10 років тому

    Big Data is the Next Generation in computing, but what exactly is it?Would you please teach me the exact meaning of "Big Data" and "Velocity" in social science perspective. Also, it seems that the Big Data characteristics is old version because the newest is 4Vs.

  • @vishaldesai575
    @vishaldesai575 9 років тому

    Excellent video and explanation.

  • @hord1827
    @hord1827 12 років тому

    Could you do a video on quantum computing?

  • @PhilShnider
    @PhilShnider 9 років тому

    volume, velocity,variety & veracity

  • @DiversEvent
    @DiversEvent 9 років тому +2

    Another great video and explanation. I'm surprised you don't have more subscribers...it's probably coming soon to you. Really great programs and channel you got. Keep them coming EC.

  • @ayeshashafique229
    @ayeshashafique229 8 років тому

    Sir i am enrolled in BSCS course of Computer Science & want to learn Big data from Scratch ..what should i do so that i can make my fyp on this tech .Please suggest me , if it would be help ful or not , so that i can accomplish my mission of fyp.Kindly suggest me from where should i start as my Guide .please.Any comments or suggestion would be welcomed!!!!

    • @ExplainingComputers
      @ExplainingComputers  8 років тому

      +Ayesha Shafique Learn about Hadoop -- this will give you useful, practical knowledge, as well as developing a conceptual understanding.

  • @chokomite6036
    @chokomite6036 5 років тому +2

    Posted 2012? OMG this is insane. I just started studying Hadoop actually.

    • @ExplainingComputers
      @ExplainingComputers  5 років тому +2

      Yes, this video is from 2012 -- the principles of Big Data have been around for some time, if not the widespread practice. :) Good luck learning Hadoop -- a very useful thing to learn.

    • @ArjotGill
      @ArjotGill 4 роки тому

      @@ExplainingComputers Sir i am a noob
      Plz explain how Storage devices Store data..as different files instead of a big clump...i.e every data bit is stored as 0 or 1 ... Then how the system differenciate it as two or more files..plz sir..

  • @markganus1085
    @markganus1085 7 років тому

    the intro is very similar to the song that plays in You're the Greatest, Charlie Brown.

  • @cardellwebb7619
    @cardellwebb7619 9 років тому

    Very informative video great presentation.

    • @SUMITSAIN
      @SUMITSAIN 9 років тому

      Big Data Introduction check it here:
      www.allprogrammingtutorials.com/big-data-fundamentals/

  • @ExplainingComputers
    @ExplainingComputers  12 років тому

    My best PC is a Core 2 Quad 9550, 2.83GHz, 8GB RAM, GeForce 9500GT graphics card. It did not enjoy rendering all of the HD animation in this Big Data video! :-)

  • @MichaelSamerski
    @MichaelSamerski 3 роки тому +2

    He predicted the Corona Virus shape !

    • @ExplainingComputers
      @ExplainingComputers  3 роки тому

      We knew what kind of virus it was likely to be . . .

    • @donaloflynn
      @donaloflynn 3 роки тому

      All coronaviruses are that shape. They're spiky like crowns, hence "corona".

    • @donaloflynn
      @donaloflynn 3 роки тому

      @@ExplainingComputers Hi Christopher. Thanks for this great primer on big data. Can you elaborate a little on how you and others were able to see the pandemic coming? What made it likely to happen and why was a coronavirus in particular predicted? It's quite worrying that this was predictable and yet there was so little preparedness.

  • @sravantejburagadda4836
    @sravantejburagadda4836 9 років тому +1

    i want to do my final year project in big data so what are the precautions i need to follow

    • @rayrivera5793
      @rayrivera5793 4 роки тому

      I'm also doing a final project on Big Data. I was using this video for useful information to cite. I'm curious as to know where you are now since we have similar interest. If I could get an update that would be great.

  • @sandrobernardes_
    @sandrobernardes_ 11 років тому

    Very informative and simple.

  • @jafferkhan786
    @jafferkhan786 12 років тому

    nice video, but im still confused to what Big Data actually is, i understand how it could be used and in what ways it will help organizations, but still dont now what you are talking about when you speak about "Big Data", is it raw data e.g.blogs, social media smartphone data etc. or is it just a word to describe how data is going to be used in the future, or am i completely wrong.
    could you give me a simple definition of Big Data please

  • @1lluminati09
    @1lluminati09 10 років тому

    Thanks so much for posting, its very clear explained.

  • @Evlampije
    @Evlampije 11 років тому

    Very nice videos. I realy love them. I would realy like to watch some video about smaller particles of computers , like transistors and procesors, how they work. Thanks again for these videos.

  • @ExplainingComputers
    @ExplainingComputers  12 років тому

    Yes, that would be great! Maybe in a decade . . .

  • @JoseMendoza-rg2vw
    @JoseMendoza-rg2vw 6 років тому +30

    Anyone 2018??

    • @atomicuschart4836
      @atomicuschart4836 6 років тому

      Try to use NEW Data Visualization Tool atomicuschart.com get free trial for 3 month

    • @teapulld
      @teapulld 5 років тому +1

      Nope, 2019 here

    • @Tobi-ys3iq
      @Tobi-ys3iq 5 років тому

      Adam Hong same here

  • @sreejeshs544
    @sreejeshs544 9 років тому

    Good explanation. Thank you

  • @ExplainingComputers
    @ExplainingComputers  12 років тому

    As others have said, look at my video called "Explaining 3D Computer Graphics".

  • @ExplainingComputers
    @ExplainingComputers  11 років тому

    Yes, it is possible. But it is not the best place to start! :)

  • @prajaram1918
    @prajaram1918 5 років тому +14

    2019

  • @mayurchaudhari6950
    @mayurchaudhari6950 6 років тому +2

    Can you do a revised video on this?

  • @subodhjuhi
    @subodhjuhi 9 років тому

    Explained Well. Thank You.

  • @lucaclaessens3751
    @lucaclaessens3751 9 років тому +1

    Am I the only one who feels this eery, 1984 like situation coming a step closer through the development of big data and average people thinking they will benefit off of these kind of technological improvements?

    • @ExplainingComputers
      @ExplainingComputers  9 років тому +3

      Luca Claessens No, you are not alone in thinking this! Big Data in the hands of large companies is potentially very worrying . . .

    • @dannguyen466
      @dannguyen466 9 років тому

      ExplainingComputers What do you mean potentially very worrying in large companies?

    • @ExplainingComputers
      @ExplainingComputers  9 років тому +1

      Dan Nguyen This is a big question! Worrying to the extent that certain large companies are going to know a very great deal about individuals -- far more than governments -- and could potentially misuse this information. Many people are unaware quite how much information they are trading in "payment" for free services. For many years, some large companies have been gathering data (Walmart being one of the first). But only now is the computing power and Big Data technology becoming available to process and correlate such data, and that could lead to abuses of power.

    • @dannguyen466
      @dannguyen466 9 років тому

      i sure hope that the UPC code on the back of that 3-pack Fruit of the Loom underwear doesn't provide the color of my underwear. do you think the BIG DATA concept could also be an alternative way to track down criminals and terrorists?

    • @ExplainingComputers
      @ExplainingComputers  9 років тому

      Dan Nguyen The code on the pack will not need to provide the color -- at least not if the CCTV camera in the shop that saw you pick it up recognised your face and the pack and flagged an association. This is not just about reading bar codes and smart tags. AI and vision recognition are the real future of tracking. Video data -- and systems that can pull structured information from video -- will be where the real Big Data explosion comes from. And yes, this could have great benefits for tracking criminals and terrorists -- it is going to get harder and harder to hide.

  • @pcuser80
    @pcuser80 12 років тому

    Another excellent video!!
    Thank you

  • @ItsM9_
    @ItsM9_ 5 років тому +1

    safe 1 my g, ur knowledge is bare useful still.

  • @thefreighttrain7028
    @thefreighttrain7028 11 років тому

    Good job... One piece of AV which got big data concept in my head... :)

  • @ShakespeerTube
    @ShakespeerTube 4 роки тому

    Hello. Could I ask you about the inicial music of this video? Where could I find it if possible? Thanks

    • @ExplainingComputers
      @ExplainingComputers  4 роки тому +1

      I composed the intro music -- it only appears in my videos on this UA-cam channel.

    • @ShakespeerTube
      @ShakespeerTube 4 роки тому +1

      @@ExplainingComputers Oh I see... then is GREAT. I love it!

  • @GameProfessor
    @GameProfessor 11 років тому

    very intuitive and easy to understand. Thanks for making this video. :)

  • @ExplainingComputers
    @ExplainingComputers  12 років тому

    I have done a video on quantum computing! :-) Search for "Explaining Quantum Computing" -- or follow the link in the (top right) annotation in this video at 6:40

  • @Rivo999
    @Rivo999 12 років тому

    what are the specs of your best pc?

  • @Gaao_mere_saath
    @Gaao_mere_saath 9 років тому

    Nice work, thanks a lot.

  • @Matador120564
    @Matador120564 10 років тому

    Great explanation. Thanks a lot !!

    • @SUMITSAIN
      @SUMITSAIN 9 років тому

      Big Data Explanation check it here:
      www.allprogrammingtutorials.com/big-data-fundamentals/

  • @ADITHYA03
    @ADITHYA03 11 років тому

    very useful. Many thanks.

  • @TheMushtyroo
    @TheMushtyroo 11 років тому +1

    Funny how we can build these fast complex systems yet struggle to forecast the weather! :)

  • @Kynareth6
    @Kynareth6 11 років тому

    nicely explained, it really helps. thanks!

  • @SuperMunsterrugby
    @SuperMunsterrugby 5 років тому

    Very intresting video

  • @vampugani
    @vampugani 10 років тому

    Very nicely explained!!!

    • @SUMITSAIN
      @SUMITSAIN 9 років тому

      Big Data Explaination check it here:
      www.allprogrammingtutorials.com/big-data-fundamentals/

  • @Oggy-WanKenobi
    @Oggy-WanKenobi 9 років тому +2

    I want to Make a career in Management Consulting. Will learning big data analytic boost my CV?

    • @ExplainingComputers
      @ExplainingComputers  9 років тому +7

      Yogendra Patel Yes, certainly. Big Data, and related IT matters like AI and the Internet of Things (IoT), are high on the list of hot topics for management consultancy for the next five years. In this context, you may find these articles interesting:
      techcrunch.com/2014/09/16/ibms-new-watson-analytics-wants-to-bring-data-to-the-masses/ and
      hbr.org/2015/03/artificial-intelligence-is-almost-ready-for-business

  • @MrMRGamer1010
    @MrMRGamer1010 12 років тому

    is there a way to use discreet graphics plus integrated graphics?

  • @omarjaafor6646
    @omarjaafor6646 10 років тому

    Nice introductory video

  • @Tehchapster
    @Tehchapster 12 років тому

    Is big data better than little data??

  • @phyllispayne8338
    @phyllispayne8338 3 роки тому

    Can you do one for dummies?

  • @sippaCup
    @sippaCup 12 років тому

    Great video

  • @rogerc7960
    @rogerc7960 Рік тому

    GCHQ data storage of cables/ISPs?

  • @kenigiri
    @kenigiri 3 роки тому +1

    This video was interestingly futuristic for its recording date

  • @ExplainingComputers
    @ExplainingComputers  11 років тому

    Good spot! :)