I Made an AI with just Redstone!

Поділитися
Вставка
  • Опубліковано 28 лип 2024
  • To try everything Brilliant has to offer-free-for a full 30 days, visit brilliant.org/mattbatwings You’ll also get 20% off an annual premium subscription.
    Patreon: / mattbatwings
    Discord: / discord
    My socials: linktr.ee/mattbatwings
    My texture pack: modrinth.com/resourcepack/mat...
    World Download: (JAVA 1.18.2) www.planetminecraft.com/proje...
    IMPORTANT NOTE ABOUT USING THE WORLD DOWNLOAD, PLEASE READ!!! When drawing, make sure to make the numbers SMALL and centered. If you fill the screen with a number, it will not work. This is because the images in the MNIST dataset are small, and that’s what it was trained on.
    Code used in this video: github.com/mattbatwings/neura...
    Yannic's video: • I BUILT A NEURAL NETWO...
    Redstone Team: • 【Minecraft】World first...
    3b1b's much better MLP explanation: • But what is a neural n...
    My explanation of MLPs was inspired by • I made a Neural Networ...
    0:00 Intro
    0:23 Backstory
    2:02 MLP or CNN?
    2:43 MLP Explanation
    5:19 The Plan
    5:39 Python Simulation
    7:45 Input Layer
    8:43 Hidden Layer
    11:37 ReLU
    11:58 Output Layer
    13:09 Softmax (Kinda)
    15:25 Showcase
    16:10 Sponsor
    Music (in order):
    Astrophysics - Sweden (C418 synthwave/80s) • Sweden (C418 synthwave...
    HOME - Still Life • HOME - Still Life
    Helynt- Continue • Continue
    LitKidBeats - GOOD VIBES • [FREE] Happy Type Beat...
    Harris Heller - Guilty Spark • Guilty Spark
    Harris Heller - Streamline • Streamline
    Infraction - Photograph • Vlog lo-fi Anime Fashi...
    Harris Heller - Iridescent • Iridescent
    Harris Heller - Path Less Traveled • Path Less Traveled
    unfeel - Deep Blue • Deep Blue
    LuKremBo - biscuit • (no copyright music) l...
    Helynt - Moog City • Moog City
    LAKEY INSPIRED - Chill Day • LAKEY INSPIRED - Chill...
    Infraction - Serotonin • Vlog Lo-Fi Chill by In...
    HOME - We're Finally Landing • We're Finally Landing
    Blue Wednesday - New Shoes • Blue Wednesday - New S...
    Harris Heller - Plethora • Plethora
    LAKEY INSPIRED - The Process • LAKEY INSPIRED - The P...
    unfeel - Kinda Love • Kinda Love
    HOME - Head First • HOME - Head First
    Infraction - Jeju • Vlog Chill Hip-Hop by ...
    This video was sponsored by Brilliant
  • Ігри

КОМЕНТАРІ • 2,3 тис.

  • @mattbatwings
    @mattbatwings  2 місяці тому +513

    To try everything Brilliant has to offer-free-for a full 30 days, visit brilliant.org/mattbatwings
    You’ll also get 20% off an annual premium subscription.

    • @kraralmosawi7843
      @kraralmosawi7843 2 місяці тому +4

      ok man we got to address your genius 💀😭🙏

    • @maxtres764
      @maxtres764 2 місяці тому +1

      "Why should we try brilliant if we have you?"-me

    • @YSCU261
      @YSCU261 2 місяці тому +4

      i mean, neural networks, brilliant, it's all connected

    • @DieNow
      @DieNow 2 місяці тому +2

      Did you use a cnn to make the mnist image reduced and input the weights in a feed forward neural network?

    • @gameingroom5829
      @gameingroom5829 2 місяці тому +1

      Thanks I love brilliant

  • @CraftyMasterman
    @CraftyMasterman 2 місяці тому +9221

    if you guys think this is insane, it took this guy like 2 weeks to make this all start to finish this man is a MACHINE

  • @wiki2014
    @wiki2014 2 місяці тому +6422

    ChatGPT playing minecraft: ❌️
    Minecraft running ChatGPT: ✅️

    • @alibrahym
      @alibrahym 2 місяці тому +67

      Yeah bro they'll make a server, represent the internet, someone will then recreate chatgpt with redstone make it learn alot and people would be able to use it, but the problem is redstone is very slow, so they have to speed up the time so much, that it even responses in a "ok" time.

    • @Centorym
      @Centorym 2 місяці тому +28

      Someone NEEDS to make a chat GPT in minecraft, I Don't care if it uses command blocks, it would be so cool!

    • @tung-hsinliu861
      @tung-hsinliu861 2 місяці тому +65

      @@Centorym The GPT language models are so huge that, if we convert the whole model into redstone, the scale of the redstone machine will be so large that it will not even fit within render distance!
      For comparison chatGPT model size is somewhere about 10 million~10 billion times larger than the number-recognitoin model.
      Yeah I think command blocks is the only way to go, but even that the amount of command blocks would be monumental!
      And the labor of copying the entire model by hand...
      I think the conversion process has to be automated to be feasible

    • @Ari_Fudu
      @Ari_Fudu 2 місяці тому +13

      @@tung-hsinliu861 then we must settle for a very barebones version that has predetermined responses - although that'll be more of a magic 8ball ngl

    • @crispinotechgaming
      @crispinotechgaming 2 місяці тому +33

      ​@@Ari_Fudubut then it's not a neural network

  • @electricitysgaming5383
    @electricitysgaming5383 Місяць тому +465

    10 neurons? Bro just built me

    • @priyank5161
      @priyank5161 16 днів тому +14

      Oh that means 10 of me = 1 of u

    • @XsphinxX101
      @XsphinxX101 13 днів тому +5

      @@priyank5161Oh that means 10 of me = 1 of you (100 of original commenter’)

    • @priyank5161
      @priyank5161 13 днів тому +8

      @@XsphinxX101 woah how u only have 1/10 of neuron?

    • @XsphinxX101
      @XsphinxX101 13 днів тому +4

      @@priyank5161 si

    • @AlexanderVonish
      @AlexanderVonish 10 днів тому +4

      @@priyank5161rip, 9/10 of their Neuron got paywalled.

  • @devultra1125
    @devultra1125 2 місяці тому +528

    Bro, people out there creating neural networks in Minecraft, and I'm struggeling opening a chocalate bar while watchin them

    • @Spiinosauro
      @Spiinosauro Місяць тому +11

      Bruh

    • @opticalreticle
      @opticalreticle 29 днів тому +7

      I dont see how those two actions compare

    • @haybail7618
      @haybail7618 25 днів тому +17

      if it makes you feel any better most really advanced ai robots really struggle opening a chocolate bar as well

    • @GamerBoy-pi3qm
      @GamerBoy-pi3qm 25 днів тому +5

      Me struggling to open FUCKING CHIP BAG (:

    • @mateshpl6552
      @mateshpl6552 12 днів тому +8

      I still have a small wound on my finger after trying to open a water bottle

  • @Ierzi
    @Ierzi 2 місяці тому +2664

    This was 100% a brilliant partnership

  • @chaosinsurgency884
    @chaosinsurgency884 Місяць тому +158

    Your transcript for college, internships, and future jobs in computer science is gonna be so stacked

  • @giosee_
    @giosee_ 2 місяці тому +382

    the ONLY person on youtube that managed to explain neural networks in seconds, it took me days of research to understand them, be able to make and explain them

    • @libertyjensen6321
      @libertyjensen6321 Місяць тому +11

      Imma be perfectly honest I still ain't understand

    • @giosee_
      @giosee_ Місяць тому +8

      @@libertyjensen6321 skill issue 😔

    • @libertyjensen6321
      @libertyjensen6321 Місяць тому +2

      @@giosee_ zoinks 😔

    • @Shadowfury22
      @Shadowfury22 Місяць тому

      @@libertyjensen6321 If a particular pixel on the input is lighted up, chances are you can make a list of numbers that could have that pixel included in their final drawing, as well as a list of numbers that are very unlikely to have that one included in theirs. If you combine all of these lists from each pixel on the input, then you can get on the output how likely it is that each of the numbers was the one actually drawn.
      Everything else (hidden layers, weights, biases, etc) is just an algorithmic way to process and combine the "lists" of information made in an ingenious manner that allows you to automatically pre-generate the lists (a.k.a. get the values for weights and biases) by "training" the network beforehand (which in reality is as simple as than taking every possible final drawing to begin with, looking at the pixels that are lighted up in each of them and storing that information).

    • @gpt-jcommentbot4759
      @gpt-jcommentbot4759 Місяць тому +1

      @@libertyjensen6321 its multiplying a bunch of numbers (the input pixels) with a bunch of set values (the weights), then adding a bias (should the neuron be biased towards negative or positive activation) then adding a nonlinearity (any function which cannot be plotted as a single line)

  • @viaJustin1910
    @viaJustin1910 2 місяці тому +80

    This is such a good demonstration that every hard problem is just a ton of smaller easier problems.

    • @glowerworm
      @glowerworm Місяць тому +4

      This is also a good demonstration that there is always someone out there smarter than you could ever be lol

  • @NoahWolfe
    @NoahWolfe 2 місяці тому +374

    You solved a number of difficult problems elegantly, but your amazing ability to communicate those ideas both visually and with narrative ease really stands out. Fantastic piece of content my dude.

  • @puppypalice
    @puppypalice 2 місяці тому +1476

    We’re getting to the point where pretty soon someone is gonna recreate the nes in minecraft, or make doom in minecraft, im betting that within 10 years someone will get either doom or super Mario bros or the legend of Zelda running just off redstone

    • @thisflyingpotato4227
      @thisflyingpotato4227 2 місяці тому +254

      Idk about other games but doom already exist, someone ran it on his redstone computer (I believe it was called IRIS) I'll get back and edit this comment with the code of the video
      (edit) _SvLXy74Jr4 Also I have no idea if this has been done before

    • @frkieran
      @frkieran 2 місяці тому +19

      such an original comment

    • @proceduralism376
      @proceduralism376 2 місяці тому +47

      Modpunchtree already ran doom on his cpu iris you can look up the video

    • @feeries8208
      @feeries8208 2 місяці тому +31

      @@proceduralism376 yeah and its only 28~32s for each frame

    • @adryanlucas096
      @adryanlucas096 2 місяці тому +5

      A NES Emulator in minecraft would be CRAZY

  • @pegasaurisrex9707
    @pegasaurisrex9707 Місяць тому +49

    I just did a machine learning course last semester, and your 2 minute explanation for an MLP network was way easier to understand than our textbooks chapter that covered it. This entire build is insane, amazing work!

  • @MasterAdamonia
    @MasterAdamonia Місяць тому +10

    I approached the topic years ago when I was doing a perceptron for playing tic tac toe. I had problems with keeping neurons and it's weight in a small enough size not to add too much of delay. Today it's solved by saving it as a signal strength in a barrel. It's such a genius thing that was impossible back in my day. Mine perceptron was five times bigger and had shit accuracy as I had to limit hidden layers (every weight and bias had to be saved in a separate RS NOR Latch bases 8-bit register plus every neutron had a 8 bit multiplicator and summator). Eventually I circled back to a rule based solution as the tic tac toe is simple enough to implement it in a smaller factor size, but it was deterministic and not really "very AI". I'm so proud and happy to see that quality redstone engineering is still alive and well and now you can do those things in a very nice and compact way.

  • @mmdts
    @mmdts 2 місяці тому +387

    In 16-bit logic, you can replace division by 15 by a multiplication by -30583 (32 bit result), three shifts, and two addition operations. You can easily figure this out by compiling a function that returns its 16-bit argument divided by 15 on clang with -O2, and what's efficient to do on silicon fabric (integers over floats, and multiplication over division) is almost always efficient in minecraft too.
    As for softmax, in 2021, researchers at nvidia created a hardware-efficient softmax replacement called "softermax" that is realistically implementable in minecraft.
    I'm not a minecraft expert, but I love seeing hardware implementations of functions, and minecraft is no exception.

    • @law1337
      @law1337 Місяць тому +19

      Just because a function is hardware-efficient doesn't necessarily mean it can be easily or efficiently implemented in Minecraft, but it's an interesting point.

    • @LtDan-fy7lc
      @LtDan-fy7lc Місяць тому +6

      @@law1337 "what's efficient to do on silicon ... is almost always efficient in Minecraft too."
      Java: *raises eyebrow*

    • @DawnshieId
      @DawnshieId 10 днів тому +2

      I liked this because I'm curious. ☺️

  • @matercan5649
    @matercan5649 2 місяці тому +542

    The internet is such a cool place, imagine having a degree and choosing it to build real video games and software into minecraft and share it for a job, instead of actually building the video games and software, and making a living from that. The internet is so cool.

    • @Louis13XIII
      @Louis13XIII 2 місяці тому

      Gaming companies are so scummy and exploitative that honestly that's ain't really a bad deal after all

    • @VortexFlickens
      @VortexFlickens 2 місяці тому +3

      A forum for all ppl from stupid kids to Elon Musk

    • @watema3381
      @watema3381 2 місяці тому

      @@VortexFlickens Not much of a flattering comparison for stupid kids don't ya think?

    • @Esiv0_
      @Esiv0_ 2 місяці тому +17

      @@VortexFlickens you said stupid kids twice

    • @Meyer-gp7nq
      @Meyer-gp7nq Місяць тому

      Wow look at the stupid kids hating on Elon cause he’s successful. Someone made a joke, cope

  • @coltith7356
    @coltith7356 Місяць тому +5

    That's super cool ! I like that you explained the difficulties you had and how you overcame them, makes everything less mystical and really helps understand why you do what you do

  • @guyleroy8022
    @guyleroy8022 2 місяці тому +10

    Amazing project, congrats. Note: instead of multiplying the weights by 100, you can perform post-training int8 quantization to maintain most of the original accuracy.

  • @lolmom5004
    @lolmom5004 2 місяці тому +1426

    my brother in christ, IT TOOK ME TWO MONTHS TO MAKE A NETWORK FROM SCRATCH THAT SOVLED THE MNIST DATASET IN PYTHON AND YOU DID IT IN REDSTONE IN 2 WEEKS, i applaude you, you redstone genius

    • @WoolyCow
      @WoolyCow 2 місяці тому +70

      lol there is a video i love of some bloke just writing it in like half an hour :> watching it is great way to lose confidence in your abilities

    • @GustvandeWal
      @GustvandeWal 2 місяці тому +3

      ​@@WoolyCow Link?

    • @WoolyCow
      @WoolyCow 2 місяці тому +38

      @@GustvandeWal yt doesn't play nice with links, but its called "Building a neural network FROM SCRATCH (no Tensorflow/Pytorch, just numpy & math)"

    • @GustvandeWal
      @GustvandeWal 2 місяці тому +4

      @@WoolyCow Thx!
      (Most copy the part after /watch?v= 🙂)

    • @WoolyCow
      @WoolyCow 2 місяці тому

      @@GustvandeWal oh lol i shouldve thought of that! thanks for the tip :D

  • @TCCPeanutButter
    @TCCPeanutButter 2 місяці тому +944

    I’m struggling on a 2x2 this dudes making a Neural Network.

    • @MrFiveHimself
      @MrFiveHimself 2 місяці тому +38

      dont worry dude! it just takes time! You should watch his logical redstone reloaded series. (both new and old). they’re really helpful in understanding how computational redstone works. After that, just try to make an ALU. Its an amazing starting goal and once you’ve made your own, you can confidently say you’re proficient. I wish you luck on your journey

    • @takyc7883
      @takyc7883 2 місяці тому +93

      its 4

    • @Asheetanshu
      @Asheetanshu 2 місяці тому +10

      ​@@takyc7883he is talking about door

    • @MrFiveHimself
      @MrFiveHimself 2 місяці тому +43

      @@takyc7883 god damnit i laughed way too hard at that

    • @nynvib276
      @nynvib276 2 місяці тому +3

      ​@@MrFiveHimself That's assuming the commenter is not on bedrock.

  • @holthuizenoemoet591
    @holthuizenoemoet591 Місяць тому +5

    So a really cool detail is how you handle the floating point limitation, this is actually really close to some quantitation solutions, look at the paper : "The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits" if you have the time, you might find further optimizations there

  • @lauchaufraedern
    @lauchaufraedern 2 місяці тому +3

    This is absolutely insane, keep up the good work!

  • @flameofthephoenix8395
    @flameofthephoenix8395 2 місяці тому +417

    14:19 Exponentiation is pretty simple, just convert the exponent to a binary number, then for each bit that is turned on you add the corresponding exponent, and to get the list of corresponding exponents you just start with the number you're raising to the power of the exponent and multiply by two each step. Here's an example, if you have 5^7 then it will convert 7 to binary which is 111 then it will multiply 5, 25, and 625 to get 78,125 which is the correct answer.

    • @skaleee1207
      @skaleee1207 2 місяці тому +86

      Also known as Square-And-Multiply algorithm

    • @flameofthephoenix8395
      @flameofthephoenix8395 2 місяці тому +66

      @@skaleee1207 Nice! I didn't know its official name. Originally, I thought I was the first person to come up with it, I remember being quite proud of it, later on I learned that it already existed, but I didn't know the name until now! That name is a lot simpler than my explanation and will allow people to find more information on it too, thanks!

    • @sebastiangrau8409
      @sebastiangrau8409 2 місяці тому +26

      This is an exponential with eulers number. Any output would be irrational and very messy. I understand why he would avoid this.

    • @antarctic214
      @antarctic214 2 місяці тому +10

      You could do it with base 2 (or 4), its just changing the "temperature". In that case exponentiation is trivial (bitshift). But you still have to do division.

    • @Rudxain
      @Rudxain 2 місяці тому

      That's like shift-and-add but for exp instead of mul

  • @IGaming73
    @IGaming73 2 місяці тому +969

    We got real AI in Minecraft before GTA 6

    • @krinodagamer6313
      @krinodagamer6313 Місяць тому +15

      Diabolical

    • @goldfishglory
      @goldfishglory Місяць тому +18

      😭😭WE ONLY HAVE A COUPLE YEARS TO MAKE THESE JOKES; EVERYTHING WILL STOP BEING IMPRESSIVE SINCE ITS AFTER GTA 6

    • @_sandy_
      @_sandy_ Місяць тому +3

      i came here looking for this comment LMFAO

    • @NolanHOfficial
      @NolanHOfficial Місяць тому +16

      ​@@goldfishglorywe got gta 6 before gta 7 - some guy in 2093

    • @goldfishglory
      @goldfishglory Місяць тому

      @@NolanHOfficial true

  • @youMatterItDoesGetBetter
    @youMatterItDoesGetBetter Місяць тому +5

    Congrats, you passed your PhD thesis.

  • @ckjdinnj
    @ckjdinnj Місяць тому

    Great work! You helped me gain a better understanding of the weights. I don’t know why i was having a hard time grasping how the weights worked. Thank you

  • @Knarfy
    @Knarfy 2 місяці тому +237

    I will likely never fully understand these videos, but man are they impressive 👏
    Incredible work! My brain is fried

    • @Centorym
      @Centorym 2 місяці тому +5

      ive never seen people not reply to a famous youtuber lol

    • @Flupus
      @Flupus Місяць тому

      Hi knarfy

    • @Flupus
      @Flupus Місяць тому +1

      Are you gonna be doing "Breaking a neural network with your dumb ideas"?

    • @ThatGuyNyan
      @ThatGuyNyan Місяць тому

      Fried brain 🤤

    • @Centorym
      @Centorym Місяць тому

      @@ThatGuyNyan run knarfy RUN before this guy makes a 3 course meal from you

  • @bens8419
    @bens8419 2 місяці тому +198

    It’s always a good day when a mattbatwings Video is on my recommended

    • @CubeXC
      @CubeXC 2 місяці тому +3

      Brp you could not get recommended this before premiere

    • @user-yp6gm2wi9d
      @user-yp6gm2wi9d 2 місяці тому +2

      Same

    • @pauliesnug
      @pauliesnug 2 місяці тому +2

      @@CubeXC you can. before a premire starts, it can be recommended

  • @Henzoid
    @Henzoid 29 днів тому

    That was inCREDIBLE. I'm floored. Not just by the redstone prowess but also by the ingenuity to be able to dissect these concepts and then rebuild them from scratch. Seriously impressive.

  • @stackootb9822
    @stackootb9822 Місяць тому

    This taught me about implementing neural networks better than a lot of learning resources I've watched. Good work

  • @kevinjerome5954
    @kevinjerome5954 2 місяці тому +61

    At this rate in 5 years I'm going to see a video on my homepage from mattbatswings where he ports the entire Linux kernel into Minecraft

    • @kaz49
      @kaz49 Місяць тому +4

      Well, they do say that Linux runs on just about anything

    • @noerlol
      @noerlol День тому +1

      @@kaz49 dont give him ideas bro

  • @capsey_
    @capsey_ 2 місяці тому +151

    offtopic but recently started second semester on my computer science in college and was like "omg it's mattbatwings thing" the whole lecture because i already learned most of the stuff they were talking about from you 💀

  • @Darockam
    @Darockam Місяць тому

    Congratulations, that's so cool! I used to do a lot of redstone back then, so I love seeing people pushing the limits further and further with it :)

  • @ahmad777-noob3
    @ahmad777-noob3 Місяць тому

    The way you explained all of those deep learning terms in simple words is just marvelous!

  • @TheKikou18
    @TheKikou18 2 місяці тому +199

    Actually you only need to be continuous for training, for deployment you can drastically decrease the precision
    Without losing accuracy, if you do it right
    There's a paper where they reduce it all the way to one bit per neuron, which is a perfect fit for minecraft
    (And I'm pretty sure also to 4 bits, which would fit signal strength applications)

    • @user-yi8uz2ph1y
      @user-yi8uz2ph1y 2 місяці тому +33

      quantization baby

    • @MilkGlue-xg5vj
      @MilkGlue-xg5vj 2 місяці тому

      ​​@@user-yi8uz2ph1y Imagine getting a binary quantization good at mnist lol

    • @whatisrokosbasilisk80
      @whatisrokosbasilisk80 2 місяці тому +14

      Even for training, you can use quantization-aware or non-differentiable methods and meet parity on inference during training.

    • @MilkGlue-xg5vj
      @MilkGlue-xg5vj 2 місяці тому

      @@whatisrokosbasilisk80 That's what I'm talking about

    • @MrSonny6155
      @MrSonny6155 2 місяці тому +1

      I'm guessing this is the BNN paper by Courbariaux et al. from 2016? I'm skimming through the claims and it's insane what quantization can theoretically do.

  • @novantha1
    @novantha1 2 місяці тому +32

    The first thing that comes to mind is a recent cutting edge implementation of QAT (quantization aware training) called Bitnet 1.58; it operates on different principles than a standard MLP. It replaces the Matrix multiplication with binary operators (addition, subtraction, or no-ops), so it's fast in inference deployment and cheap in that you can sort of fit a single "unit" of weights into 1.58 bits (though it's easier to just do it as a 2bit implementation with one state unused). It'd probably be way faster in a Minecraft context as one of the biggest disadvantages in IRL deployment, that you need custom hardware to take full advantage of the speed improvements, isn't really a disadvantage in a bespoke system.
    Anyway, the biggest difference is in the training process; it's trained at Int8 or FP8 (if memory serves, it's been a little while), and is then downscaled to the 1.58bit representation, but the information lost in that conversion to ternary values is preserved in a weight reconstruction matrix, basically. The end goal is that the network is made aware that it will be converted to a ternary representation. Hence, "quantization *aware* training", so you might be able to preserve more of the accuracy of the floating point model than you thought.
    Strictly speaking, the full bitnet implementation is a Transformer network, but it should still apply to raw MLPs given that they started with the FFN (essentially an MLP placed inside a more complex network with self attention and a language head).

  • @noahflood
    @noahflood Місяць тому

    Dude this is so amazing. To have the skill to make a machine like this, understand the math and computations behind it, minecraft knowledge, and the video production after it all? That's amazing

  • @JohnathonShell
    @JohnathonShell Місяць тому

    This was so cool man. Great job!

  • @NEOMatrix-bd7uo
    @NEOMatrix-bd7uo 2 місяці тому +28

    I never thought a Minecraft video will teach me neural network better than my teacher, thanks for the upload

  • @nik7069
    @nik7069 2 місяці тому +14

    Brother.
    I spent a while learning how to make neural networks as a school project, and just doing this from scratch, in redstone is absloutely astonishing. Legend, Mattbat.

  • @Kirbogun
    @Kirbogun Місяць тому +11

    1 step closer to google in minecraft

    • @Fineas_Bondar
      @Fineas_Bondar Місяць тому

      There is a mod that uses block's as a screen and it connects to Google's url so thechnicly you can wach UA-cam in Minecraft

    • @t.bo.a7061
      @t.bo.a7061 Місяць тому

      No mods. Pure bloodstone ​@@Fineas_Bondar

  • @adamburningham
    @adamburningham Місяць тому

    Just another comment saying I'm thoroughly impressed, both in your execution and your explanation of neural networks. Thank you!

  • @OszkarFulop
    @OszkarFulop 2 місяці тому +23

    mattbatwings in 1 year: I Made a Technological Singularity with just Redstone!

  • @diegomarni1754
    @diegomarni1754 Місяць тому

    This is such an amazing work I even applauded when the video ended. While watching the showcase I noticed that the 8 was always on the same confidence range, could this be a bug? Anyway this is incredible, Congratulations!!

  • @etienneweidenfeld6468
    @etienneweidenfeld6468 Місяць тому +5

    Bro is bout to build a quantum computer in Minecraft… 💀

  • @pikagamer9676
    @pikagamer9676 2 місяці тому +27

    Nice i also thought at first that your going to train the model in Minecraft but it seems that if its going to happen its going to be a whole other story

    • @dumblr
      @dumblr 2 місяці тому +2

      wait 2 more weeks lol

  • @LazyGuy-ne3ox
    @LazyGuy-ne3ox 2 місяці тому +29

    That's incredible! Combining neural networks with Minecraft is pure genius. Keep up the amazing work!

  • @FrankHacking
    @FrankHacking 4 дні тому +1

    Wow, How kind of you to give the world download!!!, appreciate it! ❤

  • @lemonade4076
    @lemonade4076 Місяць тому

    I’m currently in my second year of computer engineering who’s spent the past 12 months learning about AI, transformers and LLMs. This has to be the coolest implementation and application of the things I am learning I have ever seen. Combines my favourite childhood game with my career aspirations.

  • @andysslayer
    @andysslayer 2 місяці тому +30

    We got AI in Minecraft before GTA 6

    • @RealTheScienceCat
      @RealTheScienceCat 23 дні тому +2

      AI with redstone* ai has been in minecraft since the first mobs.

  • @humanperson8418
    @humanperson8418 2 місяці тому +95

    Ok, now make an AI assisted shape drawing tool for your paint program.
    e.g. draw a bad square, it draws a good square with the same width and height.
    draw an ugly number, it fixes it by converting it to the closest possible number with correct dimensions.

    • @SuitedGhost
      @SuitedGhost 2 місяці тому +32

      that sounds like pure hell
      I love it

    • @alluseri
      @alluseri 2 місяці тому +4

      nah

    • @NoVIcE_Source
      @NoVIcE_Source Місяць тому +2

      @@alluseri i like how google translate assertively translates this to "Now"

  • @Proman4713
    @Proman4713 2 місяці тому +3

    I just started the first few seconds of the video... the Minecraft soundtrack remix is awesome! Gives you a liiitle bit of the nostalgia of the original soundtrack but it feels so cool

  • @epicfilms4life507
    @epicfilms4life507 Місяць тому

    This is really good bro for visualising how computers work deep down in their tiny chips. Like ur essentially blowing up a cpu to its full size and literally WALKING thru the details and wiring. U can be a goated CS major bro, u have so much f**ING talent bro. How old are you dude? Did you do UNI, or are you currently doing uni? Like bro, go do a CS major or smth, you could make a shit ton of money from just research and development. U got like bottomless talent levels bro

  • @natthekiwi7074
    @natthekiwi7074 2 місяці тому +3

    I was trying to come up with a project to add to my resume and you just simplified me to focus on ML. Thank you! :)

  • @infinitearcstudios
    @infinitearcstudios 2 місяці тому +24

    This is great work! I never thought we would have machine learning with just Redstone.

    • @bintangramadan3217
      @bintangramadan3217 2 місяці тому

      There's a guys who made this 1 year ago lol in minecraft

    • @The.Sponge
      @The.Sponge 2 місяці тому +2

      @@bintangramadan3217 Yeah but Mattbatwings is aware of that so maybe there will be something new?

    • @CubeXC
      @CubeXC 2 місяці тому +1

      You could npt have seen it yet, stop saying stuff just to get like. It was before premiere

    • @mineq4967
      @mineq4967 2 місяці тому +16

      its not machine learning, he just pasted the weights and biases into the neural network, not making it learn itself like a machine learning algorithm would

    • @Louis13XIII
      @Louis13XIII 2 місяці тому

      @@mineq4967 yeah that's a bit deceptive tbh

  • @DiamondzFinder_
    @DiamondzFinder_ 2 місяці тому

    I'm always happy to see what wizardry you come up with. Keep being awesome man!

  • @THEORANGER-hv7sg
    @THEORANGER-hv7sg Місяць тому

    Very comprehensive explanation on neural networks. Appreciate it man

  • @fearofthechippan
    @fearofthechippan 2 місяці тому +14

    This is honestly incredible. I wish this was around when I was studying these concepts, would have helped me understand back propagation and softmax so much quicker

  • @TimeWisely
    @TimeWisely 2 місяці тому +4

    Wow, that's actually crazy, good on you!

  • @fruitpnchsmuraiG
    @fruitpnchsmuraiG 2 місяці тому

    this is so cool, if there's even the slightest possibility to collaborate on a similar idea or project I'd be honored at such an opportunity

  • @wonjontheaxolotl
    @wonjontheaxolotl Місяць тому +1

    this is absolutely crazy, as someone who took machine learning in uni i never thought that this was possible in minecraft, mind blown!

  • @bright_minary6537
    @bright_minary6537 2 місяці тому +2

    You just reinvented the integer quantization! Nice job🎉

  • @NieMamNicku
    @NieMamNicku 2 місяці тому +6

    respect for the sponsor's dish at the end of the episode

  • @befikerbiresaw9788
    @befikerbiresaw9788 Місяць тому +1

    Dude your project just made me fully understand MLPs and neural networks thank you.

  • @error.418
    @error.418 2 місяці тому +8

    Can't say enough about how great it is that you showed prior work from others in the community before digging in to your version. That's what we want to see in the community ❤

  • @Pohakoo
    @Pohakoo 2 місяці тому +3

    WHAT THIS IS THE VIDEO I’VE BEEN WAITING FOR OMGGGG

  • @kindstranger3871
    @kindstranger3871 Місяць тому +1

    I remember having my mind blown when I saw the first working computer in minecraft... the redstone was so enormous for the time. To see neural networks in minecraft a little over 10 years later is truly staggering. I'm no one of any real note but I just want you to know that you have impressed me and I am not easily impressed.

  • @kevnar
    @kevnar 15 днів тому

    Create a mod that lets you put a redstone build inside a single block. This block would have an input and an output, with the guts of it being shrunk down in a smaller dimension inside the block. Clicking on it takes you inside the block where you can build (or paste in) the redstone circuitry and connect it all to the output. Then, of course, you could have these circuits nested inside of each other so you could further compartmentalize the functions. This would compact these massive builds into a few blocks. Full functional encapsulation. Imagine the possibilities.

  • @dreamer964
    @dreamer964 2 місяці тому +38

    NO DONT TAKE OUR REDSTONE ENGINEERS JOBS

  • @rubensf7780
    @rubensf7780 2 місяці тому +31

    Now please make a calculator where you can draw the numbers yourself (using a neural network and calculator) that would be awesome

    • @bugmenot799
      @bugmenot799 17 днів тому

      That would be so cool. It would also be fun if you could draw the plus sign (Or whatever operation you were doing) as well.

  • @Martipops
    @Martipops 2 місяці тому

    Okay the bit shift caught me off guard. Absolutely amazing work

  • @OrangeBoyAdventures
    @OrangeBoyAdventures Місяць тому

    This is amazing bro. Great job!

  • @ALPRNX422
    @ALPRNX422 2 місяці тому +12

    at this point bro is gonna make hooman brain in redstone dang good job

    • @ziphy_6471
      @ziphy_6471 2 місяці тому +1

      Cringe

    • @ALPRNX422
      @ALPRNX422 2 місяці тому +1

      @@ziphy_6471 omg its linus no way 🔥🔥🔥

    • @ziphy_6471
      @ziphy_6471 2 місяці тому +2

      @@ALPRNX422 I have several children in my basement

    • @ALPRNX422
      @ALPRNX422 2 місяці тому +1

      @@ziphy_6471 cool

    • @ziphy_6471
      @ziphy_6471 2 місяці тому

      @@ALPRNX422 Will you be my next OwO UwU * turns up bulge *

  • @LightslicerGP
    @LightslicerGP 2 місяці тому +18

    Amazing
    I hope you mention the first guy who did a neural network thing in minecraft, recognising numbers
    Edit: he did

    • @ThiaGamesBR
      @ThiaGamesBR 2 місяці тому +1

      Feels good to comment before watching the video...

    • @two697
      @two697 2 місяці тому +3

      Why would you comment this before watching the video. He mentioned the other guy very early on in the video

    • @doctoroppa7991
      @doctoroppa7991 Місяць тому

      Twitter rot

  • @liamloveslunch
    @liamloveslunch Місяць тому

    Really great video. Also you demonstrate how easy making a neural network can be. You just explained everything very well. Will inspire people. Inspired me.

  • @DeveloperJake
    @DeveloperJake Місяць тому

    That’s a marvelous creation to be able to feature on your portfolios.

  • @KiwiRedstone
    @KiwiRedstone 2 місяці тому +7

    Wait what!???? Please tell me that this is just uploading the model into redstone and not all complex things like backpropagation to train the NN inside Minecraft...

    • @FriedMonkey362
      @FriedMonkey362 2 місяці тому +4

      For simple nural networks you dont really need backpropagation, you can just randomize the values until it gets better, itll take longer to train and wont be as efficient but its way easier to do

    • @bintangramadan3217
      @bintangramadan3217 2 місяці тому +1

      Bro there's a guy from Chinese who made neural Network in mine5 1 year ago lol

    • @Abcdef0101_
      @Abcdef0101_ 2 місяці тому

      ​@@bintangramadan3217Send the vid pls

    • @boblol1465
      @boblol1465 2 місяці тому +3

      yes it is uploading the model into redstone dw

    • @KiwiRedstone
      @KiwiRedstone 2 місяці тому

      At least...

  • @InsertName404
    @InsertName404 2 місяці тому +4

    How did u get around the network being bad at actual digit recognition, due to the MNIST data set all being perfectly centered?

    • @ferguspick6845
      @ferguspick6845 Місяць тому +1

      A simple MLP can learn a pretty good representation already for this dataset, but one easy approach would be to transform the input images (e.g. skew, rotate) and add these as additional training samples, this makes the learned representations even more robust :)

    • @InsertName404
      @InsertName404 Місяць тому

      @@ferguspick6845 tysm

  • @JohnSchley
    @JohnSchley Місяць тому

    massive kudos dude, seriously impressive!!!

  • @miltontinoco9851
    @miltontinoco9851 Місяць тому

    Your work is incredible! I have a lot of trouble working with PyTorch to create a neural network, and the fact that you were able to do it in Minecraft is mind-blowing.

  • @Pafiya256
    @Pafiya256 Місяць тому +3

    We are getting AI in minecraft before GTA VI comes out 💀💀

  • @NimArchivesYT
    @NimArchivesYT 2 місяці тому +7

    I’m a time traveler and mattbatt has recently made a human brain in Minecraft

    • @Meyer-gp7nq
      @Meyer-gp7nq Місяць тому +1

      He also made a Time Machine in Minecraft which is how you’re here I assume

    • @NimArchivesYT
      @NimArchivesYT Місяць тому

      @@Meyer-gp7nq Naturally

  • @pablofueros
    @pablofueros Місяць тому

    As a data scientist and Minecraft redstone enjoyer, i have to say that this project is so brilliant, congrats matt

  • @jhoylangoncalves3127
    @jhoylangoncalves3127 Місяць тому

    Man, that looks so fun.
    Congratulations.

  • @nesicvojin
    @nesicvojin 2 місяці тому +37

    So... For all of you without experience with neural networks, this isn't a whole thing (not even close). He is placing weights which he already got from training in Python. Even though this is impressive, it's way less impressive than some of his other builds. Training a neural network would be impossible in Minecraft because of all the math it requires which isn't possible (or extremely hard and slow) in Minecraft... I hope I cleared things out :)

    • @Dimitri_gdr
      @Dimitri_gdr 2 місяці тому +1

      You're right, but had to do that and the result is still pretty cool

    • @andreabassi4521
      @andreabassi4521 2 місяці тому +2

      It's not impossible, maybe with a lighter neural network the training process will be possible.

    • @teabow.
      @teabow. 2 місяці тому +1

      it's a neural network

    • @TheKastellan
      @TheKastellan 2 місяці тому +3

      I mean it pretty obviously isn't the whole thing, and regardless it is still impressive. Logical redstone is pretty much "just" how you chain different circuits together so saying that it is any less impressive doesn't really make sense. Also even if it is just hard coding the weights, it is STILL a valid neural network model. Weird comment.

    • @flameofthephoenix8395
      @flameofthephoenix8395 2 місяці тому +1

      I'm not extremely familiar with Minecraft, but I suspect that second half of what you said, "extremely hard or slow" is more accurate, though there would of course be memory limitations of the computer itself being unable to store all of the redstone. However, assuming the world file isn't too large Minecraft should be Turing complete.

  • @YuraSuper2048
    @YuraSuper2048 2 місяці тому +3

    bro casually invented quantization by himself 💀

  • @RealTheScienceCat
    @RealTheScienceCat 24 дні тому +1

    i got it so i could constantly draw numbers, and if it got them wrong, i 'punish' it by setting a part on fire, pouring a bit of water on it, exploding it, switching wires and more ways of damaging it. and when it breaks fully i will just reset it.

  • @notapplicable7292
    @notapplicable7292 Місяць тому

    you could probably have made your life easier with the network design but the confidence display is extremely cool.

  • @bktadventures2878
    @bktadventures2878 Місяць тому

    Whenever I see videos like these, im thinking to myself that with some time and my current skill in computer science and minecraft, I could actually do it as well, but then I watch the video further and start to realize that not only do you have to have the skill, time and discipline for the task itself, but also for recording, cutting and putting out such a wellmade video about it, which is something I most likely could NOT do.

  • @mustiz1898
    @mustiz1898 Місяць тому

    This man is SEVERELY underrated. He made this whole thing in 11 days.

  • @JuniorJunison
    @JuniorJunison Місяць тому

    I love that you can recreate digital logoc in minecraft. I remember making adders and logic gates after learning about them in my digital logic circuit design class.

  • @anonymanonymus4706
    @anonymanonymus4706 Місяць тому

    After not being able to build a Python simulation for one project of mine, the last thing I expected was to find a detailed explanation of how the particular part that wasn't working for me was working in a random Minecraft video I watched for fun in my free time. Thank you for the (probably unintended) help with my project, and the video was interesting in its own right as well.

  • @Gunbudder
    @Gunbudder Місяць тому

    this is amazing showcase of what a NN is and how it works. i worked with NN's for years and i still struggle sometimes lol

  • @CreateGuy4
    @CreateGuy4 Місяць тому +1

    The first time I understood such a viedo! thanks! and please keep going!

  • @sabersakin3685
    @sabersakin3685 Місяць тому

    As a minecraft player and having experience in ML for over one year, i''m literally blown away!!! This is truly amazing.

  • @ParkerJaster
    @ParkerJaster Місяць тому

    This video was awesome!! It taught me the basics of machine learning but related it all to Minecraft. The perfect combo!

  • @huynhat1799
    @huynhat1799 Місяць тому +1

    Although I didn't actually understand what you were doing, it's always fascinating how those people like you has pushed the minecraft redstone community so far. Keep up with your work!

  • @riczardo8588
    @riczardo8588 2 місяці тому +1

    I'm IT student too and it's soo amazing to watch!

  • @imabioligist1882
    @imabioligist1882 Місяць тому +1

    bro what you are a genuine genius. I do not mean this non-literally, you are a genius

  • @RiddleAndFactWorld
    @RiddleAndFactWorld Місяць тому

    It felt like I am watching Alan Turing solving making enigma. Keep creating this kind of content.

  • @braveecologic2030
    @braveecologic2030 Місяць тому

    Yep definitely cool. You just said about integers being needed for minecraft and I'm thinking so you just multiply it up... sounds obvious but its only because you were already talking about it. So good.