Compiling C to printable x86, to make an executable research paper

Поділитися
Вставка
  • Опубліковано 26 гру 2024

КОМЕНТАРІ • 1,1 тис.

  • @moth.monster
    @moth.monster 6 років тому +2127

    "printable x86" is actually the best esoteric programming language

    • @nokkonokko
      @nokkonokko 4 роки тому +71

      Good luck golfing with it...

    • @want-diversecontent3887
      @want-diversecontent3887 4 роки тому +31

      I don't know x86 but I'll try with 6502

    • @tissuepaper9962
      @tissuepaper9962 2 роки тому +96

      @@nokkonokko invent a new form of code golfing called "novelwriting" and see who can write the longest readable book that is also a useful program.

    • @evalcat1
      @evalcat1 2 роки тому +9

      @ilkemincraft753 and then actually perform the play

    • @ashleybyrd2015
      @ashleybyrd2015 2 роки тому +3

      @@tissuepaper9962 what defines a useful program? because it certainly seems hard

  • @therealfranklin
    @therealfranklin 7 років тому +1606

    "Outside of this region is a bunch of hooey." Might be the best description of UTF-8 I've ever heard of.

    • @simonmultiverse6349
      @simonmultiverse6349 3 роки тому +35

      3:53

    • @dragonridertechnologies
      @dragonridertechnologies Рік тому +9

      Well, yes, but it's still better than the other UTF representations.

    • @gloverelaxis
      @gloverelaxis Рік тому +11

      i'd argue that UTF-8 is one of the most beautifully elegant ideas in all of computer science, up there with the Y combinator, but its genius lies in its simplicity and its social impact rather than logical gymnastics. having one dead-simple encoding for all historical and current human written language is a truly *marvelous* thing. i can speak the word "duck" to you in ancient Egyptian hieroglyphs very directly and literally: "𓅬", right here in this comment box. all blame for the hooey code points which don't represent written text, like BEL/BELL, lies with ASCII and the other historical ancestors. i fully support a version 2 that drops ASCII back-compat

    • @josephenders1893
      @josephenders1893 Рік тому +6

      ​@@gloverelaxisthe backwards compatibility of UTF8 is what makes it really interesting (and useful). Almost every source code file is representable with it in an incredibly clever way it allows the expansion into every other character you can want.

    • @kargaroc386
      @kargaroc386 10 місяців тому

      Except for stuff like shift-jis which isn't compatible at all (aside that it uses ASCII for the first 127 code points like everything except ebcdic) and appears frequently enough to not just be completely forgotten but infrequently enough that people who need to know, don't know about it.

  • @jdlenl
    @jdlenl 6 років тому +842

    i love how you explained assembly without mentioning assembly

    • @Mmouse_
      @Mmouse_ Рік тому +52

      People tend to learn to code at a fairly high level then wander down to lower levels.
      Whilst I was on that path, I couldn't help but think "this can't be how that's done, it's uglier than my most hacky code" - but sure enough, that is how it's done.
      Some people then wander down to hardware level and it's somehow even worse, after starting with a high level language and writing beautiful, Indented code then discovering that eventually it ends up as what can only be described as absolute shite it's pretty jarring.

    • @important9836
      @important9836 10 місяців тому

      Akin to submitting a proofread manuscript detailing how to build a rocket to reach the moon, and the caveman executing it just farts really hard and gets there. Your screen still shows a rocket.@@Mmouse_

    • @Doodoofart725
      @Doodoofart725 8 місяців тому +6

      ​@@Mmouse_It's somehow relieving. Even the best code I write ends up as unintelligble gibberish so whatever lol

    • @xavierrodriguez2463
      @xavierrodriguez2463 6 місяців тому +1

      ​@@Mmouse_just because something is meant to be human readable doesn't mean it's good, and just because something is ugly doesn't mean it's bad

    • @xavierrodriguez2463
      @xavierrodriguez2463 6 місяців тому

      Imma be honest there's something incredibly beautiful about how a computer actually functions at a low level, abstract languages are cool but imo they're not more beautiful than machine code

  • @SirChris314
    @SirChris314 7 років тому +2554

    this video was good up until 25:03 at which point it was a masterpiece

    • @otesunki
      @otesunki 6 років тому +20

      haha

    • @TheJamie109
      @TheJamie109 5 років тому +112

      That was such a huge setup for that reveal. Im impressed. "Haha got you! I spent so long jumping through hoops to write this code to troll you!"

    • @dimkir100
      @dimkir100 5 років тому +26

      My jaw dropped when it revealed the infamous image! :D :D LOL Great job! Amazing video and research! :)

    • @avieus
      @avieus 5 років тому +16

      And better than the masterpiece was at 25:42

    • @FosukeLordOfError
      @FosukeLordOfError 3 роки тому +21

      I saw it coming at the last second, and I loved it. I wept tears of joy.

  • @woulg
    @woulg Рік тому +204

    This is my favorite flavor of art. I don't know if you have won any modern art prizes but imo you deserve many. There was a guy who came to my uni to give a talk who did stuff like this but only a fraction as labour intensive (and therefore exponentially less cool), and he was a big time, famous conceptual artist. I can't remember his name but he did one piece where he threw colored sticks in the air and took pictures of them because hypothetically they could randomly happen to arrange themselves into a perfect representation of a hypercube (the pictures are wonderful). He did another one where he got every possible attachment for his camera and several pairs of glasses and things to improve vision and then took the shittiest bluriest self portraits (because it was basically impossible to operate with this many "upgrades"). And the last one that I remember which was also very beautiful, he took 2 super long exposure photos of him laying on his back and then his front while listening to the whole back and then front of a public enemy record. He was one of my favs but after watching several of my videos you've definitely usurped him (and the others who shall remain nameless because of my shit memory). In about a decade look out for my comment on someone else's video where I detail my vague memory of your work hahaha. Anyway, sorry for the ramble, great stuff as usual, I'm off to watch the rest.

    • @tom7
      @tom7  Рік тому +80

      Thank you! I'm content with becoming a vague memory in a decade :)

    • @kasparpoland9803
      @kasparpoland9803 Рік тому +6

      Couldn't have put it into words any better myself. It's really inspiring :)

    • @viniciusmv7727
      @viniciusmv7727 11 місяців тому +4

      ​@@kasparpoland9803 That's a great pun considering the video

    • @boscorner
      @boscorner Місяць тому

      Does anyone know the artists name

  • @magneticflux-
    @magneticflux- 7 років тому +1344

    14:38 "This kind of fractal structure shows up a lot in computer science and mathematics and Hyrule."

    • @porky1118
      @porky1118 6 років тому +31

      I didn't hear that the first time, even if I didn't skip that part ^^

    • @EnderLord99
      @EnderLord99 3 роки тому +7

      I mean, he's not wrong.

    • @MCRuCr
      @MCRuCr 2 роки тому +14

      AND drinking games

    • @lollllloro
      @lollllloro 2 роки тому +14

      I wasn't sure it was "Hyrule" and I brushed the word off as some word I don't know.

    • @vieilatome2257
      @vieilatome2257 2 роки тому +3

      Only link can defeat ganon

  • @BludtheThursty
    @BludtheThursty 7 років тому +298

    "This kind of fractal structure shows up a lot in computer science, mathematics, and Hyrule"
    Gold

  • @TerjeMathisen
    @TerjeMathisen 3 роки тому +141

    The huge step here is when you realized that it is in fact impossible to write a regular program without any of the 8-bit bytes, and then decided to use an entire 64 KB block as your program, with wraparound at the end.
    I did the opposite back around 1992, by deciding to write an executable ascii program that used an even smaller character set: Just the 70+ chars that are blessed by MIME as passing transparently through any email gateway.
    This is the 65 MIME Base-64 set plus a handful of others that don't need any quoting.
    My final result does the absolute minimum possible amount of self-modification: A single 2-byte backwards JMP opcode is sufficient to enable the primary bootloader (two 64-byte lines, with optionally one or two line separator chars) to run.
    This boot loader decodes pairs of Base-64 chars to generate any byte value, so it encodes a maximally dense Base64 decoder which is used to decode and optionally either save to disk or execute the actual payload.

    • @yairmorgenstern416
      @yairmorgenstern416 6 місяців тому +3

      Sounds like a video in of itself :)

    • @TerjeMathisen
      @TerjeMathisen 6 місяців тому +4

      @@yairmorgenstern416 The part I'm really proud of is that I wrote that program on paper only, while on an Easter ski break, and it all worked as soon as I typed it in. 🙂I did bring a printout of all the legal opcodes/opcode combinations.

  • @FishamanP
    @FishamanP 7 років тому +640

    I'd love to see a video of you creating a blank text file, typing the program in, saving it as a .exe, and running it. It would really drive the point of this exercise home.

    • @tom7
      @tom7  7 років тому +470

      Are you sure? :) Unfortunately due to constraints in the header, these EXEs have to be 400k. Did you see that video of a guy live-streaming pressing his mouse button a million times? It'd basically be like that!

    • @waxt0n
      @waxt0n 3 роки тому +33

      @@tom7 could you have a macro that does it?

    • @ccgarciab
      @ccgarciab 3 роки тому +82

      @@waxt0n well, he has the compiler that he described in the video

    • @randomblogger2835
      @randomblogger2835 3 роки тому +1

      @@tom7 make .coms instead of .exes.

    • @__lasevix_
      @__lasevix_ 2 роки тому +1

      @@tom7 pay someone to do it

  • @Reecer77
    @Reecer77 7 років тому +275

    Man, "boring"? Tom7, I LIVE to see you post a new video, because it's always super interesting each and every time. I really hope that's not the *sole* reason you only make videos on things like, twice a year, if that, because I would be ECSTATIC if you had slightly more video content to share, WHATEVER it is.

    • @tom7
      @tom7  7 років тому +110

      Well, thanks for saying that. :) The main reason I don't share more stuff is that I usually put a lot of work into the setup (this project was my main programming hobby for a few months) and since I have a full-time job, there's only so many hours in the day (and only so many brain-sugars in the brain)!

    • @TheMaplestrip
      @TheMaplestrip 7 років тому +27

      suckerpinch I was really happy when you said you wouldn't be explaining bytes and byte code and all that. I was worried I would be forced to sit through a lot of stuff I already knew. You ended up not explaining a lot of stuff I didn't know, but that was completely fine because you explained everything that was needed to understand the video. It's this kind of editorial control that makes your videos a joy to watch.

  • @gkcs
    @gkcs 7 років тому +694

    This is just brilliant! Do you have any source for your inspiration, or is it just plain craziness?

    • @tom7
      @tom7  7 років тому +449

      Thanks! :) I just write down silly ideas I have, then spend months executing them...

    • @ster2600
      @ster2600 3 роки тому +92

      @@tom7 I wish I was as dedicated to my actual life as you are to these seemingly pointless yet fascinating projects

    • @imperatusmauser7096
      @imperatusmauser7096 3 роки тому +4

      @Ibrahim Braydon wow, bots

    • @devhypercoder2522
      @devhypercoder2522 3 роки тому +2

      @@imperatusmauser7096 and even a reply bot lol

    • @imperatusmauser7096
      @imperatusmauser7096 3 роки тому

      @@devhypercoder2522 I've been seeing these bots everywhere, especially in CodeVault's videos

  • @car-keys
    @car-keys 7 років тому +129

    Tom, as a young CS major, this channel is incredibly interesting. Thanks for all you do!

    • @tom7
      @tom7  7 років тому +27

      You're welcome and thanks for saying so! :)

  • @TheUnknownsShow
    @TheUnknownsShow 7 років тому +30

    This is still my favorite UA-cam channel of all time. I really wish Tom would upload more often, but at least what he does upload is always gold!

    • @tom7
      @tom7  7 років тому +9

      thank you (:

  • @car-keys
    @car-keys 7 років тому +323

    I've played enough TIS-100 to know how impressive this is.

    • @MultipleObjectSelector
      @MultipleObjectSelector 6 років тому +18

      car keys TIS has basically no instructions compared to IA or even ARM. IA is more complicated than most languages that target it.

    • @unflexian
      @unflexian 5 років тому +12

      GET SHENZHEN IO
      ALSO EXAPUNKS LOOKS FUN
      MHRD TOO

    • @BradenBest
      @BradenBest 5 років тому +10

      @@unflexian MHRD is hard as shit. The furthest I could get without looking up schematics was the full-adder.

    • @Huntracony
      @Huntracony 5 років тому +9

      @@unflexian Oh fuck, I already thought the Zachtronics games were next level but MHDR looks another few levels beyond that and now I have to play it.

    • @123sleepygamer
      @123sleepygamer Рік тому +2

      This video made me think of that game. I suck at it so bad. Was better at Exapunks.

  • @KyleNally
    @KyleNally 7 років тому +58

    Tom, as a larval web designer with *just* enough experience playing TIS-100 to follow this, I have to say I'm pretty blown away by what you did here, not only with the 'what' but also with the way you explained things. I'm not a CS major by any means, and I wasn't really lost anywhere.
    Great job, and I'll be mentioning your channel to my developer friends when I go to class tomorrow. Looking forward to seeing your next video!

  • @thomasgraham5840
    @thomasgraham5840 Рік тому +2

    Honestly, between this and the running video, you give me a clear impression of what a person can get done in a single lifetime

  • @javierbg1995
    @javierbg1995 7 років тому +87

    14:33 You already had me in, but man...
    BTW: I didn't think I'd ever see a Numberphile parody. Very nice

    • @tom7
      @tom7  7 років тому +20

      Thanks for watching! :)

  • @TheMaplestrip
    @TheMaplestrip 7 років тому +73

    Oh how I love this channel! This video reminds me most of glitch abusers of video games like _Pokémon_ and _Super Mario 64,_ using the compiled-level code in ways it was never supposed to be used. What you did is absolutely gorgeous.

    • @tom7
      @tom7  7 років тому +20

      aw thanks :)

    • @a_grin_without_a_cat
      @a_grin_without_a_cat 6 місяців тому +1

      I recently saw some Zelda speedrun that uses the fucking arbitrary code execution to teleport through levels. It is slow and tedious to set up, it is extremely boring to watch (that's why it lives in a separate category now), but on a conceptual level it is just amazing.

  • @JuliaC-sp5qk
    @JuliaC-sp5qk 3 роки тому +9

    the stuff you make consistently makes me want to cry while also being extremely impressed

  • @lbgstzockt8493
    @lbgstzockt8493 6 місяців тому +1

    I love how this is just barely possible, yet you make it work anyways. Your videos are very inspiring

    • @tom7
      @tom7  6 місяців тому +2

      Survivor bias at work!

  • @vinculaomega5283
    @vinculaomega5283 7 років тому +621

    This was the most elaborate Rick Roll I've ever seen. You've earned my like and subscribe, good sir!

    • @davidmikan7925
      @davidmikan7925 3 роки тому +22

      you're kinda spoiling it for other people since it’s the top comment :/

    • @lucas29476
      @lucas29476 3 роки тому +11

      @@davidmikan7925 tbh UA-cam mobile app is to blame for displaying the top comment prominently. This functionality is included in the past few months

  • @rigen97
    @rigen97 Рік тому +1

    My favorite part of your video is when you mention some absurd concept and then pull a document while casually saying "I already wrote a paper about that." Kinda gives these videos semi-documentary feel to them.

  • @snnowwy
    @snnowwy 3 роки тому +8

    "This kind of fractal structure shows up a lot in computer science and mathematics and Hyrule". Brilliant. Excellent video too. Absolutely inspired.

  • @pixelflow
    @pixelflow 6 років тому +203

    This needs to be printed in a book with one of those misleading 80s qbasic 'games, puzzles and more!' covers. Because nothing is better than OPLrolling yourself after typing for several hours.

    • @hobbified
      @hobbified Рік тому

      There was no QBasic in the 80s.

    • @ValeBridges
      @ValeBridges Рік тому +7

      @@hobbified Well, I suppose that's what makes them so misleading

  • @RamLaska
    @RamLaska 3 роки тому +6

    I remember seeing programs that would work identically in some variation of unix shell, perl, and/or C, but doing one that's both valid plain text and DOS-executable is MENTAL.
    I love it!

  • @jkid1134
    @jkid1134 2 роки тому +1

    I was floored by the elegance of addition as a bridge between AND and XOR into OR

  • @konpet4248
    @konpet4248 Рік тому +5

    I'm proud to say that this video really made me understand what compilers are and how that kinda stuff works. Even around 3-4 years later I still occasionally come back

  • @Terbium23
    @Terbium23 7 років тому +876

    Did I just got rickrolled?

    • @tarberd
      @tarberd 7 років тому +20

      I... guess .... ??? I mean ... I'm confused ...

    • @niklasgransjen684
      @niklasgransjen684 7 років тому +26

      In a 25 min video, even.

    • @batfan1939
      @batfan1939 7 років тому +11

      It's been so long since it happened to me, it took me a second to recognize it.
      Well, that, and it's 2:25 a.m.

    • @robertcullipher3492
      @robertcullipher3492 6 років тому +20

      The most elaborate rick roll ever!

    • @SreenikethanI
      @SreenikethanI 6 років тому +2

      wait this comment has 256 likes... I don't wanna spoil it...

  • @asp-uwu
    @asp-uwu 7 років тому +279

    Couldn't you OR two numbers by doing (A XOR B) XOR (A AND B)?
    Seems like it would be easier than doing the 2's complement math...

    • @tom7
      @tom7  7 років тому +183

      Yes, and good eye. Somehow I missed this option. Plus is a nice segue in the presentation, at least.

    • @asp-uwu
      @asp-uwu 7 років тому +32

      Cool!
      Did you have to write all of this assembly by hand? Or did you just be _very specific_ to the compiler what you wanted?
      Not sure which would be easier, actually...

    • @tom7
      @tom7  7 років тому +88

      I wrote the compiler, so it's sort of a mix. At each stage (intermediate language) I get to pick what operations are available, but then I have to pay for that by implementing them (basically 'hand writing' code) in the next lower-level language. OR sticks around until the conversion to the "LLVMNOP" language, where it decomposes into AND, MOV, and XOR, and then I implement those three in printable x86 more-or-less by hand.

    • @asp-uwu
      @asp-uwu 7 років тому +26

      Hmmm, seems tedious. But then again, the process for making everyone of your entries so far does!
      Great stuff, man!

    • @rich1051414
      @rich1051414 5 років тому +24

      @@tom7 "LLVMNOP" sounds like your toddler confidently trying to finish your sentence.

  • @whatchaduuurn
    @whatchaduuurn Рік тому +22

    You may find Ladder Diagram an interesting “programming language”. It is widely used in industrial automation on programmable logic controllers (PLC). It follows like your ladder idea and evolved out of industrial machinery using hardwired relay logic.

  • @joshnoble07
    @joshnoble07 7 років тому +228

    Tom. You are a son of a bitch. I have waited for this day for almost a year now. How on earth did you find a way to outdo yourself. This is phenomenal.

  • @brianlindner1866
    @brianlindner1866 6 років тому +2

    The most elegantly executed rick roll of all time. I salute you, sir.

  • @evgenyaleksandrov1206
    @evgenyaleksandrov1206 5 років тому +3

    I heard a lot that self-limitations improve creativity and help finding new handy way to do something. But when you said "we can't just load a value to the register" a was just shocked. This video has insane amount of hilarious stuff and I totally enjoy it. Fantastic!

  • @iamthelowercase
    @iamthelowercase Рік тому +1

    I'm not sure what impresses me most: the absolutely bonkers thing you decided to do, how well you both pulled it off and explained it, or your absolutely deadpan sense of humor. I will be sharing this video with everyone I know who I believe has even a *modicum* of a chance of following it.

  • @IAmTehAg
    @IAmTehAg 7 років тому +45

    Two vids in one years time?
    I love it :)
    Im honestly blown away so consistently by your work. Your enjoyment of wrestling with senseless problems is beautiful.
    I used to get excited over lots of channels new vids as a kid, but now i only get excited at your channel

    • @tom7
      @tom7  7 років тому +9

      Aw thanks, I'm glad you enjoyed it :)

  • @SW33wNecie
    @SW33wNecie 5 років тому +1

    This dude just straight up did a 25 minute video explaining assembly language just to fucking rickroll people.
    You're a god damn genius, Tom.

  • @francesco9703
    @francesco9703 7 років тому +18

    These videos are the most original programming videos on UA-cam. Always interesting and a pleasure to watch, and the length isn't really a problem!
    Still hope you'll do something more in the field of AI, though :)

  • @scottsmith4204
    @scottsmith4204 7 років тому +8

    Finally, only so many times i can watch your old stuff.

  • @xeostube
    @xeostube 4 роки тому +6

    It's a sad testament to the difficulty of collaborative filtering that for all the effort you put into this, only 150k people (if that, as I've seen it twice) have ever gotten to enjoy it.

    • @tom7
      @tom7  4 роки тому +9

      The important thing is that the RIGHT 150,000 people see it!

  • @TRex-fu7bt
    @TRex-fu7bt Рік тому

    I’m doing that thing every year where I rewatch all your videos and the Numberphile paper always delights me.

  • @entropyzero5588
    @entropyzero5588 6 років тому +83

    Awesome stuff!
    Though, quick question: Wouldn't (A xor B ) xor (A and B) also net you (A or B) ? ;)

    • @jurjenbos228
      @jurjenbos228 2 роки тому +5

      Of course

    • @MatheusAugustoDaSilva
      @MatheusAugustoDaSilva 2 роки тому +16

      The "how dare you not save a couple instructions in a project that took you months to accomplish and yielded you a research paper" strikes again.

    • @bacicinvatteneaca
      @bacicinvatteneaca 2 роки тому +13

      @@MatheusAugustoDaSilva well, cutting in half the number of operations needed for a simple AND is kind of a big deal

  • @alexmueller7864
    @alexmueller7864 Рік тому +2

    Hey, just wanted you to know that I found your channel a matter of days ago and have watched almost everything that you've posted. You're my hero! Working on amazingly unnecessary projects for their own sake is something that I heavily aspire to do.

  • @roboto_
    @roboto_ 7 років тому +237

    that was the most elaborate rickroll ever

    • @Hexcede
      @Hexcede 3 роки тому +2

      I didn't watch the full video. I set up DOSBox just to run the file to see what it does after trying to compile a different 16 bit emulator.
      I just went through so much effort to get rick rolled by a text file.

  • @A1rPun
    @A1rPun 3 роки тому +1

    The compiler analogy got me, every detail in this video is awesome.

  • @contrl31
    @contrl31 7 років тому +99

    At 9:10 ish, why can't we do (A & B) XOR (A XOR B)?

    • @gafeht
      @gafeht 7 років тому +1

      (1000) XOR (0110) = 1110...
      Seems to do the same thing in the same amount of steps (3)

    • @Architector_4
      @Architector_4 7 років тому +12

      +gafeht
      But he said that we don't have + operation so he needed to make it with other stuff, so just putting XOR in the middle is actually better.
      Or maybe he knew about it and used + to demonstrate that he will need to make that + from other operations aswell.

    • @gafeht
      @gafeht 7 років тому +1

      +Architector #4
      Ah, you're right. I missed that the second time through.
      Nice thinking +contrl31

    • @tom7
      @tom7  7 років тому +124

      It's better for the narrative of the video to use plus, so I'm glad I did, but XOR is definitely faster. Fixed the compiler. A few people have pointed this out, and I'm kinda ashamed I didn't spot it. Good eyes :)

    • @CosmiaNebula
      @CosmiaNebula 7 років тому +2

      Don't worry.
      (I spotted that too.)

  • @huh5950
    @huh5950 4 роки тому +1

    I've learned most of this stuff at school but before this video I always tought it was useless for most programmers, it was a good reality check thank you

  • @xwcg
    @xwcg 7 років тому +6

    I have no words. This is incredibly amazing.

  • @PendragonDaGreat
    @PendragonDaGreat 2 роки тому

    I come back to this vid every couple of years, and every time I get to the end (after the first time) I *know* what's coming, and yet it still gets me.

  • @succulentcombustiblebacon8487
    @succulentcombustiblebacon8487 2 роки тому +3

    Don't worry about the pace.
    I like this setup. A frosty pint, a drawing board, some pleasantly scratchy markers, and x86 assembly explained by someone who still cares. It's perfect.
    keep doin the thing
    also your doodles would kick my doodles dad's ass.

  • @mranthonymills
    @mranthonymills 5 років тому

    I was just waiting for you to mention self-modifying code, such that you would transform any executable (executable A) into a printable executable (executable A') that would reproduce executable A in memory and then jump to it. But then I noticed that you explicitly forswore the use of self-modifying code, because that would be too easy or something. Hats off to you, my good sir, then!

  • @gafeht
    @gafeht 7 років тому +140

    Why is the compiler a toilet though?

    • @Architector_4
      @Architector_4 7 років тому +49

      Why not? He drew it really nicely, actually .-.

    • @tom7
      @tom7  7 років тому +121

      It is a totally obscure in-joke for a few friends, relating to this cartoon:
      www.cs.cmu.edu/~tom7/csnotes/spring03/compiler-time.gif

    • @gafeht
      @gafeht 7 років тому +12

      oh god lol

    • @Architector_4
      @Architector_4 7 років тому +38

      Woah, removing "compiler-time.gif" from the end of that link reveals more images... That my brain can't make any logical sense of... ._.

    • @TimoSluis
      @TimoSluis 7 років тому +12

      It takes in some shit, does some magical things with it, and still comes out as something that sort of still represents what came into it

  • @alexismandelias
    @alexismandelias 3 роки тому +1

    Best video I've seen in a while. Such a great mix of entertainment, jokes and information. 25 minutes passed so fast!

  • @SuperNintendawg
    @SuperNintendawg 7 років тому +4

    YOU'RE BACK! Excited to watch this video. I was kind of hoping for a unibicle kickstarter video but this will do I guess.

  • @anonymouscommentator
    @anonymouscommentator 2 роки тому

    This guy put the most effort ever into a rickroll in a fun and creative way. I love it.

  • @dantescanline
    @dantescanline 7 років тому +25

    Always a pleasure Tom

    • @kevinpaz3142
      @kevinpaz3142 7 років тому +4

      mick maus I saw what date it was and thought "Hey, Sigbovik (sic) is tomorrow, wonder if Tom7 got anything?"

    • @tom7
      @tom7  7 років тому +5

      Glad you enjoyed it and thanks for watching! (:

  • @DougSalad
    @DougSalad 2 роки тому

    Idk how I missed this one when it dropped, but fantastic stuff. I totally understood it, I swear.
    That said, as soon as you said "music", I knew where this was going, and you did not disappoint.

  • @ChrisLeeW00
    @ChrisLeeW00 7 років тому +4

    I had the duck tales theme stuck in my head all day, and here you are with that shirt. Not important, coincidence is statistically inevitable.

  • @TheFalkon11
    @TheFalkon11 Рік тому

    Only halfway through the video but I love that graph theory shows up here where you wouldn't really expect it to. Maybe it's pretty common when developing compiler, I don't have a ton of experience with that, but something about practical applications of graph theory is so intuitive and satisfying to me.

  • @mekafinchi
    @mekafinchi 2 роки тому +20

    you terrify me

  • @Shadowtrot
    @Shadowtrot 3 роки тому

    I just watched 25 minutes and 13 seconds of interesting nerdy puzzle solving only to find out it was actually-
    too beautiful to put into words.

  • @cocothepoopcatdog6351
    @cocothepoopcatdog6351 7 років тому +5

    I was literally just stalking your page today looking for more content.

  • @DeviousMalcontent2
    @DeviousMalcontent2 2 роки тому

    I must give credence to this video for the exquisite and elaborate way that it plays itself out, 10/10.

  • @danielevans7439
    @danielevans7439 6 років тому +6

    As a security professional (but not a programmer yet), I imagine this concept could be used to hide payloads in viruses. It could even help social engineers breach firewalls. Very interesting.

  • @adriankern1752
    @adriankern1752 2 роки тому +1

    The "FI;" said to be a typo by Intel at 16:57 is not actually a typo. Many pseudo programming languages or markdown languages use the backwards spelling of a certain block to specify the end of said block.

    • @tom7
      @tom7  2 роки тому

      Oh yeah, they use FI to terminate IF all over the place; nothing wrong with that. The typo in this block is that the FI is not matched (it's followed immediately by ELSE).

  • @chaosvisum9167
    @chaosvisum9167 7 років тому +39

    Very impressive presentation. You packed a fantastic amount of information and creativity into 25 minutes?

    • @tom7
      @tom7  7 років тому +10

      Glad it came out okay (for you at least). I felt like it was really difficult to get through it all, since there was so much more to say about everything, and yet 25 minutes seems way too long to hold someone's attention? Thank you for watching :)

    • @MeriaDuck
      @MeriaDuck 3 роки тому +1

      @@tom7 you would've had my attention even if it was a few hours. See also Ben Eater

    • @raghavrao5221
      @raghavrao5221 3 роки тому

      @@tom7 To a very select audience your videos are like nerd crack

  • @streetos
    @streetos 2 роки тому +1

    I loved every second of this. Very well explained demonstration of the most useless yet fascinating thing to do with your paper.

  • @ccgarciab
    @ccgarciab 3 роки тому +3

    This thing is a masterpiece at the level of the orobouros quine. Astounding

  • @DanDeebster
    @DanDeebster 3 роки тому

    I can't believe this video was 25 minutes long, it flew by. Great idea, execution and presentation. I need to up my geek game!

  • @jonthemon4
    @jonthemon4 7 років тому +73

    See you again in 6 months

    • @tom7
      @tom7  7 років тому +88

      hehe cya!

    • @AdrianCastravete
      @AdrianCastravete 7 років тому +13

      OMG! Hahahaha, That totally “terminated” the thread.

    • @ThePharphis
      @ThePharphis 7 років тому

      Hi there

  • @yorgle
    @yorgle 7 років тому +1

    It's always a joy to see that you've posted something new. This is simply amazing, Tom. :D

    • @tom7
      @tom7  7 років тому

      thanks for the encouragement! :)

  • @AssailantLF
    @AssailantLF 7 років тому +87

    YOU'RE SO SMART AND FUNNY AND GOOD AT EXPLAINING THINGS IN A FUN AND ENGAGING WAY
    I WANT TO BE YOU
    How did you become such a wizard?

    • @tom7
      @tom7  7 років тому +68

      Thanks! :) I don't know if I have a short answer for that, but I can say that behind the scenes there's a lot of hard work and anxiety and struggling with motivation and so on. Of course I don't present that part, because it's not that fun to watch, but it's certainly not effortless!

    • @AssailantLF
      @AssailantLF 7 років тому +6

      As an aspiring and amateur developer myself, that's reassuring to hear (not to delight in your struggles ;P)! I worked through most of "C Programming: A Modern Approach" and then about 1/4th of the way through K&R before I got really stumped at some problem and lost my drive a few months ago. I guess it's as simple as getting back on the horse, and staying on until I tame that mofo.
      Sorry for fangasming, but you're definitely a wizard-tier developer and I can't help but be enthralled when I get a taste of the work that you do at the level you're at. Seeing your videos and people like you who are both intellectual and playfully fun is really inspiring, so thanks a ton for your content and explanations and just bein' a cool dude.

    • @velocityra
      @velocityra 7 років тому +23

      Starting an actual project you're interested in is a much better way to learn a programming, or a specific language. Books are only good as a reference IMO, programming is really one of those things that you have to actually *do* to learn it.
      You will forget most things you read from the book, whereas if you start an actual project, you'll remember more, you'll be more motivated, and it'll be way more fun experience overall.

    • @marksmod
      @marksmod 7 років тому +8

      smoke crack

    • @josephroblesjr.8944
      @josephroblesjr.8944 3 роки тому

      @@marksmod lol

  • @tacitus_
    @tacitus_ 2 роки тому +1

    As soon as you mentioned it could play music, I knew what was coming.

  • @lunafoxfire
    @lunafoxfire 7 років тому +520

    EDIT: SPOILERS STOP READING COMMENTS BEFORE THE VIDEO
    ...
    original comment:
    This has got to be the most intense, in-depth rick roll I've ever seen...

    • @killmepls7865
      @killmepls7865 5 років тому +7

      Yeah god damn im shook

    • @nightchicken3517
      @nightchicken3517 3 роки тому +7

      Thank you for the warning

    • @kgallchobhair
      @kgallchobhair 3 роки тому +30

      Way to spoil it for every mobile user :c

    • @voxelfusion9894
      @voxelfusion9894 3 роки тому +2

      @@kgallchobhair your fault for reading comments before the video.

    • @Damaniel3
      @Damaniel3 3 роки тому +1

      Yep. Ran it in DOSbox before I even watched the video - wasn't expecting that.

  • @Jaksonthefox
    @Jaksonthefox 2 роки тому

    INCREDIBLE!
    This is the kind of work that founds new words to describe the nature or kind of work.
    I feel like an executable, printable, fully paper-a-fileable thingie needs a new word to describe it.

  • @odethebear
    @odethebear 5 років тому +3

    This is crazy! I love this project. (Edit after 10 min: Absolutely Love This)

  • @YouB3anz
    @YouB3anz 3 роки тому +1

    This channel is incredible. I will follow you forever

  • @KingJellyfishII
    @KingJellyfishII 5 років тому +6

    That is the hardest rickroll ever my friend.

  • @ptdecker
    @ptdecker 6 років тому

    I’m glad I watched this all the way to the end... it saved me from posting a snarky comment about doing something with your life. But, however much of it you wasted on this was fully worth it.

  • @carchocolate93
    @carchocolate93 7 років тому +4

    I was so hoping that your paper would actually be the compiler

  • @golarac6433
    @golarac6433 7 років тому +2

    I've seen kinda similar thing done on C64, where the BASIC code (which of course you can print) would generate the assembly code and execute it. This is way more advanced though. I like it a lot !

  • @MeinCouch123
    @MeinCouch123 7 років тому +4

    OH SHIT HE'S BACK

  • @calcaware
    @calcaware 5 років тому +1

    This is so cool. Hard to find good content like this.

  • @anferrr
    @anferrr 3 роки тому +4

    16:00 I love how HIS notion her of bad things to execute in case the EIP goes out of program, are non printable things... Not scary system breaking instructions that could be somewhere there xD

  • @AntonioBarba_TheKaneB
    @AntonioBarba_TheKaneB 5 років тому +1

    that piece of 8086 pinout and explanation of I/O ports brings back so many memories :)

  • @thogameskanaal
    @thogameskanaal 7 років тому +10

    Science, mathematics and Hyrule

  • @quantumuninstall
    @quantumuninstall 2 роки тому +1

    I want you to know that I've subscribed because I realize how much the youtube algorithm completely fucks creators like you who create long format content that makes the viewer really think. Its a feat of having the concept, to making sure its presented in a way that's digestible by a wide audience.
    I haven't watched this video yet, but you make masterpieces. Don't stop.

  • @BradenBest
    @BradenBest 5 років тому +7

    16:56 That's not a typo (unless you'd like to show a counterexample). "fi" is a common way to end if statements. It even appears in bash (bourne again shell). Look, there's three of them.
    I do seem to see an error in the second "fi", though. It's indented incorrectly which makes the flow confusing. It should be indented eight more spaces inward to match the "IF EIP < CS.Base O..." line.
    Actually, looking at it again, the shown psuedocode is a huge mess. Given what I can make of the syntax without any context, and removing ugly GNU-isms[1], it should be:
    IF condition THEN
    EIP := EIP + SignExtend(DEST);
    IF OperandSize = 16 THEN
    EIP := EIP AND 0000FFFFH;
    FI; (* IF OperandSize = 16 *)
    ELSE (* indented back for clarity; matches previous IF block; implied: OperandSize = 32 *)
    IF EIP < CS.Base OR EIP > CS.Limit THEN (* Logical and Bitwise operators using the same keywords? This language must be strongly-typed. *)
    #GP
    FI; (* IF EIP < CS.Base ... *)
    FI; (* ELSE (IF OperandSize = 16) *)
    FI; (* IF condition *)
    1. GNU-ism: Horrible formatting choices made by maintainers of GNU software, e.g. using tabs instead of spaces, or putting the bracket on the next line and indenting it between the parent statement and body instead of aligning it with the parent or leaving it on the same line, which has the effect of making code bleed together and making it much harder to tell what indentation level any given line is at. And that latter example is usually combined with two-space indents or tabs.
    Example:
    if(cond)
    {
    do_stuff();
    }
    Now imagine 5,000 lines of that and realize that GNU is not afraid to nest 6+ levels deep or write 400-line functions. Oh yeah, it's bad.

    • @yaroslavpanych2067
      @yaroslavpanych2067 5 років тому +2

      No dude, you actually failed here :D Why do you assume he is to aware of meaning of FI? He spent probably hundreds hours staring in this book.
      In this case, that particular FI in question is a error, it mustn't be there. Look into recent intel instruction set reference, you will find exactly this description, but correct - without first FI. It is just editor mistake.

    • @BradenBest
      @BradenBest 5 років тому

      @@yaroslavpanych2067 So what you're saying is that not only is it my fault that he pointed to the FI, called it a typo, and didn't clarify what he was referring to, but I was somehow supposed to know, without any context, that by "typo", he was referring to a structural logic error and not a spelling/indentation error?
      So it's safe to assume, then, that if I show you a random snippet of code without any context, I can expect you to know everything about that snippet of code just from looking at it?
      Well that's just unrealistic.

    • @BradenBest
      @BradenBest 5 років тому

      @@yaroslavpanych2067 Or are you saying that the FI is an error because it precedes the matching ELSE? That is an unreasonable assumption to make without a visible counterexample to show that self-consistency has been compromised. There is no other example in that snippet of an if/else compound, so it's safe to assume that 'FI' is analogous to '}' from C-like languages.
      What I am claiming:
      IF cond THEN ... FI;
      IF cond THEN ... FI; ELSE ... FI;
      are analogous to
      if (cond) { ... }
      if (cond) { ... } else { ... }
      and are thus perfectly valid.
      And I claim this without the context of the entire book to show any counter examples. There is only the snippet in the video, and what is visible in that moment in time. Therefore, this is what I can _reasonably_ conclude with the given information.
      The problem here is that the guy in the video does NOT attempt to show any counter examples or explain why what he's pointing at is a typo. Instead, he just claims its a typo, and, again without any context, all I can _reasonably_ conclude with the given information is that he must be unfamiliar with "fi" and just said it was a typo in the moment.
      You, on the other hand, are making conclusions that may be drawn from outside information or speculation, conclusions that are specifically not supported by the visible snippet. Therefore, it is unreasonable to claim that I "failed", just as it would be unreasonable to claim that Einstein "failed" in the event that some future discovery demonstrates a massive hole in general relativity.
      In fact, given what can be known from the visible snippet, I can go so far as to say that my assertion was _ostensibly correct,_ as the innermost IF lacks a matching FI, which contradicts the rest of the visible pseudocode, and that therefore _you_ are the one who "failed". I'm not claiming you're wrong, but I _am_ claiming that your expectations are unreasonable.
      That said, I went ahead and edited the OP to be less matter of fact since I was also guilty of speculation.

    • @tom7
      @tom7  5 років тому +10

      @@BradenBest The typo is that the FI; should not be there. It isn't used to end THEN clauses in the book (I think this syntax would be problematic because it would then be ambiguous whether a following ELSE went with that IF or a containing one, which seems contrary to the purpose of using FI in the first place). I wasn't trying to explain the error in the video; I was simply trying to make the case that this stuff is tricky because even the official reference manuals are fallible.

    • @BradenBest
      @BradenBest 5 років тому +1

      @@tom7
      As crappy as 'IF THEN FI ELSE FI' would be (versus IF THEN ELSE FI) design-wise, I have to disagree on the point about ambiguity:
      "I think this syntax would be problematic because it would then be ambiguous whether a following ELSE went with that IF or a containing one[...]"
      There is no ambiguity here. This is what I assume you must be thinking:
      IF A THEN
      IF B THEN
      do_thing_ab
      FI
      ELSE (does this match the inner or outer if?)
      do_thing_a
      FI
      ...
      But again, if FI is analogous to '}', and ends both if and else statements, then it can only mean one thing.
      IF A THEN (nest level 0->1)
      IF B THEN (1->2)
      do_thing_ab
      FI (2->1)
      ELSE *(matches inner if)* (1->2)
      do_thing_a
      FI (2->1)
      FI (ends outer if) (1->0)
      It's crappy, but it's not ambiguous.
      IF A THEN
      IF B THEN
      do_thing_ab
      FI
      ELSE (matches inner if)
      do_thing_a
      FI
      FI
      IF A THEN
      IF B THEN
      do_thing_ab
      FI
      FI
      ELSE (matches outer if)
      do_thing_c
      FI
      And the same things but with the THEN's replaced with {, FI's replaced with }, and the implicit open statement on each ELSE replaced with {:
      IF A {
      IF B {
      do_thing_ab
      }
      ELSE {
      do_thing_a
      }
      }
      IF A {
      IF B {
      do_thing_ab
      }
      }
      ELSE {
      do_thing_c
      }

  • @LewisCowles
    @LewisCowles 7 років тому +2

    Bloody love this guys video's because they are interesting but convey next to nothing but the emotion of interest

  • @Onychoprion27
    @Onychoprion27 7 років тому +3

    You, sir, are a genius.

  • @NethTech
    @NethTech 5 років тому

    When I realized you solved the jmp instruction problem by utilizing an overflow I audibly exclaimed. Wouldn't have ever considered that as a solution, smart.

    • @BradenBest
      @BradenBest 5 років тому +1

      Interesting. Overflow was the first thing my mind jumped to (if you can't go back, then go so far forward that you wrap around). Futurama even has an episode that jokes about overflow, but with time travel. The Late Philip J. Fry.

    • @NethTech
      @NethTech 5 років тому +1

      @@BradenBest Im just so used to overflows being most commonly used in security research practices, finding a valid reason to utilize an overflow for a practical programming problem was neat to see.

  • @thelegend8570
    @thelegend8570 3 роки тому +4

    As soon as he said it would play music I knew what was coming.

  • @bobdavelisafrank_4850
    @bobdavelisafrank_4850 2 роки тому +1

    at 9:04, instead of using (A and B) + (A xor B) and needing to implement addition to do the 'or' function, you could also just do (A and B) xor (A xor B)! Since the 'and' of the two numbers never has a 1 in the same place as the 'xor' of the two numbers, 'xor' gives you the behavior you wanted from 'or' to combine the two.

  • @IAMDonk
    @IAMDonk 7 років тому +6

    This video shows there's an overlap with printable ASCII and x86 binary. That's cool, but not entirely surprising. You've even shows how binary operations work, I feel most C programmers would already be familiar. Why haven't you shown anything about how you wrote an entire C compiler?

    • @tom7
      @tom7  7 років тому +12

      It's hard to know what subset of the work the audience will already be familiar with, so I just tried to pick a few interesting parts and weave a story around them while assuming as little as possible. C compilation is interesting and I could do a whole 5-hour video series on it, but it needs some background and is also pretty standard in this case. It's not until you get fairly low level that the constraints of the instruction set start causing problems.

    • @ThePharphis
      @ThePharphis 7 років тому +3

      Dude anything about compilation or low-mid level content is very good.
      I've just finished a microcomputing course so basically covered most of this material for the motorola 86k processor and that helped a lot. I watched this video last year when I knew virtually nothing, and there's quite the difference in understanding, even being unfamiliar with this version of assembly.

  • @123sleepygamer
    @123sleepygamer Рік тому

    I'm a hardware/networking guy, so half of this video was alien tongues but damn was it a great video. Every video you make is unique and special, in a sea of saturation. Keep doing what you are doing.

  • @darren8453
    @darren8453 7 років тому +13

    As a developer, I'm now wondering how often you ran this manually and rick-rolled yourself in the course of making this.

    • @tom7
      @tom7  7 років тому +18

      Not to mention the times I subconsciously rickrolled myself from having it stuck in my head and humming it...

    • @darren8453
      @darren8453 7 років тому +1

      suckerpinch now I have it stuck in my head again!!!

  • @renxula
    @renxula 7 років тому +2

    Excellent video, good sir! I know a thing or two about programming and stuff, but you managed to avoid spending too much time explaining the basics, and concentrated on the good stuff instead. So good job on that, and on creating the (mostly useless) compiler itself as well!

  • @Milkakuh
    @Milkakuh 7 років тому +6

    Now I want to know what is the minimum amount of commands to have full functionality.

    • @verymuchgoodgaming132
      @verymuchgoodgaming132 7 років тому +7

      Peter GANS there are some interesting hypothetical computers with only 1 instruction, and are still turing complete 👌en.m.wikipedia.org/wiki/One_instruction_set_computer

    • @Darwin226
      @Darwin226 7 років тому +6

      Check out movfuscator github.com/xoreaxeaxeax/movfuscator

    • @Rabarberium
      @Rabarberium 7 років тому +5

      A lot of them, apparently. There's a Defcon talk about the "Movfuscator" which implements x86 with the Mov instruction, and while it was a while ago that I watched it, I think he achieved full functionality. He mentions a couple of other single instructions that have the same property.

    • @puffles234
      @puffles234 7 років тому +3

      Any instruction that can be used in a way to simulate a MOV can be used like the movfuscator (also, the movfuscator cheats by abusing interrupts and using bogus mov instructions to trigger interrupts)

    • @Milkakuh
      @Milkakuh 7 років тому +3

      Maybe I did not understand that right, but we still need alot of different integers for the arguments which suckerpinch restricted to only printable ones.

  • @cbrpnk
    @cbrpnk 7 років тому +3

    You're a cool person, I hope to see more content of this nature on your channel in the future. Awesome work!

  • @johnpetersen5341
    @johnpetersen5341 7 років тому +3

    I loved this! I have no experience with assembly but I understood everything perfectly.
    Quick question, when you were implementing OR, you had (a AND b) + (a XOR b)... why not (a AND b) XOR (a XOR b)? I'm sure addition is needed elsewhere, but when you want the OR of two values that are bitwise exclusive, XOR seems like a natural choice.
    Also - can you make a quine in your printable x86?

    • @rexviperfan
      @rexviperfan 7 років тому

      You can not make a quine as there is no way to print, INT 21 is inaccessible. Well, it is only accessible one time throughout the lifetime of your program, and it's necessary to quit. I assume he used + because it segways into the next part, as in the paper he jumps into addition immediately after explaining how to implement or.

    • @tom7
      @tom7  7 років тому +1

      Yeah, quine was my first thought; it would have been a very elegant knot. It might be possible to print using some other tricks (or direct software access), but I couldn't figure it out before the deadline. Id' also have to grapple with the difficulties with assembling (due to instructions that change size with different immediates), which could maybe make solving for a quine very hard.
      I actually hadn't noticed the XOR trick (clearly better), but + is a nice segue as AODQ says, so I'm kinda glad I didn't. :)

    • @johnpetersen5341
      @johnpetersen5341 7 років тому

      He said exactly that a day before you posted... and it's 'segue'.

    • @rexviperfan
      @rexviperfan 7 років тому

      He did? Didn't see it. Well I suppose he said everything in the paper itself. And yea it's segue.

  • @sammikinsderp
    @sammikinsderp Рік тому

    The most elaborate rick roll I've ever been a victim of. Well played, Sir.