CoPilot Review: My Thoughts After 6 Months

Поділитися
Вставка
  • Опубліковано 25 лис 2024

КОМЕНТАРІ • 656

  • @ThePrimeagen
    @ThePrimeagen  Рік тому +432

    6 months.... IT HAS SCREWED ME MANY TIMES. I hope you like it :)

    • @mitchellmnr
      @mitchellmnr Рік тому +11

      I started using co-pilot less than a month ago and I've already spent hours trying to work out what on earth was going on ... copilot wrote code.
      So 100% with you, boilerplate code is freaking awesome, just gets the fluff out the way quickly so you can get down and dirty.
      But don't let co-pilot code :D

    • @jjmachan
      @jjmachan Рік тому

      thank you for that coverage. more videos like this prime🙌
      and thanks for all ur videos/rants/advice so far....has been super helpful 🙂

    • @RadHard
      @RadHard Рік тому +1

      As junior I'm tring to use it only to fill variables and write comments faster. When it suggests me whole bunch of code sometimes I read it or just ignore it. Like chat gpt it gives some ideas but I would not trust it enough to just copy paste.

    • @sergeykuznetsov7688
      @sergeykuznetsov7688 Рік тому +1

      Didn't you write tests for generated code? :)

    • @thecodecatalyst
      @thecodecatalyst Рік тому +1

      I agree with you, copilot is great for boilerplate but in the end you need to know your game and be in controll of what is going on.

  • @u0000-u2x
    @u0000-u2x Рік тому +1754

    So basically copilot is a great excel corner-drag-fill-thing

    • @NathanHedglin
      @NathanHedglin Рік тому +38

      Yup

    • @MonoDigital
      @MonoDigital Рік тому +43

      Perfect analogy!

    • @abacuswithrehan264
      @abacuswithrehan264 Рік тому +1

      Perfect

    • @ToddMagnussonWasHere
      @ToddMagnussonWasHere Рік тому +24

      Mr Paperclip’s grandson.

    • @Leto2ndAtreides
      @Leto2ndAtreides Рік тому +12

      Realistically, we often aren't giving it enough information to make good judgments - it has to guess from code we're writing, what we really intend.
      Comments do help in creating context.
      And, of course... more powerful models are coming (though they'll likely cost more).

  • @RickWeberEcon
    @RickWeberEcon Рік тому +640

    Working with these LLMs is like managing a team of brilliant high school interns. They're brilliant, but they're also teenagers. Manage them wisely and they'll multiply your abilities (at least within some narrow domain). Let them walk all over you and they'll write garbage faster than you can pick it up.

    • @barbietripping
      @barbietripping Рік тому +72

      Can confirm. Those kids wrote my username

    • @israelafangideh
      @israelafangideh Рік тому

      @@barbietripping 😂😂😂😂

    • @dr.mikeybee
      @dr.mikeybee Рік тому +4

      Have the LLM write you a unit test first, then run the snippet it produces from the unit test. ;)

    • @piotr780
      @piotr780 Рік тому +1

      noooo, you can't manage teenagers

    • @supernova82
      @supernova82 Рік тому +8

      You are overestimating these tools. It is mostly like training a parrot and then asking him to write your code. Both Parrot and AI don't know what they are doing but they are pretty good at repeating things.

  • @jeremybuckets
    @jeremybuckets Рік тому +430

    You know how the worst part of your job is combing through a junior dev’s PR to make sure they aren’t going to break everything if their code gets merged? Now with CoPilot you can have that experience writing your own code too!

    • @nextlifeonearth
      @nextlifeonearth Рік тому +8

      I love that part of code reviews. Once I'm on a roll to find potential issues in a PR I don't hold back.
      I once had a PR with 400 loc changes and I must have put a comment on every other line, sometimes multiple ones.
      The best part is seeing them do something with that feedback.
      More senior engineers tend to think they know better and cannot be steered to a better solution without a lot more effort.

    • @youtubeceoruinedyoutube
      @youtubeceoruinedyoutube Рік тому +2

      Exactly. Just seems like you’re signing up to work with an idiot that is constantly trying to merge garbage code. No thanks.

  • @scottiedoesno
    @scottiedoesno Рік тому +388

    Having spent a few months letting copilot write bugs for me, I'm no longer worried that it's going to take my job. Also, adding copilot to cmp seems to be the better option for me since it's easier to ignore bad suggestions. Love the video, been waiting for the review!

    • @ThePrimeagen
      @ThePrimeagen  Рік тому +40

      i tried! i was reallllly thinking about it

    • @ronniebasak96
      @ronniebasak96 Рік тому +24

      Wait for them to launch the captain. It's copilot what did you expect

    • @abbashaider7165
      @abbashaider7165 Рік тому +5

      @@ronniebasak96 Yeah, the name implicitly means you're the captain, so you can already guess what Co-pilot had to offer

    • @__sassan__
      @__sassan__ Рік тому

      I am using it with cmp too, but I do not understand how/when it decides to spit out multiline suggestions.

    • @alexp6869
      @alexp6869 Рік тому +3

      What is cmp?

  • @JFrameMan
    @JFrameMan Рік тому +76

    copilot is the best if you're using it to make development fun. If you let it take care of filling in the boring things like lists of constants, filling out predictable arguments, filling out syntax that's easy to forget, you end up having way more fun writing out the logic that requires actual thinking. If you use it to fill in logic, even if it did it correctly 100% of the time, you're going to get disillusioned with the whole dev experience and you won't have any fun feeling confused and like you're not leveling up your skills at all.

    • @greglocker2124
      @greglocker2124 Рік тому +2

      You must still be new

    • @JFrameMan
      @JFrameMan Рік тому +1

      @@greglocker2124 I am. I'm only a month past the trial period. Anything I should know?

    • @lazymass
      @lazymass Рік тому +11

      @@JFrameMan I think hes burned out developer and he meant that because you still have fun writing code, you must be new into programming... dont listen to him, programming is fun, just dont get stuck on one position for too long...

  • @thfsilvab
    @thfsilvab Рік тому +120

    Using it for a month, I really enjoy it writing boilerplate for me, but I enjoy it more when it writes unit tests for me!!! I've got some whole suit of tests entirely written by Copilot with few fixes from my part!

    • @nickmoore5105
      @nickmoore5105 Рік тому +16

      Yeah, I've found this, too; copilot is really good for spitting out unit tests for your code. It even comes up with test ideas I should have thought of. I'm just like tab tab tab tab tab tab tab thanks for the 6 new tests

    • @wokeclub1844
      @wokeclub1844 Рік тому +9

      how to ask copilot for unit tests? just comment that you want unit tests?

    • @aoeu256
      @aoeu256 Рік тому

      Can you write the test cases or what you want instead first, then have copilot fill in the code?

  • @nonstopper
    @nonstopper Рік тому +217

    Co pilot has only been good for me as a small intellisense snippet engine. Its been dead wrong when I let it write more than 50 characters honestly.

    • @ThePrimeagen
      @ThePrimeagen  Рік тому +43

      agreed

    • @josephp.3341
      @josephp.3341 Рік тому +14

      Same experience here. Its wonderful as a boilerplate elimination tool.

    • @martq2283
      @martq2283 Рік тому

      @@josephp.3341 nay

    • @adriandmochowski9391
      @adriandmochowski9391 Рік тому +3

      @@josephp.3341 Use a language with less boilerplate then? Yeah, I know, radical idea 😜

    • @JayMCSSK
      @JayMCSSK Рік тому

      @@adriandmochowski9391 Redux has entered the chat

  • @remrevo3944
    @remrevo3944 Рік тому +50

    3:43 There is actually even a better way to prevent this bug than adding the condition:
    Instead of using a condition you can match against the slice of self.frames (match &self.frame[..]) and then use [first, .., last] as pattern to guarantee that first and last are not the same element, while being both more readable and less error prone.

  • @myestery
    @myestery Рік тому +27

    Copilot has really improved my scope in terms of backend programming.
    All helper functions I need are auto generated, even the ones I didn't know I needed.
    Also in terms of translation of a requirement I copied somewhere or a json I need to manually write

  • @NNOTM
    @NNOTM Рік тому +17

    I find that it's good for rewriting existing code. E.g. a couple days ago during a Scala code review, I saw someone had a long chain of matching on Optional values, and I wrote `// instead we use a for-comprehension`, and Copilot perfectly rewrote the code as a for-comprehension.

  • @simple-security
    @simple-security Рік тому +5

    Coming from the opposite end of the spectrum (i.e. noob coder), I've been using copilot to write simple 1 or 2 page python scripts, eg for api pulls and sorts.
    For basic 'get a task done', where you're not concerned about quality coding, just getting a simple job done, it's been a dream come true.
    Yes I hit many errors, but not the type of issues I used to have that would make me quit and figure out a non-code manual way around my task.
    The gamechanger for me is I don't have to read several books, watch hours of tutorials, and become an expert at troubleshooting to get simple things done.
    AND yes I do learn a lot of python commands and syntax tips from CoPilot in a much more effective and faster way than I would through standard learning methods.
    In fact when copilot gets something wrong it's sort of a game to figure out what it's suggesting vs what you're trying to do.

  • @KeithWhittingham
    @KeithWhittingham Рік тому +41

    My experience exactly after 4 months.
    My take is that you code faster in the beginning but the gain becomes less and less.
    Coding is much more tiring because you don't have to write the stuff that require less thought. You're always working in the hard bits.
    It won't replace good programmers.
    It will reduce the number of good programmers because beginners will rely on it.

    • @thomasdinh2k
      @thomasdinh2k Рік тому

      so your advice to new learner is to avoid using CoPilot?

    • @JayMCSSK
      @JayMCSSK Рік тому

      @@thomasdinh2k No, learn to use it like this guy. It's an intellisense monster for sure. Don't let it write your code. Use it to fill in the blanks.

    • @exnihilonihilfit6316
      @exnihilonihilfit6316 Рік тому

      Wrong. The "hard bits" are precisely the precious, _creative_ bits. The part that the most productive (and precious) programmers are more _willing_ to do. (like doing your pushups vs watching TV😄)

  • @heroe1486
    @heroe1486 Рік тому +18

    Using it for a week and I love the autocompletion so far, no amount of vim skills could save you that many key strokes, like writing arguments + types a have never been that fast, when I'm doing something obvious/easily understandable and it spots it or the pattern it's also cool, it takes some corrections but it's faster than from scratch.
    I still have a key mapping to toggle it tho since it can be annoying if you're focusing on doing something non trivial and it proposes you nonsense.

  • @AssemblyWizard
    @AssemblyWizard Рік тому +22

    The fps function should use (n-1) for the calculation rather than n. Consider having 3 frames, one per second. So the duration difference between the first & third is 2 seconds, then you're dividing by 3.

  • @jordanasghar6419
    @jordanasghar6419 Рік тому +4

    The summary is my exact experience of copilot. For languages I consider myself competent in, I love copilot. It helps smooth out the boilerplate and I generally can provide it with enough context to guess what I'm up to.
    For languages I'm learning, I generally turn it off and debug interactively with gpt

  • @antidotejack2771
    @antidotejack2771 Рік тому +13

    Copilot is such a complete tool, not only writes code for you, also writes bugs for you! Freaking awesome!

  • @ricardopieper11
    @ricardopieper11 Рік тому +12

    One other thing that Copilot is really good is generating code for an API that you're unfamiliar with. I had to do some stripe scripts to check that all invoices were generated correctly. It would take like 30 minutes of me looking at the documentation, working through all that text, instead Copilot generated the code for me in 3 minutes. But it was still important that I knew some details on how the API worked beforehand, so I had the opportunity to fix some of the bugs before they happened.
    If I hadn't knew the Stripe API details beforehand, maybe it would take like 10 minutes. Still better than 30.

    • @aure6898
      @aure6898 Рік тому +3

      I think this is where it's most dangerous as well though, especially if one starts to do this regularly. Imagine it writes some code for an API that you don't understand, you haphazardly review it and then there is some subtle bug that isn't caught. I wouldn't want to let copilot write any code for me for which I don't already know what it should more or less look like beforehand. That being said, I think it can be really useful in quickly getting to know the API, and writing some rough prototype code.

    • @ricardopieper11
      @ricardopieper11 Рік тому

      @@aure6898 I definitely think the same. It's good for early API exploration or obvious/unsurprising code generation.
      Actually, since I made that comment, my perception of Copilot's usefulness has been reduced significantly. It seems to be good only at doing the obvious (pattern repetition, copy pasting, etc) and requires a lot of guidance in most places. In my compiler, it just doesn't understand much and resorts to dissing my code by saying "this is a hack but should work for now".... frankly, Copilot is not wrong there lol but it's just not that useful.

  • @strikeeaglechase1582
    @strikeeaglechase1582 Рік тому +18

    I extremely rarely let copilot write multiple lines of code, but as single-line automcomplete iv found it incredible

  • @arturmonteiro1929
    @arturmonteiro1929 Рік тому +42

    Honestly the best thing copilot has done for me is speeding up writing unit tests
    Not only will it take out any of the boiler plate around, for example, mounting components, but also, if you give a good enough name to your test case and it is a simple case, it easily create it for you

    • @wawbagel
      @wawbagel Рік тому +2

      You do realize that what is basically does is stealing licensed open source code? Using it is unethical.

    • @javierflores09
      @javierflores09 Рік тому

      @@wawbagel do you realize that no one fucking cares? Blame Microsoft for it, not the consumers

    • @bryanhoffman4331
      @bryanhoffman4331 Рік тому +8

      After spending all day today writing unit tests, this is the straw that is making me try copilot.

    • @wawbagel
      @wawbagel Рік тому +1

      @@javierflores09 consumers are just as guilty as the creators are.

    • @javierflores09
      @javierflores09 Рік тому +3

      @@wawbagel no they are not, you are using a phone that was most likely made from child exploitation in China yet I am not blaming you here for it, but Apple or Samsung, or whatever phone manufacturer you are going with. You can't blame the consumer because they can do little about it other than protesting, besides rather than being unethical it is just of dubious moral, it isn't as simple of a problem as people make it seem

  • @DaddyFrosty
    @DaddyFrosty Рік тому +5

    Another great use for Copilot is inline documentation, like in C# you can document functions with XML and I find that Copilot is a treat in those situations, and if the comment is invalid you just CTRL Backspace a bit and correct it.

  • @painperdu6740
    @painperdu6740 Рік тому +16

    i love the energy, the talent, the editing, keep up the good work !

  • @rianfuro4088
    @rianfuro4088 Рік тому +2

    Exactly my experience as well. I love copilot for taking over the boring work for me, so I can spend my time actually tackling the difficult stuff. Writing boilerplate, filling translation files, mapping data from one structure into another and interestingly documenting my code are now all things I spend less time on, since copilot usually gets these things done for me.

  • @reeethan
    @reeethan Рік тому +11

    I find that for C# Unity development, it's really good at filling in the boilerplatery stuff, like the caching of get components. It's also good at knowing what kinda stuff you'll likely do with certain variables, probably because gamedev code is so similar a lot of the time. But yeah, I only use it to fill in a line of code, but still, I use it quite often and would probably feel the pain without it.

    • @NicolasSouthern
      @NicolasSouthern Рік тому +2

      Unity dev here too, I use it the same exact way. One line at a time. I also find it incredibly good at writing SQL queries/strings, as it knows what I want to fetch and can just know what my database schema looks like somehow. Try using vscode on a plane one day, you’ll find yourself typing then stopping to wait for the auto complete and then realize a few moments later it’s not coming 😅

    • @rentefald
      @rentefald Рік тому

      @@NicolasSouthern Okay, Mr. 1000 lines of code each day. Maybe you should disable auto completion or even better remove all your so-called productivity tools.

    • @NicolasSouthern
      @NicolasSouthern Рік тому +4

      @@rentefald nah, I’ll keep using them. These productivity tools assisted me in getting a product from theory to market in probably half the time and it’s currently generating a solid income for me. I don’t need to write every for loop to feel good about myself.
      Thanks for the suggestion though!

    • @strictnonconformist7369
      @strictnonconformist7369 Рік тому +3

      @@rentefald this is a tool that is like a power tool in the hand of an experienced woodworker versus a power tool in the hands of an inexperienced woodworker: the experienced woodworker will get their project done faster, the inexperienced woodworker will likely botch their raw lumber that much faster than using hand tools, and may take off their hand in the first place.
      I find it comical someone in the field of automating things as the job description is screaming at others to avoid automating the task of automating things as much as feasible: it's the epitome of extreme hypocrisy personified.

  • @asdougl
    @asdougl Рік тому +1

    It definitely shines the most on those line-by-line suggestions when you name variables and functions intelligently, it can pretty quickly work out what you're trying to do let you just tap away at tab whilst confirming each line is what you were going to type anyway.

  • @LucasGarfield
    @LucasGarfield Рік тому +1

    Super helpful video, I've been using Copilot myself recently for the past month and have had the feeling I spend more time reading and rejecting bad code than I save from accepting good code. Love the idea of just rejecting the logic from the get go.

  • @kell7689
    @kell7689 11 місяців тому +1

    Copilot has been an **insane** boost to my productivity in all ways. Just a matter of learning what it's good at and where it falls short. Easily the best dev tool I've ever used.

  • @dyslexicsteak897
    @dyslexicsteak897 Рік тому +5

    div by 0 is defined in IEEE754, you do get a inf in rust too
    edit: for floating point types

  • @julioeliseovallsmartinez5422
    @julioeliseovallsmartinez5422 Рік тому +4

    Something that copilot was amazing at, generating translations. Something incredibly time consuming and tedious when you're a solo dev.

  • @DaneDuPlessis
    @DaneDuPlessis Рік тому

    Thank you for taking the pain for us all! I've been thinking about jumping into using Copilot but honestly I don't write all that much boilerplate in my current job.

  • @DanielKaspo
    @DanielKaspo Рік тому +1

    Love this so much, been using Co-Pilot and had a few moments where I'm like "No wait, that's a bug!"
    The biggest difference between me and you though is that when I used Co-Pilot, it had actually wrote code for an edge-case and I created a bug by trying to correct it 😂

  • @wmcphail
    @wmcphail Рік тому

    @ThePrimeagen not related to the video at all, BUT I just discovered "The Last Algorithms & Data Structures Course You'll Ever Need", and I'm so fucking excited. I've learned this stuff several times, but I feel like everything kinda leaves my mind if I'm not practicing... and it has been some time. Getting ready for job interviews, this feels like a godsend. I fucking love you man. Thank you so much! Keep doing what you're doing brotha!!

  • @RobertFletcherOBE
    @RobertFletcherOBE Рік тому

    I've found it fantastic for fleshing out comments. They always need more work but sometimes getting the bulk down is great

  • @iagosrodrigues
    @iagosrodrigues Рік тому +2

    One thing to mention when working for a company is data privacy because regular subscriptions have telemetry and data collection.

    • @wawbagel
      @wawbagel Рік тому +1

      Not only data privacy but also licensing. It’s known for basically stealing large pieces of licenses open source software without respecting its licenses. There’re ongoing legal issues against msft and other related companies due to that fact.

  • @LukeAvedon
    @LukeAvedon Рік тому +1

    Ahhhhhh WOW the quicksort example is so perfect and perfectly points out the problem with these a.i. tools.

    • @ThePrimeagen
      @ThePrimeagen  Рік тому

      Yes, it does. People don't realize exactly how sinister these problems are. Because quick sort has a step-by-step solution, most problems I solve don't

  • @marlopainter8246
    @marlopainter8246 Рік тому

    I started writing mongoose schemas, and its suggestions were great. When creating a few specific schemas, it even suggested fields that slipped my mind. I loved it for that. However, that's all I used it for, so far. I've been making sure my data models can handle the feature set I want before coding anything else. We shall see what happens when I actually get into things.

  • @webstradev
    @webstradev Рік тому +1

    Great video. Hit the hammer on the nail at the end when saying it basically works extremely well when you are already at the top of your game and just needing to smash out boilerplate. Personally I would add one suggestion/clarification to the last section.
    If you're a junior, I would also highly advise AGAINST using copilot, but I would extend that to any level of engineer that is starting at a new (existing) company, and coming into a codebase they have no knowledge of yet. Knowing the ins and out of the codebase you are in plays a big factor in how quickly you spot copilot's mistakes/inaccuracies.
    Other than that Awesome Vid!

    • @lepidoptera9337
      @lepidoptera9337 Рік тому

      If you are at the top of your game, why are you writing boilerplate? All that means is that you haven't been able to create an efficient environment for yourself and your team.

  • @wmarple
    @wmarple Рік тому +1

    Totally agree with this take. I'm a full stack web dev and have also been using it for about 6 ish months and have come to very similar conclusions. I will say that for me it's worth the subscription fee just for the efficiency gain I get from it auto filling boilerplate. And every once in a great while it does spit out some logic that is actually sound...

  • @AlanJohnson-w7w
    @AlanJohnson-w7w 9 місяців тому +1

    Copilot needs to write the test first, then once they are reviewed, then write the code to make the test work. This will remove the bugs. Since the responsibility is back on the developer to ensure the semantics of the system behaviors are well captured in the tests.

  • @claytonmarshall1308
    @claytonmarshall1308 Рік тому +2

    Best use case for me so far has been auto-completing protobuf specs and auto-filling Go struct tags *chefs kiss*

    • @ThePrimeagen
      @ThePrimeagen  Рік тому +1

      EXACTLY! that is where things are great.
      that logical boilerplate

  • @jshym1
    @jshym1 Рік тому +5

    What I find really usefull is wiring unit tests with copilot. Have you tried it? This works really great if you have existing tests and want to add more cases. Just name the function properly and copilot does most of the work :)

  • @ao3497
    @ao3497 Рік тому

    -Out of context
    You really made my life a bit better, I'm not in my best moment, but you give me the motivation enough to keep going cause you're a "real" whatever that means, just want to say thank you dude.

  • @papricasix
    @papricasix Рік тому +1

    Great summary. It kind of reflects my thoughts about Copilot as well! 🎉

  • @frroossst4267
    @frroossst4267 Рік тому +1

    This is basically how I have been using co-pilot, mind you I'm a student, and copilot is extremely useful for redundant tasks, basically copy-paste on steroids. I once let it write some assembly and boy did not work out well.

  • @RyanLynch1
    @RyanLynch1 Рік тому

    it's also great at translating my logic and teaching me the proper syntax when given a large codebase. i'm surprised at how quickly it can learn quirks like that

  • @dannydevs
    @dannydevs Рік тому

    You are legendary already. Thank you for your service--every video I watch levels me up.

  • @MartinCharles
    @MartinCharles 10 місяців тому

    This is a great concise review of where it falls short. It has screwed me majorly twice by generating incorrect code which looked right at first glance. Like honestly I got lazy and let copilot fill in the blanks for code I could have written myself faster than I could have verified. The two outages eviscerated any marginal time improvement spent typing.

    • @MartinCharles
      @MartinCharles 10 місяців тому

      Honestly if you have boilerplate in your codebase instead of fixing it with copilot, you might want to ask why you have boilerplate everywhere. Every line of boilerplate you write you gotta read too at some point.

  • @jdubz8173
    @jdubz8173 Рік тому

    Def agree with this. I feel like co-pilot has been great at typing out things for me that had pretty clear in-context "templating" provided by me, but I would never trust the code it actually provides on its own. It's also great if you're just mentally blocked and you just need some kind of starting place to work with.

  • @aGj2fiebP3ekso7wQpnd1Lhd
    @aGj2fiebP3ekso7wQpnd1Lhd Рік тому

    Nailed it. 😂 I use it mainly for line completion, boilerplate, and on occasion, it will surprise me with a logical suggestion. $10/mo likely makes me 10% more productive.

  • @axelra82
    @axelra82 Рік тому +6

    100% This is a great boilerplate tool if you know what you are looking at. I've been trying it out for about 2 months and like it (I take it with a grain of salt, it's still in the early stages).
    I have tried reasoning with GPT as well about code logic, it can handle smaller issues which can mostly be chalked up to me not being focused for whatever reason... throw "actual" problems on it and chances are you'll get a good laugh 😂 At least in its current state 😊

    • @wawbagel
      @wawbagel Рік тому

      It’s an language prediction tool optimized for English. You do realize that, don’t you? How can you possibly reason about anything with a prediction tool? 🤔

    • @heroe1486
      @heroe1486 Рік тому

      Even trivial stuff seems too much for chat GPT, I'm on the Plus version and it's the same btw.
      I feel like it's better to subdivide your problem into smaller chunks and ask him about it then do your thing.

    • @MA-ck4wu
      @MA-ck4wu Рік тому

      @@wawbagel ChatGPT is exactly like women. They're not good at logic or reasoning, they rely heavily on predicting what the situation/context calls for.

    • @axelra82
      @axelra82 Рік тому

      ​@@wawbagel haha, yes... I understand what it is. That fact that it's has the ability to generate responses based on collected data allows it to have responses based on specific questions. In that sense you can "reason" with it to understand how it came to a particular "conclusion" (i.e. why it responded the way it did). I'm not claiming to have philosophical discussions with it, but rather having a "back-n-forth" based on a specific topic, nothing more nothing less.
      So far the way I've heard it described by others, e.g. Mr. Wozniak, is "... I haven't seen any intelligence in these yet" (not verbatim). I think most would agree that there is no "intelligence" going on there, but rather as you describe it, a prediction tool. I would still argue that you can have a "conversation" with it and given the information it provides draw conclusions based on that. Making sure that you don't take anything it claims at face value.
      PS. I've used in my native language (Swedish) as well, so far it seems to deal with that just fine with the exception of some funny sentence structures.

    • @axelra82
      @axelra82 Рік тому

      @@heroe1486 100% agree on that. I've definitely noticed it having problems with larger sets at once. In a sense I like the effect it has though (just from a perspective of trying to stay positive). It forces the user to actually break down the issue to its smallest component(s) and deal with them one by one, which is generally a good way of dealing with engineering issues 🙂
      So you could almost say that by proxy it's "teaching" you to break down things to better understand the problem (and as a result maybe even the entire thing you're working on)... Even though this is an unintended consequence of the product 😅
      But yes, simple coding issues (e.g. framework specific) that I usually just end up fixing by reading documentation or scraping forums are a little amusing... where I was hoping it could just find the issue I missed because of insufficient experience with a framework, but it just spits out nonsense, and the answer was fairly simple once I understood the issue properly (from just reading).

  • @gladfilm
    @gladfilm Рік тому +7

    Right, GH Copilot is good for autocompletion, and doing some boilerplate stuff like wrapping hardcoded strings in translateable components. It's exceptionally good for writing tests for existing functions or components, saves so much keystrokes! However, you should always skim through the suggested code and do the corrections, because it suggest erroneous stuff pretty often, and you can't just blindly trust it. Just as it was pointed out in the video.
    Overall, GH Copilot can significantly improve your productivity by reducing the amount of typing, but it cannot replace a human coder (yet).

  • @smudgepost
    @smudgepost Рік тому

    As a noob coder, this guy is talking Swahili! Good job.. we need people like you

  • @dr.mikeybee
    @dr.mikeybee Рік тому

    I'm so glad they've made a Copilot vi plugin for you.

  • @robinerlacher679
    @robinerlacher679 11 місяців тому

    i like the autocompletion, used the copilot chat for hints to fix my code and use mostly the /doc command, when a method/function is finished it creates a really nice ///summary in c# 😊

  • @makeitreality457
    @makeitreality457 Рік тому

    It's also good for coming up with recent (up until 2019, or later with web plugin) libraries and functions to use. If you aren't sure where to start, it will try to do something with some functions and libraries that maybe didn't exist while I was learning to code. Then I will delete all the logic, research the APIs, and write my own using those newer tools it suggested. Having it create boilerplate in places where it can't screw up much. Because yes, it often gets creative with the bug creation.

  • @mannycalavera121
    @mannycalavera121 Рік тому +2

    I like this short no thinky videos, easier on the brain

    • @ThePrimeagen
      @ThePrimeagen  Рік тому

      can you elaborate?

    • @mannycalavera121
      @mannycalavera121 Рік тому

      @@ThePrimeagen i watch your videos to chill and lighten my mood, good to turn the brain off and watch an entertaining but enlightening shortish video now and again. Compliment, and probably good for the add revenue, that's all :)

  • @mike-barber
    @mike-barber Рік тому +3

    I strongly dislike a bunch of unnecessary boilerplate, so I'm genuinely not happy that copilot makes it easier to just generate a bunch of extra boilerplate so easily. IMO, it's _supposed_ to be annoying to type it all out, and this is usually a good signal that perhaps a better design is needed.

  • @ahmedifhaam7266
    @ahmedifhaam7266 Рік тому

    I know you really liked the DTO functionality of co-pilot, but almost all existing basic intellisense can already do it, just thought I'd mention that, love the vibe of your video, quite informative, thanks.

  • @tildesarecool7782
    @tildesarecool7782 Рік тому

    I don't know what this guy is saying but he's saying it in such a compelling way I subscribed

  • @1234matthewjohnson
    @1234matthewjohnson Рік тому +1

    use it daily, saves me a bunch of times, but i also just turn it off constantly, great for boiler plate stuff and good for some ideas i didnt think of

  • @eango
    @eango Рік тому

    i agree this is how i use copilot too, sometimes wish it was a setting to turn off those long suggestions.
    i also usually don't do the "comment driven development" thing BUT i do find that it is useful for writing unit tests honestly

    • @gonzalomunoz2767
      @gonzalomunoz2767 Рік тому +1

      You can ctrl+right to accept suggestions word by word instead of as a block. I use it quite frequently bc it's annoying when you just need some boilerplate and it thinks you need a whole 15 lines implementation of the thing

  • @k98killer
    @k98killer Рік тому

    The Go LSP takes care of a lot of boilerplate without having to use any fancy AI. I just start initializing a struct object, double activate the suggestion keymap, and all the struct initialization lines are populated.
    And the best part about not using an AI to write my bugs is that I get to write them myself.

  • @naranyala_dev
    @naranyala_dev Рік тому +1

    Got it, using Copilot to generate boilerplate and types. We still need to fix the code logic ourselves, at least Copilot gives us directions on where to start.

  • @mario7501
    @mario7501 Рік тому +2

    I started playing with wgpu in rust recently. And there is so much boiler plate. After a few hours of working on that project copilot just started smashing out those texture descriptors, buffer descriptors and so on. It saves you a lot of time, but only on the stuff that's annoying about coding. If you are not exactly sure what you need, it most likely won't do a good job

  • @jordanlaprise4609
    @jordanlaprise4609 Рік тому +2

    One of the absolute best uses I've found for copilot, is writing tests, especially in rust where you write the tests in the same file so it can read the source material.

  • @Deemo_codes
    @Deemo_codes Рік тому +12

    I see these tools as being akin to a map vs a satnav.
    using a map builds a mental map in your head and you become less reliant on it as time goes on. This to me is like reading docs and learning the tools.
    A satnav just tells you where to go and unless you explicitly try to learn from it most of the information it gives you goes in one ear and out of the other.
    It does make me worry about programming literacy going forward and i agree with your assessment that it's probably not worth it for juniors, and even more experience devs should be careful

    • @ThePrimeagen
      @ThePrimeagen  Рік тому +4

      yes, i have to chase many bugs due to it

    • @pkop4
      @pkop4 Рік тому

      Yes this is a potential problem as even if the tool produced 100% accurate code and logic, it would result over time in you not having much understanding of what your code is doing whereas when you write it yourself you have a more clear picture in your head about what it is doing.

  • @Hippo0o
    @Hippo0o Рік тому

    what was very important for me was implementing a logic to only get the first line of copilots suggestion

  • @khanhcaoquoc4283
    @khanhcaoquoc4283 Рік тому

    I really like how you let CoPilot complete your subscribtion suggestion, that just feels so natural 😂

  • @davidt01
    @davidt01 Рік тому

    I mainly use it to do all the tedious stuff like autocompleting several nested brackets or parenthesese and generating boilerplate. It's really good at picking up patterns which comes in handy many times.

  • @jsonisbored
    @jsonisbored Рік тому +1

    This is exactly how I felt when I used the free beta. My experience has just been a hobby for over 7 years. (I should really get a job lol)

  • @PeterDrinnan
    @PeterDrinnan Рік тому

    Same experience. For autocomplete, boilerpate type stuff it is good, but for logic it usually gets it wrong if beyond something simple. It definitely helps but I l am not worried about anyone losing a job anytime soon.

  • @drawmaster77
    @drawmaster77 Рік тому

    It helped me improve my c++, particularly dealing with stl

  • @timwhite1783
    @timwhite1783 Рік тому +8

    I feel like I'd rather just write my own code than babysit a junior developer (which is kinda what this feels like to me). I think the tech will get better and it will eventually reach a point where you basically have to use it. But for now I'd rather not.

  • @thomassynths
    @thomassynths Рік тому

    Agreed. Copilot is awesome at doing boilerplate. It's also pretty good at doing CLI parsers given help outputs. (In Haskell at least.)

  • @ybabts
    @ybabts Рік тому

    I just tried copilot today writing a varint encoder/decoder in Typescript. I agree with your assessment, and I would also like to add that its really good at writing JSDocs if you ever make something public facing in Javascript.

  • @ejh237
    @ejh237 Рік тому

    I am 1 day into having CoPilot in my JetBrains IDEs... and it is, for sure more than a snippet generator. I have so much to learn, but giving it project context has it returning code that looks like I wrote it, albeit sometimes/often quite wrong. I felt I was missing a place to prompt... but, I guess doing what I was doing yesterday, by deleting the wrong parts and letting it continue to suggest may be the way. Day 2 now, I guess I have a side pane with other "guesses".. I'll see how that works. Thanks for the hints on how to get it to do the right thing...

  • @dragon_pi
    @dragon_pi Рік тому +2

    Having to re-read generated code, understand it and verify that it didn't introduce subtle bugs that you would never have done because you know how the codeworks contextually has to take at least the same amount of time that it would writing your own code. Additionally the chances are higher that you then still know what you wrote two weeks ago!

    • @nickmoore5105
      @nickmoore5105 Рік тому

      True, although sometimes copilot's code is truly brilliant in a much more concise or expressive way than mine. Other times, not so much. It's like pair programming with a brilliant but drunk colleague. I've actually learned quite a bit from it.

    • @dragon_pi
      @dragon_pi Рік тому

      @@nickmoore5105 brilliant but drunk seems awesome/hj... but I think its more like "didnt understand zhe topic but learned the textbook off by heart"

  • @KiLVaiDeN
    @KiLVaiDeN Рік тому

    The more you know about what you are doing and what you want, the best the collaboration with such auto-completion AI tools.
    I think it's just the beginning though, and soon enough we will see much better code generation and UIs to use them more efficiently.

  • @languagelearningexperience6814

    Thanks! This is actually how I feel about all AI. Thanks for taking one for the team for 6 months. lol

  • @patrickkhwela8824
    @patrickkhwela8824 Рік тому

    I've never used co-pilot but it looks quite handy. Nice video and explanation!

  • @angelenriquechavezponce1629

    1:14 the "Jesus take the wheel" was spot on 😂😂😂😂

  • @dealloc
    @dealloc Рік тому +1

    CoPilot should have a partial application feature where it understands what you want to keep and then get rid of the unneeded code, making sure that things are still valid syntax (e.g. don't delete end braces).

    • @hannessteffenhagen61
      @hannessteffenhagen61 Рік тому

      Copilot has no understanding of code. It‘s just text completion, like ChatGPT (it uses the same underlying technology).

    • @dealloc
      @dealloc Рік тому

      @@hannessteffenhagen61 Both models are based on GPT, but CoPilots model has also been trained on source code from GitHub (and likely other sources) so it has a bias towards code. CoPilot also uses additional prompts internally to get more code-oriented results.
      They have a CoPilot Experimental plugin with additional features, such as refactoring tools and explanations from code. It's not unfeasible that they'd be able to construct the prompts to produce this kind of behaviour.

  • @thekwoka4707
    @thekwoka4707 Рік тому +1

    On your second point, I find that my copilot only RARELY recommends more than to the end of the current line. Which I do like, since often times the rest of the line is very obvious. If I want more lines, it will recommend a next line after I go to it, and so on. I use it like an actually smart auto-complete. Like context aware fill or something.

  • @latergator915
    @latergator915 Рік тому +2

    Spiritual movage is all we can really ask from the robots.

  • @manuelornato3722
    @manuelornato3722 Рік тому

    Had approximately the same experience after 24h of using it but was thinking I was using it wrong. Thanks for your video. A good boilerplate assistant but not sure it's worth the price.

  • @edyzakaria9522
    @edyzakaria9522 Рік тому

    thanks for your sharing experience. i test not copilot, but chatgpt, to create unit test. it was 1:10+... 1 time ask gpt for the function, 10 times more asking for unit test of that function due to runtime error.

  • @minerj101
    @minerj101 Рік тому +3

    Converting data structures across languages seems to be my favorite part. At the moment I am using Copiolet to convert many json schemas over to rust types. All I have to do is paste the json schema at the top of the file. Once I do that it just fills in all of the comments and data structures, after a bit of prodding at times it gets it done. I have found this the biggest time save to be honest.
    It's not perfect at this, but most of the time it can do the simple repetitive work of copying over tidbits of information. I still have to have the schema open on the side due to simple mistakes / changes in implementation. Overall, after using it since its release I am pleased at the speed up in development times.
    - Note on json schema conversion
    Yes, I am aware typify exists, but it isn't perfect, and I have run into many issues using it. I did file some issues on the repo so the maintainer is aware. Along with the code generated being a bit of a mess to read.

    • @MA-ck4wu
      @MA-ck4wu Рік тому

      you have run*, not ran (when ''run'' is combined with ''have'' in the past tense--->>> I have run). Just a tip.

    • @minerj101
      @minerj101 Рік тому

      @@MA-ck4wu right...

  • @toadlguy
    @toadlguy Рік тому

    This is a pretty important video. I hope more people see it.

  • @spencjon4822
    @spencjon4822 Рік тому

    It'll be interesting just how much better it copilot-x is with the GPT-4 model and added features. I've gotten AMAZING use out of having it write scripts for me that deal with APIs I'm unfamiliar with/other things like that.
    Finding all the little things add up and take FOREVER where as validation of endpoints used in a script is much faster.
    As well, having it write tests/boilerplate for code is sublime.

  • @Trans_Canada_Highway
    @Trans_Canada_Highway Рік тому

    It works really well when it has context of your well maintained, large repository. Otherwise it is boilerplate filler or a way compare how others would write the same thing.

  • @alexandrustefanmiron7723
    @alexandrustefanmiron7723 Рік тому

    O.M.G. I got it. It's like driving. You can either do it or just foff. It's much more work to fix and find bugs in someone's/ something's code that just write it from the start. I can write boiler plate code much faster than checking that the code written doesn't miss behave.

  • @Zenpi-me
    @Zenpi-me Рік тому

    1 / 0 is Infinity in JS :)
    Great Video Doc!

  • @vectoralphaSec
    @vectoralphaSec Рік тому +2

    However good it is now it will only get better and better as time goes by.

  • @vdmoKstati
    @vdmoKstati Рік тому

    after 6 months, you've delivered .. you the best ..thank you ;)

  • @xxbomelxx874
    @xxbomelxx874 Рік тому

    Thank you for the video, I had the same issue with copilot and dumped it. I maybe give it another shot!

  • @tinymints3134
    @tinymints3134 Рік тому

    Also, for quick and dirty stuff it's great because I just want something to work once, it doesn't have to work everytime necessarily.

  • @sowjanyapeddireddy898
    @sowjanyapeddireddy898 Рік тому

    Thank you for sharing your experiences.

  • @farrela.846
    @farrela.846 Рік тому

    "everyone's favorite number which is Not a Number"
    You're goddamn right prime

  • @robertjonczy
    @robertjonczy Рік тому

    Hey man. Love your content! Good job. Also wanna ask what headset do you use?

  • @chrboesch
    @chrboesch Рік тому

    Thanks for the overview, really helpful! 👍