LLMs eat entry-level SWEs

Поділитися
Вставка
  • Опубліковано 25 жов 2024

КОМЕНТАРІ • 11

  • @PawelBojkowski
    @PawelBojkowski 7 місяців тому +2

    Agree 100%! + You should make more of this kind of content.

  • @isithasubasinghe4498
    @isithasubasinghe4498 7 місяців тому +3

    LLMs won't beat humans in areas where logic is used.
    I am a researcher and write new code that LLMs haven't been trained on as a result, I tried using LLM and they were useless.
    Try and ask an LLM to prove a simpler addition function in C.
    When I used to work as an entry level software eng, I still had the ability to reason about logic.This ability alone will always beat LLMs, unless
    LLMs become able to reason about logic somehow.

    • @VivekHaldar
      @VivekHaldar  7 місяців тому +1

      I agree that in truly new domains and with new algorithms LLMs might not be very effective. But I'm talking about the day-to-day vast majority of enterprise/consumer software development where you have a DB/RPC/FE stack.
      Reasoning had been a weak point but is getting much better.

  • @gilinachum
    @gilinachum 7 місяців тому

    You can also fine tune on the codebase so a huge context window isn't a must. Despite being very easy to use compared to fine tuning.

    • @VivekHaldar
      @VivekHaldar  7 місяців тому

      Maybe not fine-tuning, but yes, RAG will still be important even with large windows.

  • @rexbenedict6062
    @rexbenedict6062 7 місяців тому

    So nobody should take cs anymore?

    • @VivekHaldar
      @VivekHaldar  7 місяців тому

      That's not what I'm implying at all. The way CS/programming is taught will change (see some prev videos on the channel), and emphasis on various topics will change.

  • @-BarathKumarS
    @-BarathKumarS 7 місяців тому +1

    I bet you wouldn’t say stuff like this when you would be graduating right now with a bachelors

    • @VivekHaldar
      @VivekHaldar  7 місяців тому +2

      I say stuff like this so that those who are graduating right now are well-prepared for this new world.

    • @kunalverma8536
      @kunalverma8536 7 місяців тому

      ​@@VivekHaldarweb d is almost over, what are other fields available unaffected by this??

    • @-BarathKumarS
      @-BarathKumarS 7 місяців тому

      @@VivekHaldar What do you mean by well-prepared? how would anyone even prepare for this,if we reach AGI in the next 2 years then even prinicpal engineers are all out of work.