Testing Claude 3.5 Sonnet | reasoning, complex image chart, building a tower defense game

Поділитися
Вставка
  • Опубліковано 5 вер 2024

КОМЕНТАРІ • 17

  • @echohive
    @echohive  2 місяці тому

    Download ALL files for this project at my patreon: www.patreon.com/posts/all-files-for-3-106578697
    Download reasoning test for this project at my patreon: www.patreon.com/posts/reasoning-test-3-106578690
    Learn to code fast with my 1000x MasterClass:
    www.patreon.com/posts/1000x-dev-103326330
    Search 200+ echohive videos and code download links:www.echohive.live/
    Auto Streamer: www.autostreamer.live/
    Fastapi course: www.patreon.com/posts/learn-fastapi-26-95041684
    Chat with us on Discord: discord.gg/PPxTP3Cs3G
    Follow on twitter(X) : twitter.com/hive_echo

  • @gui-zx3di
    @gui-zx3di 2 місяці тому +5

    Your tests are incredible

    • @echohive
      @echohive  2 місяці тому +1

      Thank you! 🙏

    • @xspydazx
      @xspydazx 13 днів тому

      falsified results my friend !

  • @andydataguy
    @andydataguy 2 місяці тому +2

    Am traveling and was so happy to see this new release!! The timing couldn't have been more perfect 🤗🔥🚀

    • @echohive
      @echohive  2 місяці тому +1

      Happy and safe travels to you! It really is a very good model. I am sure you will love it once you try it!

  • @micbab-vg2mu
    @micbab-vg2mu 2 місяці тому +2

    nice model:)

    • @echohive
      @echohive  2 місяці тому +1

      Yeah it does pretty well

  • @samvirtuel7583
    @samvirtuel7583 2 місяці тому

    the Alice problem is very interesting, there is the Eurekas effect, a form of awareness to realize that Alice is also a sister to her brother, it is this type of reasoning/awareness which allows us to carry out a task to completion without making any gross errors.
    This is an excellent test for LLMs

    • @echohive
      @echohive  2 місяці тому

      Thank you 🙏 I saw this test on one of the LlM papers. What is funny is that sometimes it will mention m + 1 because it says need to count Alice but then still answers as M in the end :)

    • @M.M.K1
      @M.M.K1 2 місяці тому

      @@echohive as a interesting in turkish language "Amy'nin N erkek kardeşi var ve ayrıca M kız kardeşi var. annesi 44 yaşında ve 3 kız kardeşi var. babası 47 yaşında ve 5 kardeşi var. Amy'nin erkek kardeşinin kaç kız kardeşi var?" answers correct M+1.

  • @MGeeify
    @MGeeify 2 місяці тому +1

    You deserve way more subscribers for sure!

    • @echohive
      @echohive  2 місяці тому

      Thank you very much for your kind words 🙏

    • @xspydazx
      @xspydazx 13 днів тому

      i dont think so !

  • @drlordbasil
    @drlordbasil 2 місяці тому

    I saw the release and havent slept since xD

    • @echohive
      @echohive  2 місяці тому

      Very exciting indeed 🚀

  • @damujen
    @damujen 2 місяці тому

    🎯 Key points for quick navigation:
    00:00 *🚀 Claude 3.5 Sonnet surpasses previous models like Claude 3 Opus and even GPT-4 in speed and accuracy, especially excelling in coding tasks.*
    00:54 *🎮 Testing includes building an 8-bit tower defense game and solving challenging logic problems to evaluate reasoning capabilities.*
    03:40 *📊 Analysis shows improvements in image understanding, with Claude 3.5 Sonnet accurately interpreting complex charts based on different metrics.*
    06:25 *🔍 Performance on reasoning tests highlights strengths and weaknesses, with notable successes in complex logic problems.*
    11:21 *💡 Auto coder demonstration showcases Claude 3.5 Sonnet's ability to generate and review complex code, including creating interactive HTML canvas animations and tower defense games.*
    20:49 *🎮 Claude 3.5 Sonnet offers diverse options for experimentation and development, including cloud and unified class features.*
    21:00 *📈 Patreon tiers offer personalized coding project assistance, with options ranging from one-hour to three-hour monthly sessions.*
    21:15 *🛠️ Benefits of becoming a patron include access to code files, courses, and exclusive master classes on efficient coding techniques.*
    Made with HARPA AI