Claude-3.5 Sonnet + Qwen2 + ContinueDev : This AMAZING Coding Copilot BEATS Github Copilot & Others!
Вставка
- Опубліковано 2 лип 2024
- In this video, I'll be telling you that how you can create a new coding copilot / assistant with ContinueDev, ShellGPT & the New Anthropic Claude-3.5 Sonnet Model. This new Anthropic Claude-3.5 Sonnet model based copilot is cheaper and better than Github's Copilot & every other local, opensource copilot I have ever seen. This Github Copilot alternative can work even without the need of GPUs which is really amazing.
This alternative can also be used with any opensource LLM, OpenAI models or the other Claude models such as GPT-4O, Claude-3, CodeQwen, Mixtral 8x22b, Mixtral 8x7b, GPT-4, Grok-1.5 & Gemini Code Assist.
------
Key Takeaways:
🚀 Unleash the Power of Claude 3.5 Sonnet: Claude 3.5 Sonnet outperforms GPT-4O, Gemini, and Llama 3, making it the ultimate copilot for coding and more.
💡 Integrate with VSCode Easily: Using the ContinueDev VSCode extension, you can effortlessly integrate the Claude API for enhanced coding productivity.
🔧 Save on Costs with API Efficiency: Claude's API charges are based on usage, making it a cost-effective alternative to GitHub Copilot's $10 subscription fee.
🌟 Dual Setup for Optimal Performance: Combine Claude 3.5 Sonnet with a local model like Qwen2 1.5b for chat and autocompletion, optimizing speed and reducing expenses.
🛠️ Set Up ShellGPT for Shell Commands: ShellGPT provides a seamless interface similar to GitHub Copilot's Shell suggestion tool, enhancing your workflow.
💬 Enhanced Coding Experience: The Claude model can generate code, insert it directly into your files, and even offer context-aware suggestions, boosting your coding efficiency.
🎉 Community-Driven Development: Join a community of developers switching to Claude, leveraging its superior capabilities and cost-effectiveness.
-----
Timestamps:
00:00 - Introduction
00:11 - About Claude-3.5 Sonnet
01:00 - Why Github Copilot is not worth it
01:18 - Making a Custom Copilot with the Claude-3.5 Sonnet Model
01:57 - Using Local Model for Autocompletion
02:18 - ShellGPT
02:35 - Installation (Starting)
02:54 - Installation (ShellGPT)
04:02 - Installation (ContinueDev + Claude-3.5 Sonnet)
06:17 - Installation (ContinueDev + Claude-3.5 Sonnet + Qwen2)
07:33 - Conclusion - Наука та технологія
Thanks for making these videos.
Thank you for this video, much appreciated
Great video. Would be awesome to see more like this and other models used if possible
Excellent walkthrough of how to set this up 🙌
love this! thanks for sharing!
Excellent: 10/10
this was the most easy and hands on explanation.
Pretty cool
That's an amazing content! Which LLM do you consider to be the best for local use in the ContinueDev chat? Do you have a video on this? Thanks :)
How about using Claude 3.5 sonnet with gpt pilot Pythagora?
cool, what OS are you running?
You have very nice voice
Interesting, but why go through all of these steps instead of using something like double bot, which just works out of the box and has all of the right models?
Groq API + Continue ❤
So cool if I knew how to code :) is there any setup for Notion?
Will try to cover something like in upcoming videos.
With Claude 3.5 as the Copilot, can it see your entire codebase?
If it can, compare it to just embedding your codebase.
The other day I sent my codebase to Claude 3 Opus and worked through some issues I was having.
The API costs were $64.
I'm wondering if the codebase got embedded into the prompt and was sent back and forth with each query.
How else would it use up so many tokens?
There's option to add your entire codebase as context in ContinueDev. But, I wouldn't recommend that due to the huge API costs that might come. Instead, you can just add the context you need to work on. Also, The new Claude 3.5 Sonnet is much cheaper than the previous opus model (Previous one was like $15/m token while this is just $3/m token)
@@AICodeKing btw github copilot uses GPT-4 or so they say. Sonnet-3.5 is really good but is it going to be worth it using like that (as in pay as you go model)? Also, github copliot is privacy oriented and secure (or so they say) compared to Sonnet-3.5 which is not private (they will work on the data you provide afaik).
@@SahilP2648 They use GPT-4 for chat, but GPT-3.5 for everything else.
@@AICodeKing could I add files and knowledbase (entire codebase and related similar projects) to an assistant in OpenAi playground and then use that particular assistant. Would that bring down costs since does not need to send codebase back and forth?
why i always got missing config key for openai?
Is possible to handle questions to the web interface from vsc? instead of api i think the $20 plan would be cheaper for our use in much scenarios
What do you mean? Using the extension if you just use the pay as you go model, then yes, it's not for code only.
Hi, how much are you going to spend like that per month? Less than $10?
It costs about $3 for a million tokens. So, You could get it below that amount if you don't use it for autocompletion.
@@AICodeKing the problem is that I don't know how many tokens day to day coding will use. Maybe more, maybe less. Maybe even using it for autocomplete works out cheaper, or not much more expensive. Please make a video in a while to let us know what the costs turn out to be.
Surely less than $10. I've do the comparison last month with Chat gpt
@@d.d.z. lets hope. I would love to just use sonnet 3.5 for aurocomplete as well. Almost never use the chat and other functionality.
@@apester2 try it and come back to talk about
any reason why sgpt doesnt seem to work as a command for me
Check If pip package path is in your Terminal environment.
Im not able to find the shell_gpt file you showed can you tell the location. Im using anaconda
It should be at ~/.config/shell_gpt/.sgptrc
It looks like OpenAI has changed the code, I am getting the "BadRequestError: 400 Bad Request" when I try to put in the API Key,
Yeah I found it won't allow me to paste the API key in this way. Find the .sgptrc file in your C: drive.
Navigate to C: > Users > "Whatever your username is" > .config > shell-gpt > .sgptrc
Then edit as per his tutorial. Hope this helps!
It was working great for me but now after a few hours Im getting a HTTP 429 too many requests error
i had the same issue
Claude in programming is waaay much better than ChatGPT
installing a python library globally sounds very windows-y. I know you can do it in *nix. I do it sometimes. Still feels dirty tbh 😅
For real? GitHub Copilot still use GPT-3?
Yes, it does.
Chat says it uses gpt4 turbo?
really you are jumping from A to B...