Taking Function Calling to the NEXT Level with Groq API 🚀 🚀 🚀

Поділитися
Вставка
  • Опубліковано 31 тра 2024
  • Groq just added support for Function Calling to the Groq API. This is the fastest API with function calling ability.
    🦾 Discord: / discord
    ☕ Buy me a Coffee: ko-fi.com/promptengineering
    |🔴 Patreon: / promptengineering
    💼Consulting: calendly.com/engineerprompt/c...
    📧 Business Contact: engineerprompt@gmail.com
    Become Member: tinyurl.com/y5h28s6h
    💻 Pre-configured localGPT VM: bit.ly/localGPT (use Code: PromptEngineering for 50% off).
    Signup for Advanced RAG:
    tally.so/r/3y9bb0
    LINKS:
    Notebook Repo: github.com/PromtEngineer/Yout...
    TIMESTAMPS:
    [00:00] Groq Adds function calling [Tool Usage]
    [01:56] How does it work
    [02:33] Code Example
    All Interesting Videos:
    Everything LangChain: • LangChain
    Everything LLM: • Large Language Models
    Everything Midjourney: • MidJourney Tutorials
    AI Image Generation: • AI Image Generation Tu...
  • Наука та технологія

КОМЕНТАРІ • 25

  • @54peace
    @54peace Місяць тому +9

    Groq rapidly becoming popular I'm worried that they'd remove the free plan. 😢

    • @natureiscrazy
      @natureiscrazy Місяць тому

      They won't cause they training off your data

    • @engineerprompt
      @engineerprompt  Місяць тому +1

      hopefully they will keep a free plan!

    • @SamuelJunghenn
      @SamuelJunghenn Місяць тому

      Do they even have a paid plan yet?

    • @SamuelJunghenn
      @SamuelJunghenn Місяць тому

      The rate limits are so low

    • @natureiscrazy
      @natureiscrazy Місяць тому

      @@SamuelJunghenn meaning? You can use it only so many times? I think mistral is best sofar?

  • @3choff
    @3choff Місяць тому

    Great video! Your way of explaining function calling is very clear and straight to the point. It would be interesting to combine Claude and Mixtral to create complex tool-use architectures, such as giving Claude Opus tools to call upon smaller model subagents, such as Mixtral or Gemma, to carry out tasks on its behalf and take advantage of the high inference speed of Groq. This idea is taken from the tool use documentation of Claude, where they suggest using Haiku as a subagent.

    • @engineerprompt
      @engineerprompt  Місяць тому +1

      Thanks, its a great idea. I have been working on sub-agents (both Claude) but your idea is worth exploring. Will be interesting to see what type of results one can get by mixing them up.

  • @ChristopherAaronNewton
    @ChristopherAaronNewton Місяць тому

    ❤ that was very helpful.

  • @wasteid1279
    @wasteid1279 Місяць тому +1

    Hey dude.. just wanted to ask how you do that mouse animtation (little elabortive if you can).
    Btw great tutorial ❤

  • @YattishRamhorry
    @YattishRamhorry Місяць тому

    Can function calling be implemented in Javascript as well?

  • @GetzAI
    @GetzAI Місяць тому

    Thanks PE!

  • @fckyougooglification
    @fckyougooglification Місяць тому

    Great video, thanks

  • @giuseppezani9049
    @giuseppezani9049 Місяць тому

    you have taken the tool example with just one function. What if i've to use more than one functions? For example:# Function hard coded to return the current system date
    def get_current_date():
    """Get the current system date"""
    current_date = date.today()
    return json.dumps({"current_date":current_date})
    # Function hard coded to return files contained in user given path
    def get_files(user_input_path):
    """Get the current files in a user specified directory"""
    files_list = os.listdir(user_input_path)
    return json.dumps({"files_list": files_list})
    ## inside the tool _calls
    available_functions = {
    "get_files": get_files,
    "get_current_date": get_current_date,
    } # only one function in this example, but you can have multiple
    Which is the correct way of assigning the function_response when you have multiple function with different parameters / no parameters each?

  • @Priming-AI
    @Priming-AI Місяць тому

    source code ? github ?

  • @temperad0
    @temperad0 29 днів тому

    bruh, this everyone could know by reading the docs, why don't you show how to change this for loop so we can do that with multiple functions ....