llama3-groq-tool-use:70b-q2

llama3-groq-tool-use:70b-q2_K

967.6K Downloads Updated 2 years ago

A series of models from Groq that represent a significant advancement in open-source AI capabilities for tool use/function calling.

tools 8b 70b

ollama run llama3-groq-tool-use:70b-q2_K

curl http://localhost:11434/api/chat \
  -d '{
    "model": "llama3-groq-tool-use:70b-q2_K",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='llama3-groq-tool-use:70b-q2_K',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'llama3-groq-tool-use:70b-q2_K',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Details

Updated 2 years ago

2 years ago

dab8a158f092 · 26GB ·

model

archllama

parameters70.6B

quantizationQ2_K

26GB

license

META LLAMA 3 COMMUNITY LICENSE AGREEMENT – Adapted For Groq 8B/70B Tool Use Meta Llama 3 Version R

9.8kB

params

{ "stop": [ "<|start_header_id|>", "<|end_header_id|>", "<|eot_id|>"

96B

template

{{- if .Messages }} {{- if or .System .Tools }}<|start_header_id|>system<|end_header_id|> {{ .System

1.7kB

Readme

These models, developed in collaboration with Glaive, represent a significant advancement in open-source AI capabilities for tool use/function calling.

Benchmark Results

These models have achieved remarkable results, setting new benchmarks for Large Language Models with tool use capabilities:

Llama-3-Groq-70B-Tool-Use: 90.76% overall accuracy (#1 on BFCL at the time of publishing - July 2024)
Llama-3-Groq-8B-Tool-Use: 89.06% overall accuracy (#3 on BFCL at the time of publishing - July 2024)

References

Hugging Face

Blog