llama3-groq-tool-use:8b-q3_K

llama3-groq-tool-use:8b-q3_K_S

285.2K Downloads Updated 1 year ago

A series of models from Groq that represent a significant advancement in open-source AI capabilities for tool use/function calling.

tools 8b 70b

ollama run llama3-groq-tool-use:8b-q3_K_S

curl http://localhost:11434/api/chat \
  -d '{
    "model": "llama3-groq-tool-use:8b-q3_K_S",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='llama3-groq-tool-use:8b-q3_K_S',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'llama3-groq-tool-use:8b-q3_K_S',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Details

Updated 1 year ago

1 year ago

3f7165ed6ac3 · 3.7GB ·

model

archllama

parameters8.03B

quantizationQ3_K_S

3.7GB

license

META LLAMA 3 COMMUNITY LICENSE AGREEMENT – Adapted For Groq 8B/70B Tool Use Meta Llama 3 Version R

9.8kB

template

{{- if .Messages }} {{- if or .System .Tools }}<|start_header_id|>system<|end_header_id|> {{ .System

1.7kB

params

{ "stop": [ "<|start_header_id|>", "<|end_header_id|>", "<|eot_id|>"

96B

Readme

These models, developed in collaboration with Glaive, represent a significant advancement in open-source AI capabilities for tool use/function calling.

Benchmark Results

These models have achieved remarkable results, setting new benchmarks for Large Language Models with tool use capabilities:

Llama-3-Groq-70B-Tool-Use: 90.76% overall accuracy (#1 on BFCL at the time of publishing - July 2024)
Llama-3-Groq-8B-Tool-Use: 89.06% overall accuracy (#3 on BFCL at the time of publishing - July 2024)

References

Hugging Face

Blog