llama3-chatqa:70b-v1.5-q6

llama3-chatqa:70b-v1.5-q6_K

313.2K Downloads Updated 1 year ago

A model from NVIDIA based on Llama 3 that excels at conversational question answering (QA) and retrieval-augmented generation (RAG).

8b 70b

ollama run llama3-chatqa:70b-v1.5-q6_K

curl http://localhost:11434/api/chat \
  -d '{
    "model": "llama3-chatqa:70b-v1.5-q6_K",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='llama3-chatqa:70b-v1.5-q6_K',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'llama3-chatqa:70b-v1.5-q6_K',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Details

Updated 1 year ago

1 year ago

8cc009d2a270 · 58GB ·

model

archllama

parameters70.6B

quantizationQ6_K

58GB

license

META LLAMA 3 COMMUNITY LICENSE AGREEMENT Meta Llama 3 Version Release Date: April 18, 2024 “Agreem

12kB

template

{{ if .System }}System: {{ .System }} {{ end }}{{ if .Prompt }}User: {{ .Prompt }} {{ end }}Assistan

139B

system

This is a chat between a user and an artificial intelligence assistant. The assistant gives helpful,

260B

Readme

ChatQA-1.5 is built on top of the Llama-3 base model, and incorporates conversational QA data to enhance its tabular and arithmetic calculation capability.

ChatQA-1.5 has two variants:

Llama3-ChatQA-1.5-8B llama3-chatqa:8b
Llama3-ChatQA-1.5-70B llama3-chatqa:70b

References

Website

Hugging Face