notux:8x7b-v1-q5_K

notux:8x7b-v1-q5_K_S

152.2K Downloads Updated 2 years ago

A top-performing mixture of experts model, fine-tuned with high-quality data.

8x7b

ollama run notux:8x7b-v1-q5_K_S

curl http://localhost:11434/api/chat \
  -d '{
    "model": "notux:8x7b-v1-q5_K_S",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='notux:8x7b-v1-q5_K_S',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'notux:8x7b-v1-q5_K_S',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Details

Updated 2 years ago

2 years ago

acae292badb5 · 32GB ·

model

archllama

parameters46.7B

quantizationQ5_K_S

32GB

template

[INST] {{ .System }} {{ .Prompt }} [/INST]

43B

license

MIT License Copyright (c) [year] [fullname] Permission is hereby granted, free of charge, to any per

1.1kB

params

{ "stop": [ "[INST]", "[/INST]" ] }

30B

Readme

This model is a fine-tuned version of Mixtral using a high-quality, curated dataset. As of Dec 26th 2023, this model is the top ranked MoE (Mixture of Experts) model on the Hugging Face Open LLM Leaderboard.

References

HuggingFace

Argilla