Meta-Llama-3.1-8B-Instruct-GGUF [Q8_0]

Reply to topic
DL-List and Torrent activity
Size:  8 GB   |    Registered:  2 months 13 days   |    Downloaded:  88 times
Seeders:  1  [  0 KB/s  ]  
 
Author Message

NotFirst ®

Registered: 3 months 23 days

Posts: 16

Post 23-Jul-2024 19:26 | #1 · Author

[Code]

Llama 3.1 8B Instruct released today by Meta.
GGUF by https://huggingface.co/MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF
Model Information
The Meta Llama 3.1 collection of multilingual large language models (LLMs) is a collection of pretrained and instruction tuned generative models in 8B, 70B and 405B sizes (text in/text out). The Llama 3.1 instruction tuned text only models (8B, 70B, 405B) are optimized for multilingual dialogue use cases and outperform many of the available open source and closed chat models on common industry benchmarks.
Model developer: Meta
Model Architecture: Llama 3.1 is an auto-regressive language model that uses an optimized transformer architecture. The tuned versions use supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF) to align with human preferences for helpfulness and safety.
Supported languages: English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai.
Llama 3.1 family of models. Token counts refer to pretraining data only. All model versions use Grouped-Query Attention (GQA) for improved inference scalability.
Model Release Date: July 23, 2024.
Model card: https://huggingface.co/meta-llama/Meta-Llama-3.1-8B-Instruct
Meta-Llama-3.1-8B-Instruct-GGUF [Q8_0] [aitracker.art-85].torrent  
Torrent: Registered [ 2024-07-23 19:26 ]

info_hash v2: AF5775CC1E73336FCE4328EE7834EF4DE7DA78DB0E5ADBCA36E1E5CC2EF72128

Download .torrent

Download

255 KB

Status: * not checked
Downloaded: 88 times
Size: 7.95 GB
Meta-Llama-3.1-8B-Instruct-GGUF.Q8_0
[Profile] [PM]

NotFirst ®

Registered: 3 months 23 days

Posts: 16

Post 23-Jul-2024 19:28 | #2 · Author (after 1 minute)

New & noteworthy: 128K context, function calling. I haven't tried those on the quantized version yet.
[Profile] [PM]
Display posts:    
Reply to topic
Move to top

Current time is: 06-Oct 05:30

All times are UTC + 1



You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
You cannot attach files in this forum
You can download files in this forum

Cover our bill…

Donate at ko-fi.com

Or use crypto:

We accept BTC, XMR, LTC, BCH & DOGE