New section to dump the quants

Reply to topic
 
Author Message

leaf ®

Registered: 4 months

Posts: 35

Location: Earth

Post 13-Jun-2024 05:00 | #1 · Author

[Code]

Currently all the torrents are kinda just all over the place, which could be a problem if more models are added. I think a separate Quantization section should be added, to dump all the gguf/awq/gptq/exl2 quants and those can be linked to from a single post, one for each model. This way they can be searched but also don't take up space on the model sections.
[Profile] [PM]

Dreamertist

Registered: 4 months 4 days

Posts: 13

Post 13-Jun-2024 05:51 | #2 (after 51 minute)

I don't really want to add too many categories. Most are downloading a quant of some sort and you can use the search to do something like searching "q4*" in LLaMA 3 8B to find all 4bit quants of models based on L3 8B
[Profile] [PM]
Display posts:    
Reply to topic
Move to top

Current time is: 11-Oct 00:34

All times are UTC + 1



You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
You cannot attach files in this forum
You cannot download files in this forum

Cover our bill…

Donate at ko-fi.com

Or use crypto:

We accept BTC, XMR, LTC, BCH & DOGE