Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

8-bit precision

text-embeddings-inference

Misc with no match

4-bit precision

Models

5,824

Full-text search

Active filters: llama-cpp

Trappu/Magnum-Picaro-0.7-v2-12b-GGUF

Updated 2 days ago • 45 • 4

byroneverson/glm-4-9b-chat-abliterated-gguf

Text Generation • Updated 16 days ago • 116 • 4

Flamesline/gpt5o-reflexion-q-agi-llama-3.1-8b-Q6_K-GGUF

Updated 7 days ago • 311 • 3

bunnycore/dolphin-2.9.4-gemma2-2b-Q4_K_M-GGUF

Updated 24 days ago • 78 • 2

byroneverson/gemma-2-27b-it-abliterated-gguf

Text Generation • Updated 8 days ago • 2.44k • 9

darkc0de/Xortron7MethedUp-SLERP-8B-Q5_K_M-GGUF

Updated 9 days ago • 5 • 2

NikolayKozloff/NightyGurps-12b-v1-experimental-Q8_0-GGUF

Updated 8 days ago • 17 • 2

NikolayKozloff/OmniLing-V1-12b-experimental-Q6_K-GGUF

Text Generation • Updated 5 days ago • 5 • 2

NikolayKozloff/OmniLing-V1-12b-experimental-Q5_K_M-GGUF

Text Generation • Updated 5 days ago • 17 • 2

v000000/L3.1-Storniitova-8B-Q8_0-GGUF

Updated 5 days ago • 23 • 2

Nohobby/ThisWontWork3-Q8_0-GGUF

Updated 4 days ago • 28 • 2

Nohobby/ThisWontWork4-Q8_0-GGUF

Updated 4 days ago • 33 • 2

Nohobby/ThisWontWork3-Q6_K-GGUF

Updated 4 days ago • 14 • 2

Nohobby/ThisWontWork3-Q5_K_M-GGUF

Updated 4 days ago • 40 • 2

aashish1904/Chronos-Divergence-33B-Q8_0-GGUF

Updated 4 days ago • 13 • 2

darkc0de/BuddyGlassNeverSleeps-Q8_0-GGUF

Updated 1 day ago • 4 • 2

NikolayKozloff/Llama-3.1-8B-Instruct-Reasoner-1o1_v0.3-Q8_0-GGUF

Text Generation • Updated about 8 hours ago • 2

hrus/Mistral-Small-Instruct-2409-Q8_0-GGUF

Updated about 2 hours ago • 2

DavidAU/MPT-7b-WizardLM_Uncensored-Storywriter-Merge-Q6_K-GGUF

Updated Aug 9 • 361 • 6

boxomcfoxo/YiffyEstopianMaid-13B-GGUF

Updated Apr 19 • 131 • 3

nullt3r/llava-llama-3-8b-v1_1-Q8_0-GGUF

Image-Text-to-Text • Updated Apr 27 • 15 • 1

Vikhrmodels/Vikhr-7B-instruct_0.4-GGUF

Updated May 5 • 400 • 9

JoyboyBrian/gemma-2b-Q4_0-GGUF

Updated May 4 • 35 • 1

noxinc/Mistral-portuguese-luana-7b-Mathematics-Q5_K_M-GGUF-PTBR

Text Generation • Updated May 7 • 15 • 1

Bllossom/llama-3-Korean-Bllossom-70B-gguf-Q4_K_M

Updated May 14 • 454 • 48

MLP-KTLim/llama-3-Korean-Bllossom-8B-gguf-Q4_K_M

Updated Jul 3 • 2.19k • 45

ssmits/Falcon2-5.5B-Portuguese-GGUF

Updated May 20 • 11 • 1

NikolayKozloff/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jun 6 • 25 • 5

NikolayKozloff/Qwen2-7B-Q5_K_M-GGUF

Text Generation • Updated Jun 6 • 12 • 2

kowlick/Qwen2-72B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jun 7 • 43 • 1