Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

25,626

Base only

Active filters: llama-cpp

fdtn-ai/Foundation-Sec-8B-Reasoning-Q4_K_M-GGUF

Text Generation • 8B • Updated Feb 18 • 8.01k • 9

lainlives/Qwen3-Coder-30B-A3B-Instruct_Pruned_REAP-15B-A3B-SafeTensors-Q8_0-GGUF

16B • Updated Jan 31 • 102 • 2

lainlives/Qwen3-Coder-30B-A3B-Instruct_Pruned_REAP-15B-A3B-SafeTensors-Q4_K_M-GGUF

16B • Updated Jan 31 • 201 • 4

jinaai/jina-embeddings-v5-text-small-classification

Text Classification • 0.6B • Updated Apr 15 • 3.96k • 7

rizkysulaeman/Gemma3N-4B-Conv-MM-Img-Audio-Text-Code-Reasoning-Q8_0-GGUF

Any-to-Any • 7B • Updated Feb 19 • 177 • 3

jinaai/jina-embeddings-v5-text-nano-retrieval-GGUF

Sentence Similarity • 0.2B • Updated Feb 27 • 6.66k • 5

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 117k • 791

modelfix/NVIDIA-Nemotron-3-Nano-30B-A3B-FP8-GGUF

Text Generation • 32B • Updated Mar 27 • 62 • 1

prism-ml/Bonsai-1.7B-gguf

Text Generation • 2B • Updated Apr 18 • 68.3k • 94

Ayodele01/gemma-4-E2B-Gemini-3.1-Pro-Reasoning-Distill-GGUF

Text Generation • 5B • Updated Apr 5 • 948 • 3

vividdream/Qwen-Open-Finance-R-8B-IQ4_NL-GGUF

Question Answering • 8B • Updated Apr 4 • 137 • 4

NidAll/supergemma4-e4b-abliterated-Q4_K_M-GGUF

Text Generation • 8B • Updated Apr 17 • 1.41k • 29

prism-ml/Ternary-Bonsai-1.7B-gguf

Text Generation • 2B • Updated Jun 10 • 9.33k • 47

prism-ml/Ternary-Bonsai-4B-gguf

Text Generation • 4B • Updated Jun 10 • 8.95k • 36

barozp/Qwen3.6-28B-REAP20-A3B-GGUF

Text Generation • 28B • Updated Apr 19 • 5.7k • 83

dulshanbandara/qwen2vl-2b-photography-critique-GGUF

Image-Text-to-Text • 2B • Updated Apr 22 • 220 • 2

Krasnopjorovs/gemma-4-26b-a4b-it-Imatrix-IQ4_XS-GGUF

Text Generation • 25B • Updated Apr 23 • 323 • 5

Youssofal/Qwen3.6-27B-Abliterated-Heretic-Uncensored-GGUF

Text Generation • 27B • Updated Apr 30 • 4.01k • 29

ShadowOkami/gemma-4-E2B-it-Uncensored-MAX-Q4_K_M-GGUF

Any-to-Any • 5B • Updated Apr 24 • 896 • 5

brunopio/Qwen3.5-14B-A3B-Claude-4.6-Opus-Reasoning-Distilled-reap-Q4_K_M-GGUF

Text Generation • 14B • Updated May 26 • 4.81k • 22

GestaltLabs/Ornstein-Hermes-3.6-27B-SABER-GGUF

Text Generation • 27B • Updated Apr 28 • 855 • 21

gaston-parravicini/LFM2.5-8B-A1B-Uncensored-Gaston-GGUF

Text Generation • 8B • Updated May 30 • 8.91k • 30

pjsmith/Qwen3.6-35B-A3B-2.6763bpw.gguf

35B • Updated Jun 7 • 643 • 9

MindFreakGamer/gemma-4-E2B-pocket-mechanic-GGUF

Text Generation • 5B • Updated Jun 15 • 300 • 3

mitkox/FastContext-1.0-4B-SFT-Q4_K_M-GGUF

4B • Updated Jun 15 • 71 • 19

Prototype3550/Qwen3.6-9B-Heretic-Uncensored-Thinking-Sweet-Madness-Q4_K_M-GGUF

Image-Text-to-Text • 9B • Updated Jun 18 • 3.04k • 6

prithivMLmods/lift-GGUF

Image-Text-to-Text • 9B • Updated Jun 19 • 2.75k • 8

Verdugie/Fable-Therapy-9B

Text Generation • 9B • Updated Aug 5 • 699 • 10

BennyDaBall/Krea-2-Engineer-V1-GGUF

Text Generation • 4B • Updated Aug 9 • 2.07k • 36

prithivMLmods/Q3.5-9B-GLM-5.1-v2.0-GGUF

Image-Text-to-Text • 9B • Updated Jul 2 • 426 • 3