*aadelrag/falcon-7b*
#[7.67 GB](https://huggingface.co/aadelrag/falcon-7b-Q8_0/resolve/main/falcon-7b-Q8_0.gguf?download=true)
*adicutie/gorefer-qwen*
#[1.65 GB](https://huggingface.co/aadicutie/gorefer-qwen/resolve/main/gorefer-qwen.gguf?download=true)
*abetlen/functionary-7b-v1-gguf*
#[3.86 GB](https://huggingface.co/abetlen/functionary-7b-v1-GGUF/resolve/main/functionary-7b-v1.Q4_K_S.gguf?download=true)
#[4.78 GB](https://huggingface.co/abetlen/functionary-7b-v1-GGUF/resolve/main/functionary-7b-v1.Q5_K.gguf?download=true)
#[13.5 GB](https://huggingface.co/abetlen/functionary-7b-v1-GGUF/resolve/main/functionary-7b-v1.f16.gguf?download=true)
*abhinand/Qwen3.6-35B-A3B-DFlash-gguf*
#[292 MB](https://huggingface.co/abhinand/Qwen3.6-35B-A3B-DFlash-GGUF/resolve/main/Qwen3.6-35B-A3B-DFlash-Q4_K_M.gguf?download=true)
#[400 MB](https://huggingface.co/abhinand/Qwen3.6-35B-A3B-DFlash-GGUF/resolve/main/Qwen3.6-35B-A3B-DFlash-Q6_K.gguf?download=true)
#[515 MB](https://huggingface.co/abhinand/Qwen3.6-35B-A3B-DFlash-GGUF/resolve/main/Qwen3.6-35B-A3B-DFlash-Q8_0.gguf?download=true)
#[959 MB](https://huggingface.co/abhinand/Qwen3.6-35B-A3B-DFlash-GGUF/resolve/main/Qwen3.6-35B-A3B-DFlash-bf16.gguf?download=true)
*abodizx05/model_legal*
#[16.1 GB](https://huggingface.co/abodizx05/model_legal/resolve/main/meta-llama-3.1-8b.F16.gguf?download=true)
*abhinand/13B-Theseus-MK1*
#[9.78 GB](https://huggingface.co/abhinand/13B-Theseus-MK1/resolve/main/13B-Theseus-MK1_Q5_1.gguf?download=true)
*abhinand/13B-Thorns-l2*
#[7.87 GB](https://huggingface.co/abhinand/13B-Thorns-l2/resolve/main/13B-Thorns-l2_Q4_K_M.gguf?download=true)
#[9.23 GB](https://huggingface.co/abhinand/13B-Thorns-l2/resolve/main/13B-Thorns-l2_Q5_K_M.gguf?download=true)
*abhinand/Athena-v1*
#[9.23 GB](https://huggingface.co/abhinand/Athena-v1/resolve/main/Athena-v1_Q5_K_M.gguf?download=true)
*abhinand/Athena-v2*
#[9.23 GB](https://huggingface.co/abhinand/Athena-v2/resolve/main/Athena-v2_Q5_K_M.gguf?download=true)
*abhinand/Athena-v3*
#[7.87 GB](https://huggingface.co/abhinand/Athena-v3/resolve/main/Athena-v3_Q4_K_M.gguf?download=true)
#[9.23 GB](https://huggingface.co/abhinand/Athena-v3/resolve/main/Athena-v3_Q5_K_M.gguf?download=true)
*abhinand/COTHuginn-4.5-19b*
#[10.3 GB](https://huggingface.co/abhinand/COTHuginn-4.5-19b/resolve/main/COTHuginn-4.5-19b_Q3_K_L.gguf?download=true)
#[9.39 GB](https://huggingface.co/abhinand/COTHuginn-4.5-19b/resolve/main/COTHuginn-4.5-19b_Q3_K_M.gguf?download=true)
#[8.39 GB](https://huggingface.co/abhinand/COTHuginn-4.5-19b/resolve/main/COTHuginn-4.5-19b_Q3_K_S.gguf?download=true)
#[12.1 GB](https://huggingface.co/abhinand/COTHuginn-4.5-19b/resolve/main/COTHuginn-4.5-19b_Q4_1.gguf?download=true)
#[11.7 GB](https://huggingface.co/abhinand/COTHuginn-4.5-19b/resolve/main/COTHuginn-4.5-19b_Q4_K_M.gguf?download=true)
#[11 GB](https://huggingface.co/abhinand/COTHuginn-4.5-19b/resolve/main/COTHuginn-4.5-19b_Q4_K_S.gguf?download=true)
#[14.5 GB](https://huggingface.co/abhinand/COTHuginn-4.5-19b/resolve/main/COTHuginn-4.5-19b_Q5_1.gguf?download=true)
*abhinand/CalliopeDS-L2-13B*
#[7.87 GB](https://huggingface.co/abhinand/CalliopeDS-L2-13B/resolve/main/CalliopeDS-L2-13B_Q4_K_M.gguf?download=true)
#[9.23 GB](https://huggingface.co/abhinand/CalliopeDS-L2-13B/resolve/main/CalliopeDS-L2-13B_Q5_K_M.gguf?download=true)
*abhinand/CalliopeDS-v2-L2-13B*
#[9.23 GB](https://huggingface.co/abhinand/CalliopeDS-v2-L2-13B/resolve/main/CalliopeDS-v2-L2-13B_Q5_K_M.gguf?download=true)
*abhinand/ChatAYT-Lora-Assamble-Marcoroni*
#[9.23 GB](https://huggingface.co/abhinand/ChatAYT-Lora-Assamble-Marcoroni/resolve/main/ChatAYT-Lora-Assamble-Marcoroni_Q5_K_M.gguf?download=true)
*abhinand/ChatAYT-Lora-Assamble-Marcoroni-v2*
#[9.23 GB](https://huggingface.co/abhinand/ChatAYT-Lora-Assamble-Marcoroni-v2/resolve/main/ChatAYT-Lora-Assamble-Marcoroni-v2_Q5_K_M.gguf?download=true)
*abhinand/Chronohermes-Grad-L2-13b*
#[9.78 GB](https://huggingface.co/abhinand/Chronohermes-Grad-L2-13b/resolve/main/Chronohermes-Grad-L2-13b_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/Chronohermes-Grad-L2-13b/resolve/main/Chronohermes-Grad-L2-13b_Q5_1_8K.gguf?download=true)
*abhinand/Chronorctypus-Limarobormes-13b*
#[7.87 GB](https://huggingface.co/abhinand/Chronorctypus-Limarobormes-13b/resolve/main/Chronorctypus-Limarobormes-13b_Q4_K_M.gguf?download=true)
#[7.41 GB](https://huggingface.co/abhinand/Chronorctypus-Limarobormes-13b/resolve/main/Chronorctypus-Limarobormes-13b_Q4_K_S.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/Chronorctypus-Limarobormes-13b/resolve/main/Chronorctypus-Limarobormes-13b_Q5_1.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/Chronorctypus-Limarobormes-13b/resolve/main/Chronorctypus-Limarobormes-13b_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/Chronorctypus-Limarobormes-13b/resolve/main/Chronorctypus-Limarobormes-13b_Q5_1_8K.gguf?download=true)
#[10.7 GB](https://huggingface.co/abhinand/Chronorctypus-Limarobormes-13b/resolve/main/Chronorctypus-Limarobormes-13b_Q6_K.gguf?download=true)
*abhinand/Chronos-Hermes-v2-13b-Limarp-Lora-Merged*
#[9.78 GB](https://huggingface.co/abhinand/Chronos-Hermes-v2-13b-Limarp-Lora-Merged/resolve/main/Chronos-Hermes-v2-13b-Limarp-Lora-Merged_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/Chronos-Hermes-v2-13b-Limarp-Lora-Merged/resolve/main/Chronos-Hermes-v2-13b-Limarp-Lora-Merged_Q5_1_8K.gguf?download=true)
*abhinand/Emerhyst-13B*
#[9.23 GB](https://huggingface.co/abhinand/Emerhyst-13B/resolve/main/Emerhyst-13B_Q5_K_M.gguf?download=true)
*abhinand/Emerhyst-20B*
#[9.7 GB](https://huggingface.co/abhinand/Emerhyst-20B/resolve/main/Emerhyst-20B_Q3_K_M.gguf?download=true)
#[12 GB](https://huggingface.co/abhinand/Emerhyst-20B/resolve/main/Emerhyst-20B_Q4_K_M.gguf?download=true)
#[14.2 GB](https://huggingface.co/abhinand/Emerhyst-20B/resolve/main/Emerhyst-20B_Q5_K_M.gguf?download=true)
*abhinand/EnsembleV5-Nova-13B*
#[9.23 GB](https://huggingface.co/abhinand/EnsembleV5-Nova-13B/resolve/main/EnsembleV5-Nova-13B_Q5_K_M.gguf?download=true)
*abhinand/FrankensteinsMonster-13B*
#[9.78 GB](https://huggingface.co/abhinand/FrankensteinsMonster-13B/resolve/main/FrankensteinsMonster-13B_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/FrankensteinsMonster-13B/resolve/main/FrankensteinsMonster-13B_Q5_1_8K.gguf?download=true)
*abhinand/Guanaco-13B-Uncensored*
#[9.78 GB](https://huggingface.co/abhinand/Guanaco-13B-Uncensored/resolve/main/Guanaco-13B-Uncensored_Q5_1.gguf?download=true)
*abhinand/Hermes-Kimiko-13B-f16*
#[9.78 GB](https://huggingface.co/abhinand/Hermes-Kimiko-13B-f16/resolve/main/Hermes-Kimiko-13B-f16_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/Hermes-Kimiko-13B-f16/resolve/main/Hermes-Kimiko-13B-f16_Q5_1_8K.gguf?download=true)
*abhinand/Huginn-13b-FP16*
#[9.78 GB](https://huggingface.co/abhinand/Huginn-13b-FP16/resolve/main/Huginn-13b-FP16_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/Huginn-13b-FP16/resolve/main/Huginn-13b-FP16_Q5_1_8K.gguf?download=true)
*abhinand/Huginn-13b-V4*
#[9.78 GB](https://huggingface.co/abhinand/Huginn-13b-V4/resolve/main/Huginn-13b-V4_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/Huginn-13b-V4/resolve/main/Huginn-13b-V4_Q5_1_8K.gguf?download=true)
*abhinand/Huginn-13b-v1.2*
#[9.78 GB](https://huggingface.co/abhinand/Huginn-13b-v1.2/resolve/main/Huginn-13b-v1.2_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/Huginn-13b-v1.2/resolve/main/Huginn-13b-v1.2_Q5_1_8K.gguf?download=true)
*abhinand/Huginn-19b-prototype*
#[10.3 GB](https://huggingface.co/abhinand/Huginn-19b-prototype/resolve/main/Huginn-19b-prototype_Q3_K_L.gguf?download=true)
#[9.39 GB](https://huggingface.co/abhinand/Huginn-19b-prototype/resolve/main/Huginn-19b-prototype_Q3_K_M.gguf?download=true)
#[8.39 GB](https://huggingface.co/abhinand/Huginn-19b-prototype/resolve/main/Huginn-19b-prototype_Q3_K_S.gguf?download=true)
#[12.1 GB](https://huggingface.co/abhinand/Huginn-19b-prototype/resolve/main/Huginn-19b-prototype_Q4_1.gguf?download=true)
#[11.7 GB](https://huggingface.co/abhinand/Huginn-19b-prototype/resolve/main/Huginn-19b-prototype_Q4_K_M.gguf?download=true)
#[11 GB](https://huggingface.co/abhinand/Huginn-19b-prototype/resolve/main/Huginn-19b-prototype_Q4_K_S.gguf?download=true)
#[14.5 GB](https://huggingface.co/abhinand/Huginn-19b-prototype/resolve/main/Huginn-19b-prototype_Q5_1.gguf?download=true)
*abhinand/Huginn-v3-13b*
#[9.78 GB](https://huggingface.co/abhinand/Huginn-v3-13b/resolve/main/Huginn-v3-13b_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/Huginn-v3-13b/resolve/main/Huginn-v3-13b_Q5_1_8K.gguf?download=true)
*abhinand/LLAMA2-13B-Holodeck-1*
#[9.78 GB](https://huggingface.co/abhinand/LLAMA2-13B-Holodeck-1/resolve/main/LLAMA2-13B-Holodeck-1_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/LLAMA2-13B-Holodeck-1/resolve/main/LLAMA2-13B-Holodeck-1_Q5_1_8K.gguf?download=true)
*abhinand/LLaMA2-13B-Holomax*
#[9.78 GB](https://huggingface.co/abhinand/LLaMA2-13B-Holomax/resolve/main/LLaMA2-13B-Holomax_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/LLaMA2-13B-Holomax/resolve/main/LLaMA2-13B-Holomax_Q5_1_8K.gguf?download=true)
*abhinand/LLaMa-2-PeanutButter_v19_R8-7B*
#[5.06 GB](https://huggingface.co/abhinand/LLaMa-2-PeanutButter_v19_R8-7B/resolve/main/LLaMa-2-PeanutButter_v19_R8-7B_Q5_1.gguf?download=true)
*abhinand/Llama-2-13b-hf*
#[9.78 GB](https://huggingface.co/abhinand/Llama-2-13b-hf/resolve/main/Llama-2-13b-hf_Q5_1.gguf?download=true)
*abhinand/MLewd-L2-13B*
#[9.78 GB](https://huggingface.co/abhinand/MLewd-L2-13B/resolve/main/MLewd-L2-13B_Q5_1.gguf?download=true)
*https://huggingface.co/abhinand*
#[9.78 GB](https://huggingface.co/abhinand/MLewd-L2-13B-v2/resolve/main/MLewd-L2-13B-v2_Q5_1.gguf?download=true)
*abhinand/MLewd-L2-13B-v2-1*
#[9.78 GB](https://huggingface.co/abhinand/MLewd-L2-13B-v2/resolve/main/MLewd-L2-13B-v2_Q5_1.gguf?download=true)
*abhinand/MLewd-L2-13B-v2-2*
#[9.78 GB](https://huggingface.co/abhinand/MLewd-L2-13B-v2-2/resolve/main/MLewd-L2-13B-v2-2_Q5_1.gguf?download=true)
*abhinand/MLewd-L2-13B-v2-3*
#[9.78 GB](https://huggingface.co/abhinand/MLewd-L2-13B-v2-3/resolve/main/MLewd-L2-13B-v2-3_Q5_1.gguf?download=true)
*abhinand/MLewdBoros-L2-13B*
#[9.78 GB](https://huggingface.co/abhinand/MLewd-L2-13B-v2-3/resolve/main/MLewd-L2-13B-v2-3_Q5_1.gguf?download=true)
*abhinand/MLewdBoros-L2-13B-SuperCOT*
#[9.78 GB](https://huggingface.co/abhinand/MLewdBoros-L2-13B/resolve/main/MLewdBoros-L2-13B_Q5_1.gguf?download=true)
*abhinand/Marcoroni-13B*
#[7.87 GB](https://huggingface.co/abhinand/Marcoroni-13B/resolve/main/Marcoroni-13B_Q4_K_M.gguf?download=true)
#[9.23 GB](https://huggingface.co/abhinand/Marcoroni-13B/resolve/main/Marcoroni-13B_Q5_K_M.gguf?download=true)
*abhinand/Medusa-13b*
#[9.76 GB](https://huggingface.co/abhinand/Medusa-13b/resolve/main/Medusa-13b_Q5_1_4K.gguf?download=true)
#[9.76 GB](https://huggingface.co/abhinand/Medusa-13b/resolve/main/Medusa-13b_Q5_1_8K.gguf?download=true)
*abhinand/Mythalion-Kimiko-v2*
#[9.78 GB](https://huggingface.co/abhinand/Mythalion-Kimiko-v2/resolve/main/Mythalion-Kimiko-v2_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/Mythalion-Kimiko-v2/resolve/main/Mythalion-Kimiko-v2_Q5_1_8K.gguf?download=true)
*abhinand/Mythical-Destroyer-L2-13B*
#[9.78 GB](https://huggingface.co/abhinand/Mythical-Destroyer-L2-13B/resolve/main/Mythical-Destroyer-L2-13B_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/Mythical-Destroyer-L2-13B/resolve/main/Mythical-Destroyer-L2-13B_Q5_1_8K.gguf?download=true)
*abhinand/Mythical-Destroyer-V2-L2-13B*
#[9.78 GB](https://huggingface.co/abhinand/Mythical-Destroyer-V2-L2-13B/resolve/main/Mythical-Destroyer-V2-L2-13B_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/Mythical-Destroyer-V2-L2-13B/resolve/main/Mythical-Destroyer-V2-L2-13B_Q5_1_8K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/MythoMax-L2-13b/resolve/main/MythoMax-L2-13b_Q5_1.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/MythoMax-L2-13b/resolve/main/MythoMax-L2-13b_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/MythoMax-L2-13b/resolve/main/MythoMax-L2-13b_Q5_1_8K.gguf?download=true)
*abhinand/MythoMax-L2-13b*
#[9.78 GB](https://huggingface.co/abhinand/MythoMax-L2-13b/resolve/main/MythoMax-L2-13b_Q5_1.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/MythoMax-L2-13b/resolve/main/MythoMax-L2-13b_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/MythoMax-L2-13b/resolve/main/MythoMax-L2-13b_Q5_1_8K.gguf?download=true)
*abhinand/MythoMax-L2-Kimiko-v2-13b*
#[9.78 GB](https://huggingface.co/abhinand/MythoMax-L2-Kimiko-v2-13b/resolve/main/MythoMax-L2-Kimiko-v2-13b_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/MythoMax-L2-Kimiko-v2-13b/resolve/main/MythoMax-L2-Kimiko-v2-13b_Q5_1_8K.gguf?download=true)
*abhinand/MythoMax-L2-LoRA-Assemble-13B*
#[9.23 GB](https://huggingface.co/abhinand/MythoMax-L2-LoRA-Assemble-13B/resolve/main/MythoMax-L2-LoRA-Assemble-13B_Q5_K_M.gguf?download=true)
*abhinand/Nous-Hermes-Llama2-13b*
#[9.78 GB](https://huggingface.co/abhinand/Nous-Hermes-Llama2-13b/resolve/main/Nous-Hermes-Llama2-13b_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/Nous-Hermes-Llama2-13b/resolve/main/Nous-Hermes-Llama2-13b_Q5_1_8K.gguf?download=true)
*abhinand/Nous-Hermes-Llama2-13b-Kimiko-Lora-Merged*
#[9.78 GB](https://huggingface.co/abhinand/Nous-Hermes-Llama2-13b-Kimiko-Lora-Merged/resolve/main/Nous-Hermes-Llama2-13b-Kimiko-Lora-Merged_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/Nous-Hermes-Llama2-13b-Kimiko-Lora-Merged/resolve/main/Nous-Hermes-Llama2-13b-Kimiko-Lora-Merged_Q5_1_8K.gguf?download=true)
*abhinand/Nous-Hermes-Llama2-13b-Limarp-Lora-Merged*
#[9.78 GB](https://huggingface.co/abhinand/Nous-Hermes-Llama2-13b-Limarp-Lora-Merged/resolve/main/Nous-Hermes-Llama2-13b-Limarp-Lora-Merged_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/Nous-Hermes-Llama2-13b-Limarp-Lora-Merged/resolve/main/Nous-Hermes-Llama2-13b-Limarp-Lora-Merged_Q5_1_8K.gguf?download=true)
*abhinand/Nous-Hermes-Llama2-13b-Storywriter*
#[9.78 GB](https://huggingface.co/abhinand/Nous-Hermes-Llama2-13b-Storywriter/resolve/main/Nous-Hermes-Llama2-13b-Storywriter_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/Nous-Hermes-Llama2-13b-Storywriter/resolve/main/Nous-Hermes-Llama2-13b-Storywriter_Q5_1_8K.gguf?download=true)
*abhinand/Nous-Hermes-limarp-l2-13B*
#[9.78 GB](https://huggingface.co/abhinand/Nous-Hermes-limarp-l2-13B/resolve/main/Nous-Hermes-limarp-l2-13B_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/Nous-Hermes-limarp-l2-13B/resolve/main/Nous-Hermes-limarp-l2-13B_Q5_1_8K.gguf?download=true)
*abhinand/Nova-13B*
#[9.23 GB](https://huggingface.co/abhinand/Nova-13B/resolve/main/Nova-13B_Q5_K_M.gguf?download=true)
*abhinand/Nova-13B-50-step*
#[9.23 GB](https://huggingface.co/abhinand/Nova-13B-50-step/resolve/main/Nova-13B-50-step_Q5_K_M.gguf?download=true)
*abhinand/OpenOrca-Platypus2-13B*
#[9.78 GB](https://huggingface.co/abhinand/OpenOrca-Platypus2-13B/resolve/main/OpenOrca-Platypus2-13B_Q5_1.gguf?download=true)
*abhinand/OpenRP*
#[7.87 GB](https://huggingface.co/abhinand/OpenRP/resolve/main/OpenRP_Q4_K_M.gguf?download=true)
#[9.23 GB](https://huggingface.co/abhinand/OpenRP/resolve/main/OpenRP_Q5_K_M.gguf?download=true)
*abhinand/OpenRP-13B-SuperCOT*
#[7.87 GB](https://huggingface.co/abhinand/OpenRP-13B-SuperCOT/resolve/main/OpenRP-13B-SuperCOT_Q4_K_M.gguf?download=true)
#[9.23 GB](https://huggingface.co/abhinand/OpenRP-13B-SuperCOT/resolve/main/OpenRP-13B-SuperCOT_Q5_K_M.gguf?download=true)
*abhinand/Orca-Nova-13B*
#[9.23 GB](https://huggingface.co/abhinand/Orca-Nova-13B/resolve/main/Orca-Nova-13B_Q5_K_M.gguf?download=true)
*abhinand/Platypus2-13B*
#[9.78 GB](https://huggingface.co/abhinand/Platypus2-13B/resolve/main/Platypus2-13B_Q5_1.gguf?download=true)
*abhinand/Pygmalion-2-13b-SuperCOT*
#[7.87 GB](https://huggingface.co/abhinand/Pygmalion-2-13b-SuperCOT/resolve/main/Pygmalion-2-13b-SuperCOT_Q4_K_M.gguf?download=true)
#[9.23 GB](https://huggingface.co/abhinand/Pygmalion-2-13b-SuperCOT/resolve/main/Pygmalion-2-13b-SuperCOT_Q5_K_M.gguf?download=true)
*abhinand/Pygmalion-2-13b-SuperCOT2*
#[7.87 GB](https://huggingface.co/abhinand/Pygmalion-2-13b-SuperCOT/resolve/main/Pygmalion-2-13b-SuperCOT_Q4_K_M.gguf?download=true)
#[9.23 GB](https://huggingface.co/abhinand/Pygmalion-2-13b-SuperCOT/resolve/main/Pygmalion-2-13b-SuperCOT_Q5_K_M.gguf?download=true)
*abhinand/ReML-L2-13B*
#[9.78 GB](https://huggingface.co/abhinand/ReML-L2-13B/resolve/main/ReML-L2-13B_Q5_1.gguf?download=true)
*abhinand/ReML-v2-L2-13B*
#[9.78 GB](https://huggingface.co/abhinand/ReML-v2-L2-13B/resolve/main/ReML-v2-L2-13B_Q5_1.gguf?download=true)
*abhinand/ReMM-L2-13B*
#[9.78 GB](https://huggingface.co/abhinand/ReMM-L2-13B/resolve/main/ReMM-L2-13B_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/ReMM-L2-13B/resolve/main/ReMM-L2-13B_Q5_1_8K.gguf?download=true)
*abhinand/ReMM-L2-13B-PIPPA*
#[9.78 GB](https://huggingface.co/abhinand/ReMM-L2-13B-PIPPA/resolve/main/ReMM-L2-13B-PIPPA_Q5_1.gguf?download=true)
*abhinand/ReMM-L2-13B-v1*
#[9.78 GB](https://huggingface.co/abhinand/ReMM-L2-13B-v1/resolve/main/ReMM-L2-13B-v1_Q5_1.gguf?download=true)
*abhinand/ReMM-Lion-13B*
#[9.78 GB](https://huggingface.co/abhinand/ReMM-Lion-13B/resolve/main/ReMM-Lion-13B_Q5_1.gguf?download=true)
*abhinand/ReMM-S-Kimiko-v2-13B*
#[9,78 GB](https://huggingface.co/abhinand/ReMM-S-Kimiko-v2-13B/resolve/main/ReMM-S-Kimiko-v2-13B_Q5_1.gguf?download=true)
*abhinand/ReMM-SLERP-L2-13B*
#[9.78 GB](https://huggingface.co/abhinand/ReMM-SLERP-L2-13B/resolve/main/ReMM-SLERP-L2-13B_Q5_1.gguf?download=true)
#[9.23 GB](https://huggingface.co/abhinand/ReMM-SLERP-L2-13B/resolve/main/ReMM-SLERP-L2-13B_Q5_K_M.gguf?download=true)
*abhinand/ReMM-v2-Kimiko-v2-13B*
#[7.87 GB](https://huggingface.co/abhinand/ReMM-v2-Kimiko-v2-13B/resolve/main/ReMM-v2-Kimiko-v2-13B_Q4_K_M.gguf?download=true)
#[9.23 GB](https://huggingface.co/abhinand/ReMM-v2-Kimiko-v2-13B/resolve/main/ReMM-v2-Kimiko-v2-13B_Q5_K_M.gguf?download=true)
*abhinand/ReMM-v2-L2-13B*
#[9.78 GB](https://huggingface.co/abhinand/ReMM-v2-L2-13B/resolve/main/ReMM-v2-L2-13B_Q5_1.gguf?download=true)
*abhinand/ReMM-v2-L2-13B-VARIANT*
#[9.78 GB](https://huggingface.co/abhinand/ReMM-v2-L2-13B-VARIANT/resolve/main/ReMM-v2-L2-13B-VARIANT_Q5_1.gguf?download=true)
*abhinand/ReMM-v2.1-L2-13B*
#[9.78 GB](https://huggingface.co/abhinand/ReMM-v2-L2-13B-VARIANT/resolve/main/ReMM-v2-L2-13B-VARIANT_Q5_1.gguf?download=true)
*abhinand/Slerpeno*
#[7.87 GB](https://huggingface.co/abhinand/Slerpeno/resolve/main/Slerpeno_Q4_K_M.gguf?download=true)
#[9.23 GB](https://huggingface.co/abhinand/Slerpeno/resolve/main/Slerpeno_Q5_K_M.gguf?download=true)
*abhinand/StableBeluga-13B*
#[9.78 GB](https://huggingface.co/abhinand/StableBeluga-13B/resolve/main/StableBeluga-13B_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/StableBeluga-13B/resolve/main/StableBeluga-13B_Q5_1_8K.gguf?download=true)
*abhinand/Stheno-Inverted-L2-13B*
#[9.78 GB](https://huggingface.co/abhinand/Stheno-Inverted-L2-13B/resolve/main/Stheno-Inverted-L2-13B_Q5_1.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/Stheno-Inverted-L2-13B/resolve/main/Stheno-Inverted-L2-13B_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/Stheno-Inverted-L2-13B/resolve/main/Stheno-Inverted-L2-13B_Q5_1_8K.gguf?download=true)
*abhinand/Synthia-13B*
#[9.78 GB](https://huggingface.co/abhinand/Synthia-13B/resolve/main/Synthia-13B_Q5_1.gguf?download=true)
*abhinand/UndiMix-v1-13b*
#[9.78 GB](https://huggingface.co/abhinand/UndiMix-v1-13b/resolve/main/UndiMix-v1-13b_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/UndiMix-v1-13b/resolve/main/UndiMix-v1-13b_Q5_1_8K.gguf?download=true)
*abhinand/UndiMix-v2-13b*
#[9.78 GB](https://huggingface.co/abhinand/UndiMix-v2-13b/resolve/main/UndiMix-v2-13b_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/UndiMix-v2-13b/resolve/main/UndiMix-v2-13b_Q5_1_8K.gguf?download=true)
*abhinand/UndiMix-v3-13B*
#[9.78 GB](https://huggingface.co/abhinand/UndiMix-v3-13B/resolve/main/UndiMix-v3-13B_Q5_1.gguf?download=true)
*abhinand/UndiMix-v4-13B*
#[7.87 GB](https://huggingface.co/abhinand/UndiMix-v4-13B/resolve/main/UndiMix-v4-13B_Q4_K_M.gguf?download=true)
#[9.23 GB](https://huggingface.co/abhinand/UndiMix-v4-13B/resolve/main/UndiMix-v4-13B_Q5_K_M.gguf?download=true)
*abhinand/Unholy-v1-10L-13B*
#[9.78 GB](https://huggingface.co/abhinand/Unholy-v1-10L-13B/resolve/main/Unholy-v1-10L-13B_Q5_1.gguf?download=true)
*abhinand/Unholy-v1-12L-13B*
#[9.78 GB](https://huggingface.co/abhinand/Unholy-v1-12L-13B/resolve/main/Unholy-v1-12L-13B_Q5_1.gguf?download=true)
*abhinand/WizardLM-13B-V1.0*
#[9.78 GB](https://huggingface.co/abhinand/WizardLM-13B-V1.0/resolve/main/WizardLM-13B-V1.0_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/WizardLM-13B-V1.0/resolve/main/WizardLM-13B-V1.0_Q5_1_8K.gguf?download=true)
*abhinand/WizardLM-13B-V1.2*
#[9.78 GB](https://huggingface.co/abhinand/WizardLM-13B-V1.2/resolve/main/WizardLM-13B-V1.2_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/WizardLM-13B-V1.2/resolve/main/WizardLM-13B-V1.2_Q5_1_8K.gguf?download=true)
*abhinand/airoboros-l2-13b-gpt4-2.0*
#[9.78 GB](https://huggingface.co/abhinand/airoboros-l2-13b-gpt4-2.0/resolve/main/airoboros-l2-13b-gpt4-2.0_Q5_1.gguf?download=true)
*abhinand/airochronos-l2-13B*
#[9.78 GB](https://huggingface.co/abhinand/airochronos-l2-13B/resolve/main/airochronos-l2-13B_Q5_1_34K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/airochronos-l2-13B/resolve/main/airochronos-l2-13B_Q5_1_8K.gguf?download=true)
*abhinand/airolima-chronos-grad-l2-13B*
#[9.78 GB](https://huggingface.co/abhinand/airolima-chronos-grad-l2-13B/resolve/main/airolima-chronos-grad-l2-13B_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/airolima-chronos-grad-l2-13B/resolve/main/airolima-chronos-grad-l2-13B_Q5_1_8K.gguf?download=true)
*abhinand/airolima-l2-13b-gpt4-2.0*
#[9.78 GB](https://huggingface.co/abhinand/airolima-l2-13b-gpt4-2.0/resolve/main/airolima-l2-13b-gpt4-2.0_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/airolima-l2-13b-gpt4-2.0/resolve/main/airolima-l2-13b-gpt4-2.0_Q5_1_8K.gguf?download=true)
*abhinand/chronoboros-grad-l2-13B*
#[9.78 GB](https://huggingface.co/abhinand/airolima-chronos-grad-l2-13B/resolve/main/airolima-chronos-grad-l2-13B_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/airolima-chronos-grad-l2-13B/resolve/main/airolima-chronos-grad-l2-13B_Q5_1_8K.gguf?download=true)
*abhinand/chronolima-airo-grad-l2-13B*
#[9.78 GB](https://huggingface.co/abhinand/airolima-l2-13b-gpt4-2.0/resolve/main/airolima-l2-13b-gpt4-2.0_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/airolima-l2-13b-gpt4-2.0/resolve/main/airolima-l2-13b-gpt4-2.0_Q5_1_8K.gguf?download=true)
*abhinand/chronos-13b*
#[9.78 GB](https://huggingface.co/abhinand/chronos-13b/resolve/main/chronos-13b_Q5_1.gguf?download=true)
*abhinand/chronos-13b-v2*
#[9.78 GB](https://huggingface.co/abhinand/chronos-13b-v2/resolve/main/chronos-13b-v2_Q5_1.gguf?download=true)
*abhinand/limarp-13b-merged*
#[9.78 GB](https://huggingface.co/abhinand/limarp-13b-merged/resolve/main/limarp-13b-merged_Q5_1.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/limarp-13b-merged/resolve/main/limarp-13b-merged_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/limarp-13b-merged/resolve/main/limarp-13b-merged_Q5_1_8K.gguf?download=true)
*abhinand/llama-2-13b-chat-limarp-v2-merged*
#[9.78 GB](https://huggingface.co/abhinand/llama-2-13b-chat-limarp-v2-merged/resolve/main/llama-2-13b-chat-limarp-v2-merged_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/llama-2-13b-chat-limarp-v2-merged/resolve/main/llama-2-13b-chat-limarp-v2-merged_Q5_1_8K.gguf?download=true)
*abhinand/llama-2-16b-nastychat*
#[12.2 GB](https://huggingface.co/abhinand/llama-2-16b-nastychat/resolve/main/llama-2-16b-nastychat_Q5_1.gguf?download=true)
*abhinand/model_007_13b_v2*
#[7.87 GB](https://huggingface.co/abhinand/model_007_13b_v2/resolve/main/model_007_13b_v2_Q4_K_M.gguf?download=true)
#[9.23 GB](https://huggingface.co/abhinand/model_007_13b_v2/resolve/main/model_007_13b_v2_Q5_K_M.gguf?download=true)
*abhinand/mythalion-13b*
#[9.73 GB](https://huggingface.co/abhinand/mythalion-13b/resolve/main/mythalion-13b_Q5_K_M.gguf?download=true)
*abhinand/openchat_v3.2_super*
#[9.78 GB](https://huggingface.co/abhinand/openchat_v3.2_super/resolve/main/openchat_v3.2_super_Q5_1.gguf?download=true)
*abhinand/pygmalion-2-13b*
#[9.23 GB](https://huggingface.co/abhinand/pygmalion-2-13b/resolve/main/pygmalion-2-13b_Q5_K_M.gguf?download=true)
*abhinand/robin-13b-v2-delta*
#[9.78 GB](https://huggingface.co/abhinand/robin-13b-v2-delta/resolve/main/robin-13b-v2-delta_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/robin-13b-v2-delta/resolve/main/robin-13b-v2-delta_Q5_1_8K.gguf?download=true)
*abhinand/speechless-codellama-platypus-13b*
#[9.78 GB](https://huggingface.co/abhinand/speechless-codellama-platypus-13b/resolve/main/speechless-codellama-platypus-13b_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/speechless-codellama-platypus-13b/resolve/main/speechless-codellama-platypus-13b_Q5_1_8K.gguf?download=true)
*abhinand/speechless-llama2-13b*
#[9.78 GB](https://huggingface.co/abhinand/speechless-llama2-13b/resolve/main/speechless-llama2-13b_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/speechless-llama2-13b/resolve/main/speechless-llama2-13b_Q5_1_8K.gguf?download=true)
*abhinand/speechless-llama2-hermes-orca-platypus-13b*
#[9.78 GB](https://huggingface.co/abhinand/speechless-llama2-hermes-orca-platypus-13b/resolve/main/speechless-llama2-hermes-orca-platypus-13b_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/speechless-llama2-hermes-orca-platypus-13b/resolve/main/speechless-llama2-hermes-orca-platypus-13b_Q5_1_8K.gguf?download=true)
*abhinand/speechless-llama2-hermes-orca-platypus-wizardlm-13b*
#[9.78 GB](https://huggingface.co/abhinand/speechless-llama2-hermes-orca-platypus-wizardlm-13b/resolve/main/speechless-llama2-hermes-orca-platypus-wizardlm-13b_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/speechless-llama2-hermes-orca-platypus-wizardlm-13b/resolve/main/speechless-llama2-hermes-orca-platypus-wizardlm-13b_Q5_1_8K.gguf?download=true)
*abhinand/speechless-llama2-luban-orca-platypus-13b*
#[9.78 GB](https://huggingface.co/abhinand/speechless-llama2-luban-orca-platypus-13b/resolve/main/speechless-llama2-luban-orca-platypus-13b_Q5_1_4K.gguf?download=true)
#[9.78 GB](https://huggingface.co/abhinand/speechless-llama2-luban-orca-platypus-13b/resolve/main/speechless-llama2-luban-orca-platypus-13b_Q5_1_8K.gguf?download=true)
*abhinand/spicyboros-13b-2.2*
#[9.78 GB](https://huggingface.co/abhinand/spicyboros-13b-2.2/resolve/main/spicyboros-13b-2.2_Q5_1.gguf?download=true)
*abhinand/spicyboros-7b-2.2*
#[5.06 GB](https://huggingface.co/abhinand/spicyboros-7b-2.2/resolve/main/spicyboros-7b-2.2_Q5_1.gguf?download=true)
*adamo1139*
#[4.37 GB](https://huggingface.co/adamo1139/BasicEconomics-Mistral-7B-QLORA-v0.4-GGUF/resolve/main/BasicEconomics-Mistral-v4-q4_k_m.gguf?download=true)
#[4.08 Gb](https://huggingface.co/adamo1139/BasicEconomics-SpicyBoros-2.2-7B-QLORA-v0.1-GGUF/resolve/main/BasicEconomics-SpicyBoros-7B-01-q4_K_M.gguf?download=true)
#[4.08 GB](https://huggingface.co/adamo1139/BasicEconomics-SpicyBoros-2.2-7B-QLORA-v0.2-GGUF/resolve/main/BasicEconomics-SpicyBoros-7B-02-q4_K_M.gguf?download=true)
#[4.06 Gb](https://huggingface.co/adamo1139/BasicEconomics-SpicyBoros-2.2-7B-QLORA-v0.3-GGUF/resolve/main/BasicEconomics-SpicyBoros-7B-03-q4_K_M.gguf?download=true)
#[4.08 GB](https://huggingface.co/adamo1139/PS_AD_O365_CodeLlama_7B_05_QLoRA_GGUF/resolve/main/PS_AD_O365_CodeLlama_7B_05_q4_k_m.gguf?download=true)
#[5.94 GB](https://huggingface.co/adamo1139/PS_AD_O365_Dolphin_7B_06_QLoRA_GGUF/resolve/main/PS_AD_O365_Dolphin_06_q6_k.gguf?download=true)
#[4.37 GB](https://huggingface.co/adamo1139/PS_AD_O365_Mistral_7B_02_GGUF/resolve/main/PS_AD_O365_Mistral_7B_02_q4_k_m.gguf?download=true)
#[4.37 GB](https://huggingface.co/adamo1139/PS_AD_O365_Mistral_superCOT_7B_03_QLoRA_GGUF/resolve/main/PS_AD_O365_Mistral_superCOT_7B_03_q4_k_m.gguf?download=true)
#[4.08 Gb](https://huggingface.co/adamo1139/PS_AD_O365_SpicyBoros_7B_01_GGUF/resolve/main/PS_AD_01_q4_K_M.gguf?download=true)
*adilkairolla/zeta-2.1-gguf*
#[5.07 GB](https://huggingface.co/adilkairolla/zeta-2.1-GGUF/resolve/main/zeta-2.1-Q4_K_M.gguf?download=true)
#[5.9 GB](https://huggingface.co/adilkairolla/zeta-2.1-GGUF/resolve/main/zeta-2.1-Q5_K_M.gguf?download=true)
#[8.77 GB](https://huggingface.co/adilkairolla/zeta-2.1-GGUF/resolve/main/zeta-2.1-Q8_0.gguf?download=true)
#[16.5 GB](https://huggingface.co/adilkairolla/zeta-2.1-GGUF/resolve/main/zeta-2.1-f16.gguf?download=true)
*adityabhushannagar/Qwen-3.5-9B-Gemini-Opus-merge-gguf*
#[3.83 GB](https://huggingface.co/adityabhushannagar/Qwen-3.5-9B-Gemini-Opus-merge-GGUF/resolve/main/merged-9b-opus-gemini-Q2_K.gguf?download=true)
#[4.93 GB](https://huggingface.co/adityabhushannagar/Qwen-3.5-9B-Gemini-Opus-merge-GGUF/resolve/main/merged-9b-opus-gemini-Q3_K_L.gguf?download=true)
#[4.62 GB](https://huggingface.co/adityabhushannagar/Qwen-3.5-9B-Gemini-Opus-merge-GGUF/resolve/main/merged-9b-opus-gemini-Q3_K_M.gguf?download=true)
#[4.26 GB](https://huggingface.co/adityabhushannagar/Qwen-3.5-9B-Gemini-Opus-merge-GGUF/resolve/main/merged-9b-opus-gemini-Q3_K_S.gguf?download=true)
#[5.31 GB](https://huggingface.co/adityabhushannagar/Qwen-3.5-9B-Gemini-Opus-merge-GGUF/resolve/main/merged-9b-opus-gemini-Q4_0.gguf?download=true)
#[5.81 GB](https://huggingface.co/adityabhushannagar/Qwen-3.5-9B-Gemini-Opus-merge-GGUF/resolve/main/merged-9b-opus-gemini-Q4_1.gguf?download=true)
#[5.63 GB](https://huggingface.co/adityabhushannagar/Qwen-3.5-9B-Gemini-Opus-merge-GGUF/resolve/main/merged-9b-opus-gemini-Q4_K_M.gguf?download=true)
#[5.35 GB](https://huggingface.co/adityabhushannagar/Qwen-3.5-9B-Gemini-Opus-merge-GGUF/resolve/main/merged-9b-opus-gemini-Q4_K_S.gguf?download=true)
#[6.31 GB](https://huggingface.co/adityabhushannagar/Qwen-3.5-9B-Gemini-Opus-merge-GGUF/resolve/main/merged-9b-opus-gemini-Q5_0.gguf?download=true)
#[6.8 GB](https://huggingface.co/adityabhushannagar/Qwen-3.5-9B-Gemini-Opus-merge-GGUF/resolve/main/merged-9b-opus-gemini-Q5_1.gguf?download=true)
#[6.47 GB](https://huggingface.co/adityabhushannagar/Qwen-3.5-9B-Gemini-Opus-merge-GGUF/resolve/main/merged-9b-opus-gemini-Q5_K_M.gguf?download=true)
#[6.31 GB](https://huggingface.co/adityabhushannagar/Qwen-3.5-9B-Gemini-Opus-merge-GGUF/resolve/main/merged-9b-opus-gemini-Q5_K_S.gguf?download=true)
#[7.36 GB](https://huggingface.co/adityabhushannagar/Qwen-3.5-9B-Gemini-Opus-merge-GGUF/resolve/main/merged-9b-opus-gemini-Q6_K.gguf?download=true)
#[9.53 GB](https://huggingface.co/adityabhushannagar/Qwen-3.5-9B-Gemini-Opus-merge-GGUF/resolve/main/merged-9b-opus-gemini-Q8_0.gguf?download=true)
#[17.9 GB](https://huggingface.co/adityabhushannagar/Qwen-3.5-9B-Gemini-Opus-merge-GGUF/resolve/main/merged-9b-opus-gemini-f16.gguf?download=true)
*afrideva/Nous-Capybara-3B-V1.9-gguf*
#[1.2 GB](https://huggingface.co/afrideva/Nous-Capybara-3B-V1.9-GGUF/resolve/main/nous-capybara-3b-v1.9.q2_k.gguf?download=true)
#[1.39 GB](https://huggingface.co/afrideva/Nous-Capybara-3B-V1.9-GGUF/resolve/main/nous-capybara-3b-v1.9.q3_k_m.gguf?download=true)
#[1.71 GB](https://huggingface.co/afrideva/Nous-Capybara-3B-V1.9-GGUF/resolve/main/nous-capybara-3b-v1.9.q4_k_m.gguf?download=true)
#[1.99 GB](https://huggingface.co/afrideva/Nous-Capybara-3B-V1.9-GGUF/resolve/main/nous-capybara-3b-v1.9.q5_k_m.gguf?download=true)
#[2.3 GB](https://huggingface.co/afrideva/Nous-Capybara-3B-V1.9-GGUF/resolve/main/nous-capybara-3b-v1.9.q6_k.gguf?download=true)
#[2.97 GB](https://huggingface.co/afrideva/Nous-Capybara-3B-V1.9-GGUF/resolve/main/nous-capybara-3b-v1.9.q8_0.gguf?download=true)
*ai-sage/GigaChat3.1-10B-A1.8B-gguf*
#[21.4 GB](https://huggingface.co/ai-sage/GigaChat3.1-10B-A1.8B-GGUF/resolve/main/GigaChat3.1-10B-A1.8B-bf16.gguf?download=true)
#[6.47 GB](https://huggingface.co/ai-sage/GigaChat3.1-10B-A1.8B-GGUF/resolve/main/GigaChat3.1-10B-A1.8B-q4_K_M.gguf?download=true)
#[8.78 GB](https://huggingface.co/ai-sage/GigaChat3.1-10B-A1.8B-GGUF/resolve/main/GigaChat3.1-10B-A1.8B-q6_K.gguf?download=true)
#[11.4 GB](https://huggingface.co/ai-sage/GigaChat3.1-10B-A1.8B-GGUF/resolve/main/GigaChat3.1-10B-A1.8B-q8_0.gguf?download=true)
*Qwen3-VL-Embedding-8B-gguf*
#[4.68 Gb](https://huggingface.co/aiteza/Qwen3-VL-Embedding-8B-GGUF/resolve/main/qwen3-vl-embedding-8b-q4_k_m.gguf?download=true)
*aladar/TinyLLama-v0-gguf*
#[5.68 Mb](https://huggingface.co/aladar/TinyLLama-v0-GGUF/resolve/main/TinyLLama-v0.Q8_0.gguf?download=true)
#[10 MB](https://huggingface.co/aladar/TinyLLama-v0-GGUF/resolve/main/TinyLLama-v0.f16.gguf?download=true)
#[19.2 Mb](https://huggingface.co/aladar/TinyLLama-v0-GGUF/resolve/main/TinyLLama-v0.f32.gguf?download=true)
*alexedelsburg/Puma-3b-gguf*
#[2.14 GB](https://huggingface.co/alexedelsburg/Puma-3b-GGUF/resolve/main/puma-3b.q4_1.gguf?download=true)
*aloobun/llama2-7b-WizardLM-alpaca-evol-instruct-35k-mini-gguf*
#[13.5 GB](https://huggingface.co/aloobun/llama2-7b-WizardLM-alpaca-evol-instruct-35k-mini-GGUF/resolve/main/llama2-7b-wizardlm-alpaca-evol-instruct-35k-mini.gguf.fp16.bin?download=true)
#[4.78 GB](https://huggingface.co/aloobun/llama2-7b-WizardLM-alpaca-evol-instruct-35k-mini-GGUF/resolve/main/llama2-7b-wizardlm-alpaca-evol-instruct-35k-mini.gguf.q5_k_m.bin?download=true)
*aloobun/llama2-7b-openhermes-15k-mini-gguf*
#[13.5 GB](https://huggingface.co/aloobun/llama2-7b-openhermes-15k-mini-GGUF/resolve/main/llama2-7b-openhermes-15k-mini.gguf.fp16.bin?download=true)
#[4.78 GB](https://huggingface.co/aloobun/llama2-7b-openhermes-15k-mini-GGUF/resolve/main/llama2-7b-openhermes-15k-mini.gguf.q5_k_m.bin?download=true)
*alphahg/CodeLlama-13b-hf-rust-finetune-full-gguf*
#[7.87 GB](https://huggingface.co/alphahg/CodeLlama-13b-hf-rust-finetune-full-GGUF/resolve/main/codellama-13b-hf-rust-finetune-full.q4_k_m.gguf?download=true)
#[9.23 GB](https://huggingface.co/alphahg/CodeLlama-13b-hf-rust-finetune-full-GGUF/resolve/main/codellama-13b-hf-rust-finetune-full.q5_k_m.gguf?download=true)
*alphahg/CodeLlama-7b-hf-rust-finetune-gguf*
#[4.08 GB](https://huggingface.co/alphahg/CodeLlama-7b-hf-rust-finetune-GGUF/resolve/main/codellama-7b-hf-rust-finetune.q4_k_m.gguf?download=true)
#[4.78 GB](https://huggingface.co/alphahg/CodeLlama-7b-hf-rust-finetune-GGUF/resolve/main/codellama-7b-hf-rust-finetune.q5_k_m.gguf?download=true)
*alphahg/Synatra-7B-Instruct-v0.2-gguf*
#[4.37 GB](https://huggingface.co/alphahg/Synatra-7B-Instruct-v0.2-GGUF/resolve/main/synatra-7b-instruct-v0.2.q4_k_m.gguf?download=true)
#[5.13 GB](https://huggingface.co/alphahg/Synatra-7B-Instruct-v0.2-GGUF/resolve/main/synatra-7b-instruct-v0.2.q5_k_m.gguf?download=true)
*alvarobartt/lince-zero-7b-gguf*
#[4.21 GB](https://huggingface.co/alvarobartt/lince-zero-7b-GGUF/resolve/main/lince-zero-7b-q4_0.gguf?download=true)
#[5.08 GB](https://huggingface.co/alvarobartt/lince-zero-7b-GGUF/resolve/main/lince-zero-7b-q5_0.gguf?download=true)
#[5.34 GB](https://huggingface.co/alvarobartt/lince-zero-7b-GGUF/resolve/main/lince-zero-7b-q5_k_s.gguf?download=true)
*alvion427/PerroPastorModels*
#[5.6 GB](https://huggingface.co/alvion427/PerroPastorModels/resolve/main/mistral-7b-q5_1.gguf?download=true)
#[2.7 GB](https://huggingface.co/alvion427/PerroPastorModels/resolve/main/orcamini-3b-q5_1.gguf?download=true)
*m17an/Gemma4-31B-it-GGUF*
#[32.6 GB](https://huggingface.co/am17an/Gemma4-31B-it-GGUF/resolve/main/Gemma4-31B-Q8_0.gguf?download=true)
#[515 MB](https://huggingface.co/am17an/Gemma4-31B-it-GGUF/resolve/main/mtp-gemma-4-31B-it.gguf?download=true)
*ancerlop/MistralGGUF*
#[7.7 GB](https://huggingface.co/ancerlop/MistralGGUF/resolve/main/mistral.gguf?download=true)
*androlike/TerraMix_L2_13B_16K_GGUF*
#[7.87 GB](https://huggingface.co/androlike/TerraMix_L2_13B_16K_GGUF/resolve/main/TerraMix-L2-13B-16K-Q4_K_M.gguf?download=true)
#[9.23 GB](https://huggingface.co/androlike/TerraMix_L2_13B_16K_GGUF/resolve/main/TerraMix-L2-13B-16K-Q5_K_M.gguf?download=true)
#[26 GB](https://huggingface.co/androlike/TerraMix_L2_13B_16K_GGUF/resolve/main/TerraMix-L2-13B-16K-fp16.gguf?download=true)
*androlike/astramix_l2_7b_gguf*
#[4.78 GB](https://huggingface.co/androlike/astramix_l2_7b_gguf/resolve/main/astramix_l2_7b_Q5_K_M.gguf?download=true)
#[13.5 GB](https://huggingface.co/androlike/astramix_l2_7b_gguf/resolve/main/astramix_l2_7b_f16.gguf?download=true)
*page43/MetaMath-7B-V1.0*
#[3.83 GB](https://huggingface.co/apage43/MetaMath-7B-V1.0-GGUF/resolve/main/MetaMath-7B-V1.0-Q4_0.gguf?download=true)
*apepkuss79/Baichuan-13B-Chat-GGUF*
#[7.55 GB](https://huggingface.co/apepkuss79/Baichuan-13B-Chat-GGUF/resolve/main/Baichuan-13B-Chat-f16-q4_0.gguf?download=true)
#[26.5 GB](https://huggingface.co/apepkuss79/Baichuan-13B-Chat-GGUF/resolve/main/Baichuan-13B-Chat-f16.gguf?download=true)
*apepkuss79/CodeShell-7B-Chat-GGUF*
#[16 GB](https://huggingface.co/apepkuss79/CodeShell-7B-Chat-GGUF/resolve/main/CodeShell-7B-Chat-model-f16.gguf?download=true)
#[4.57 GB](https://huggingface.co/apepkuss79/CodeShell-7B-Chat-GGUF/resolve/main/CodeShell-7B-Chat-model-q4_0.gguf?download=true)
*armand0e/Qwen3.5-4B-Gemini-3-Flash-Distill-GGUF*
#[8.42 GB](https://huggingface.co/armand0e/Qwen3.5-4B-Gemini-3-Flash-Distill-GGUF/resolve/main/Qwen3.5-4B-Gemini-3-Flash-Distill.bf16.gguf?download=true)
#[8.42 GB](https://huggingface.co/armand0e/Qwen3.5-4B-Gemini-3-Flash-Distill-GGUF/resolve/main/Qwen3.5-4B-Gemini-3-Flash-Distill.f16.gguf?download=true)
#[2.26 GB](https://huggingface.co/armand0e/Qwen3.5-4B-Gemini-3-Flash-Distill-GGUF/resolve/main/Qwen3.5-4B-Gemini-3-Flash-Distill.q3_k_m.gguf?download=true)
#[2.07 GB](https://huggingface.co/armand0e/Qwen3.5-4B-Gemini-3-Flash-Distill-GGUF/resolve/main/Qwen3.5-4B-Gemini-3-Flash-Distill.q3_k_s.gguf?download=true)
#[2.71 GB](https://huggingface.co/armand0e/Qwen3.5-4B-Gemini-3-Flash-Distill-GGUF/resolve/main/Qwen3.5-4B-Gemini-3-Flash-Distill.q4_k_m.gguf?download=true)
#[3.07 GB](https://huggingface.co/armand0e/Qwen3.5-4B-Gemini-3-Flash-Distill-GGUF/resolve/main/Qwen3.5-4B-Gemini-3-Flash-Distill.q5_k_m.gguf?download=true)
#[3.46 GB](https://huggingface.co/armand0e/Qwen3.5-4B-Gemini-3-Flash-Distill-GGUF/resolve/main/Qwen3.5-4B-Gemini-3-Flash-Distill.q6_k.gguf?download=true)
#[4.48 GB](https://huggingface.co/armand0e/Qwen3.5-4B-Gemini-3-Flash-Distill-GGUF/resolve/main/Qwen3.5-4B-Gemini-3-Flash-Distill.q8_0.gguf?download=true)
#[676 MB](https://huggingface.co/armand0e/Qwen3.5-4B-Gemini-3-Flash-Distill-GGUF/resolve/main/mmproj-BF16.gguf?download=true)
#[672 MB](https://huggingface.co/armand0e/Qwen3.5-4B-Gemini-3-Flash-Distill-GGUF/resolve/main/mmproj-F16.gguf?download=true)
#[1.33 GB](https://huggingface.co/armand0e/Qwen3.5-4B-Gemini-3-Flash-Distill-GGUF/resolve/main/mmproj-F32.gguf?download=true)
*aryannaik-91/gemma-3-4b-instruct-custom-v1*
#[2.49 GB](https://huggingface.co/aryannaik-91/gemma-3-4b-instruct-custom-v1/resolve/main/gemma-3-4b-it.Q4_K_M.gguf?download=true)
*arzaan789/phi-4-mini-uncensored*
#[1.73 GB](https://huggingface.co/arzaan789/phi-4-mini-uncensored/resolve/main/phi_4_mini_uncensored.Q2_K.gguf?download=true)
#[2.31 GB](https://huggingface.co/arzaan789/phi-4-mini-uncensored/resolve/main/phi_4_mini_uncensored.Q3_K_L.gguf?download=true)
#[2.12 GB](https://huggingface.co/arzaan789/phi-4-mini-uncensored/resolve/main/phi_4_mini_uncensored.Q3_K_M.gguf?download=true)
#[1.9 GB](https://huggingface.co/arzaan789/phi-4-mini-uncensored/resolve/main/phi_4_mini_uncensored.Q3_K_S.gguf?download=true)
#[2.49 GB](https://huggingface.co/arzaan789/phi-4-mini-uncensored/resolve/main/phi_4_mini_uncensored.Q4_K_M.gguf?download=true)
#[2.35 GB](https://huggingface.co/arzaan789/phi-4-mini-uncensored/resolve/main/phi_4_mini_uncensored.Q4_K_S.gguf?download=true)
#[2.81 GB](https://huggingface.co/arzaan789/phi-4-mini-uncensored/resolve/main/phi_4_mini_uncensored.Q5_K_M.gguf?download=true)
#[2.73 GB](https://huggingface.co/arzaan789/phi-4-mini-uncensored/resolve/main/phi_4_mini_uncensored.Q5_K_S.gguf?download=true)
#[3.16 GB](https://huggingface.co/arzaan789/phi-4-mini-uncensored/resolve/main/phi_4_mini_uncensored.Q6_K.gguf?download=true)
#[4.08 GB](https://huggingface.co/arzaan789/phi-4-mini-uncensored/resolve/main/phi_4_mini_uncensored.Q8_0.gguf?download=true)
#[7.68 GB](https://huggingface.co/arzaan789/phi-4-mini-uncensored/resolve/main/phi_4_mini_uncensored.f16.gguf?download=true)
*ash001/llama-13b-quantized*
#[7.37 GB](https://huggingface.co/ash001/llama-13b-quantized/resolve/main/chat_ggml-model-13b-q4_0.gguf?download=true)
#[7.37 GB](https://huggingface.co/ash001/llama-13b-quantized/resolve/main/normal_ggml-model-13b-q4_0.gguf?download=true)
#[2.83 GB](https://huggingface.co/asyafiqe/Merak-7B-v3-Mini-Orca-Indo-GGUF/resolve/main/Merak-7B-v3-Mini-Orca-Indo.q2_K.gguf?download=true)
#[3.6 GB](https://huggingface.co/asyafiqe/Merak-7B-v3-Mini-Orca-Indo-GGUF/resolve/main/Merak-7B-v3-Mini-Orca-Indo.q3_K_L.gguf?download=true)
#[3.3 GB](https://huggingface.co/asyafiqe/Merak-7B-v3-Mini-Orca-Indo-GGUF/resolve/main/Merak-7B-v3-Mini-Orca-Indo.q3_K_M.gguf?download=true)
#[2.95 GB](https://huggingface.co/asyafiqe/Merak-7B-v3-Mini-Orca-Indo-GGUF/resolve/main/Merak-7B-v3-Mini-Orca-Indo.q3_K_S.gguf?download=true)
#[3.83 GB](https://huggingface.co/asyafiqe/Merak-7B-v3-Mini-Orca-Indo-GGUF/resolve/main/Merak-7B-v3-Mini-Orca-Indo.q4_0.gguf?download=true)
#[4.24 GB](https://huggingface.co/asyafiqe/Merak-7B-v3-Mini-Orca-Indo-GGUF/resolve/main/Merak-7B-v3-Mini-Orca-Indo.q4_1.gguf?download=true)
#[4.08 GB](https://huggingface.co/asyafiqe/Merak-7B-v3-Mini-Orca-Indo-GGUF/resolve/main/Merak-7B-v3-Mini-Orca-Indo.q4_K_M.gguf?download=true)
#[3.86 GB](https://huggingface.co/asyafiqe/Merak-7B-v3-Mini-Orca-Indo-GGUF/resolve/main/Merak-7B-v3-Mini-Orca-Indo.q4_K_S.gguf?download=true)
#[4.65 GB](https://huggingface.co/asyafiqe/Merak-7B-v3-Mini-Orca-Indo-GGUF/resolve/main/Merak-7B-v3-Mini-Orca-Indo.q5_0.gguf?download=true)
#[5.06 GB](https://huggingface.co/asyafiqe/Merak-7B-v3-Mini-Orca-Indo-GGUF/resolve/main/Merak-7B-v3-Mini-Orca-Indo.q5_1.gguf?download=true)
#[4.78 GB](https://huggingface.co/asyafiqe/Merak-7B-v3-Mini-Orca-Indo-GGUF/resolve/main/Merak-7B-v3-Mini-Orca-Indo.q5_K_M.gguf?download=true)
#[4.65 GB](https://huggingface.co/asyafiqe/Merak-7B-v3-Mini-Orca-Indo-GGUF/resolve/main/Merak-7B-v3-Mini-Orca-Indo.q5_K_S.gguf?download=true)
#[5.53 GB](https://huggingface.co/asyafiqe/Merak-7B-v3-Mini-Orca-Indo-GGUF/resolve/main/Merak-7B-v3-Mini-Orca-Indo.q6_K.gguf?download=true)
#[7.16 GB](https://huggingface.co/asyafiqe/Merak-7B-v3-Mini-Orca-Indo-GGUF/resolve/main/Merak-7B-v3-Mini-Orca-Indo.q8_0.gguf?download=true)
*atwine/Llama-2-7b-chat-f16-gguf*
#[13.5 GB](https://huggingface.co/atwine/Llama-2-7b-chat-f16-gguf/resolve/main/Llama-2-7b-chat-f16.gguf?download=true)
*atwine/Llama-2-7b-chat-q8-gguf*
#[7.16 GB](https://huggingface.co/atwine/Llama-2-7b-chat-q8-gguf/resolve/main/Llama-2-7b-chat-q8.gguf?download=true)
*audreyt/Taiwan-LLM-7B-v2.0-chat-gguf*
#[2.83 GB](https://huggingface.co/audreyt/Taiwan-LLM-7B-v2.0-chat-GGUF/resolve/main/Taiwan-LLM-7B-v2.0-chat-Q2_K.gguf?download=true)
#[3.6 GB](https://huggingface.co/audreyt/Taiwan-LLM-7B-v2.0-chat-GGUF/resolve/main/Taiwan-LLM-7B-v2.0-chat-Q3_K_L.gguf?download=true)
#[3.3 GB](https://huggingface.co/audreyt/Taiwan-LLM-7B-v2.0-chat-GGUF/resolve/main/Taiwan-LLM-7B-v2.0-chat-Q3_K_M.gguf?download=true)
#[2.95 GB](https://huggingface.co/audreyt/Taiwan-LLM-7B-v2.0-chat-GGUF/resolve/main/Taiwan-LLM-7B-v2.0-chat-Q3_K_S.gguf?download=true)
#[3.83 GB](https://huggingface.co/audreyt/Taiwan-LLM-7B-v2.0-chat-GGUF/resolve/main/Taiwan-LLM-7B-v2.0-chat-Q4_0.gguf?download=true)
#[4.24 GB](https://huggingface.co/audreyt/Taiwan-LLM-7B-v2.0-chat-GGUF/resolve/main/Taiwan-LLM-7B-v2.0-chat-Q4_1.gguf?download=true)
#[4.08 GB](https://huggingface.co/audreyt/Taiwan-LLM-7B-v2.0-chat-GGUF/resolve/main/Taiwan-LLM-7B-v2.0-chat-Q4_K_M.gguf?download=true)
#[3.86 GB](https://huggingface.co/audreyt/Taiwan-LLM-7B-v2.0-chat-GGUF/resolve/main/Taiwan-LLM-7B-v2.0-chat-Q4_K_S.gguf?download=true)
#[4.65 GB](https://huggingface.co/audreyt/Taiwan-LLM-7B-v2.0-chat-GGUF/resolve/main/Taiwan-LLM-7B-v2.0-chat-Q5_0.gguf?download=true)
#[5.06 GB](https://huggingface.co/audreyt/Taiwan-LLM-7B-v2.0-chat-GGUF/resolve/main/Taiwan-LLM-7B-v2.0-chat-Q5_1.gguf?download=true)
#[4.78 GB](https://huggingface.co/audreyt/Taiwan-LLM-7B-v2.0-chat-GGUF/resolve/main/Taiwan-LLM-7B-v2.0-chat-Q5_K_M.gguf?download=true)
#[4.65 GB](https://huggingface.co/audreyt/Taiwan-LLM-7B-v2.0-chat-GGUF/resolve/main/Taiwan-LLM-7B-v2.0-chat-Q5_K_S.gguf?download=true)
#[5.53 GB](https://huggingface.co/audreyt/Taiwan-LLM-7B-v2.0-chat-GGUF/resolve/main/Taiwan-LLM-7B-v2.0-chat-Q6_K.gguf?download=true)
#[7.16 GB](https://huggingface.co/audreyt/Taiwan-LLM-7B-v2.0-chat-GGUF/resolve/main/Taiwan-LLM-7B-v2.0-chat-Q8_0.gguf?download=true)
*Taiwan-LLM-7B-v2.0.1-chat-gguf*
#[2.83 GB](https://huggingface.co/audreyt/Taiwan-LLM-7B-v2.0.1-chat-GGUF/resolve/main/Taiwan-LLM-7B-v2.0.1-chat-Q2_K.gguf?download=true)
#[3.6 GB](https://huggingface.co/audreyt/Taiwan-LLM-7B-v2.0.1-chat-GGUF/resolve/main/Taiwan-LLM-7B-v2.0.1-chat-Q2_K.gguf?download=true)
#[2.95 GB](https://huggingface.co/audreyt/Taiwan-LLM-7B-v2.0.1-chat-GGUF/resolve/main/Taiwan-LLM-7B-v2.0.1-chat-Q3_K_L.gguf?download=true)
#[3.83 GB](https://huggingface.co/audreyt/Taiwan-LLM-7B-v2.0.1-chat-GGUF/resolve/main/Taiwan-LLM-7B-v2.0.1-chat-Q3_K_M.gguf?download=true)
#[4.24 GB](https://huggingface.co/audreyt/Taiwan-LLM-7B-v2.0.1-chat-GGUF/resolve/main/Taiwan-LLM-7B-v2.0.1-chat-Q3_K_S.gguf?download=true)
#[4.08 GB](https://huggingface.co/audreyt/Taiwan-LLM-7B-v2.0.1-chat-GGUF/resolve/main/Taiwan-LLM-7B-v2.0.1-chat-Q4_0.gguf?download=true)
#[3.86 GB](https://huggingface.co/audreyt/Taiwan-LLM-7B-v2.0.1-chat-GGUF/resolve/main/Taiwan-LLM-7B-v2.0.1-chat-Q4_K_S.gguf?download=true)
#[4.65 GB](https://huggingface.co/audreyt/Taiwan-LLM-7B-v2.0.1-chat-GGUF/resolve/main/Taiwan-LLM-7B-v2.0.1-chat-Q5_0.gguf?download=true)
#[5.06 GB](https://huggingface.co/audreyt/Taiwan-LLM-7B-v2.0.1-chat-GGUF/resolve/main/Taiwan-LLM-7B-v2.0.1-chat-Q5_1.gguf?download=true)
#[4.78 GB](https://huggingface.co/audreyt/Taiwan-LLM-7B-v2.0.1-chat-GGUF/resolve/main/Taiwan-LLM-7B-v2.0.1-chat-Q5_K_M.gguf?download=true)
#[4.65 GB](https://huggingface.co/audreyt/Taiwan-LLM-7B-v2.0.1-chat-GGUF/resolve/main/Taiwan-LLM-7B-v2.0.1-chat-Q5_K_S.gguf?download=true)
#[5.53 GB](https://huggingface.co/audreyt/Taiwan-LLM-7B-v2.0.1-chat-GGUF/resolve/main/Taiwan-LLM-7B-v2.0.1-chat-Q6_K.gguf?download=true)
#[7.16 GB](https://huggingface.co/audreyt/Taiwan-LLM-7B-v2.0.1-chat-GGUF/resolve/main/Taiwan-LLM-7B-v2.0.1-chat-Q8_0.gguf?download=true)
*audreyt/Taiwan-LLaMa-v1.0-gguf*
#[5.51 GB](https://huggingface.co/audreyt/Taiwan-LLaMa-v1.0-GGUF/resolve/main/Taiwan-LLaMa-13b-1.0.Q2_K.gguf?download=true)
#[6.93 GB](https://huggingface.co/audreyt/Taiwan-LLaMa-v1.0-GGUF/resolve/main/Taiwan-LLaMa-13b-1.0.Q3_K_L.gguf?download=true)
#[6.31 GB](https://huggingface.co/audreyt/Taiwan-LLaMa-v1.0-GGUF/resolve/main/Taiwan-LLaMa-13b-1.0.Q3_K_M.gguf?download=true)
#[5.66 GB](https://huggingface.co/audreyt/Taiwan-LLaMa-v1.0-GGUF/resolve/main/Taiwan-LLaMa-13b-1.0.Q3_K_S.gguf?download=true)
#[7.37 GB](https://huggingface.co/audreyt/Taiwan-LLaMa-v1.0-GGUF/resolve/main/Taiwan-LLaMa-13b-1.0.Q4_0.gguf?download=true)
#[8.17 GB](https://huggingface.co/audreyt/Taiwan-LLaMa-v1.0-GGUF/resolve/main/Taiwan-LLaMa-13b-1.0.Q4_1.gguf?download=true)
#[7.87 GB](https://huggingface.co/audreyt/Taiwan-LLaMa-v1.0-GGUF/resolve/main/Taiwan-LLaMa-13b-1.0.Q4_K_M.gguf?download=true)
#[7.37 GB](https://huggingface.co/audreyt/Taiwan-LLaMa-v1.0-GGUF/resolve/main/Taiwan-LLaMa-13b-1.0.Q4_K_S.gguf?download=true)
#[8.97 GB](https://huggingface.co/audreyt/Taiwan-LLaMa-v1.0-GGUF/resolve/main/Taiwan-LLaMa-13b-1.0.Q5_0.gguf?download=true)
#[9.78 GB](https://huggingface.co/audreyt/Taiwan-LLaMa-v1.0-GGUF/resolve/main/Taiwan-LLaMa-13b-1.0.Q5_1.gguf?download=true)
#[9.23 GB](https://huggingface.co/audreyt/Taiwan-LLaMa-v1.0-GGUF/resolve/main/Taiwan-LLaMa-13b-1.0.Q5_K_M.gguf?download=true)
#[8.97 GB](https://huggingface.co/audreyt/Taiwan-LLaMa-v1.0-GGUF/resolve/main/Taiwan-LLaMa-13b-1.0.Q5_K_S.gguf?download=true)
#[18.7 GB](https://huggingface.co/audreyt/Taiwan-LLaMa-v1.0-GGUF/resolve/main/Taiwan-LLaMa-13b-1.0.Q6_K.gguf?download=true)
#[13.8 GB](https://huggingface.co/audreyt/Taiwan-LLaMa-v1.0-GGUF/resolve/main/Taiwan-LLaMa-13b-1.0.Q8_0.gguf?download=true)
*aurora-m/aurora-m-redteamed-gguf*
#[10.7 GB](https://huggingface.co/aurora-m/aurora-m-redteamed-GGUF/resolve/main/aurora-m-biden-harris-redteamed_Q5_K_S.gguf?download=true)
#[31 GB](https://huggingface.co/aurora-m/aurora-m-redteamed-GGUF/resolve/main/aurora-m-biden-harris-redteamed_fp16.gguf?download=true)
*automajicly/qwen-1.5b-android*
#[3.56 GB](https://huggingface.co/automajicly/qwen-1.5b-android/resolve/main/qwen-1.5b-base.gguf?download=true)
#[924 MB](https://huggingface.co/automajicly/qwen-1.5b-android/resolve/main/qwen-1.5b-q3.gguf?download=true)
#[1.12 GB](https://huggingface.co/automajicly/qwen-1.5b-android/resolve/main/qwen-1.5b-q4.gguf?download=true)
*xelbrons/Gemma-4-E4B-it-Q2_K*
#[4.4 GB](https://huggingface.co/axelbrons/Gemma-4-E4B-it-Q2_K/resolve/main/gemma-4-q2_k.gguf?download=true)
*xelbrons/Gemma-4-E4B-it-Q3_K_L*
#[5.02 GB](https://huggingface.co/axelbrons/Gemma-4-E4B-it-Q3_K_L/resolve/main/gemma-4-q3_k_l.gguf?download=true)
*xelbrons/Gemma-4-E4B-it-Q3_K_M*
#[4.85 GB](https://huggingface.co/axelbrons/Gemma-4-E4B-it-Q3_K_M/resolve/main/gemma-4-q3_k_m.gguf?download=true)
*xelbrons/Gemma-4-E4B-it-Q3_K_S*
#[4.65 GB](https://huggingface.co/axelbrons/Gemma-4-E4B-it-Q3_K_S/resolve/main/gemma-4-q3_k_s.gguf?download=true)
*xelbrons/Gemma-4-E4B-it-Q4_K_S*
#[5.2 GB](https://huggingface.co/axelbrons/Gemma-4-E4B-it-Q4_K_S/resolve/main/gemma-4-q4_k_s.gguf?download=true)
*xelbrons/Gemma-4-E4B-it-Q5_K_M*
#[5.76 GB](https://huggingface.co/axelbrons/Gemma-4-E4B-it-Q5_K_M/resolve/main/gemma-4-q5_k_m.gguf?download=true)
*xelbrons/Gemma-4-E4B-it-Q5_K_S*
#[5.69 GB](https://huggingface.co/axelbrons/Gemma-4-E4B-it-Q5_K_S/resolve/main/gemma-4-q5_k_s.gguf?download=true)
*xelbrons/Gemma-4-E4B-it-Q6_K*
#[6.22 GB](https://huggingface.co/axelbrons/Gemma-4-E4B-it-Q6_K/resolve/main/gemma-4-q6_k.gguf?download=true)
*xelbrons/Gemma-4-E4B-it-Q8_0*
#[8.03 GB](https://huggingface.co/axelbrons/Gemma-4-E4B-it-Q8_0/resolve/main/gemma-4-q8_0.gguf?download=true)
*axelbrons/gemma-4-E4B-it-q4_k_m*
#[5.34 GB](https://huggingface.co/axelbrons/gemma-4-E4B-it-q4_k_m/resolve/main/gemma-4-q4_k_m.gguf?download=true)
*axi0mX/SU-01-gguf*
#[61.6 GB](https://huggingface.co/axi0mX/SU-01-GGUF/resolve/main/SU-01-BF16.gguf?download=true)
#[10.8 GB](https://huggingface.co/axi0mX/SU-01-GGUF/resolve/main/SU-01-IQ2_M.gguf?download=true)
#[10.3 GB](https://huggingface.co/axi0mX/SU-01-GGUF/resolve/main/SU-01-IQ2_XXS.gguf?download=true)
#[12.9 GB](https://huggingface.co/axi0mX/SU-01-GGUF/resolve/main/SU-01-IQ3_XXS.gguf?download=true)
#[17.3 GB](https://huggingface.co/axi0mX/SU-01-GGUF/resolve/main/SU-01-IQ4_NL.gguf?download=true)
#[16.4 GB](https://huggingface.co/axi0mX/SU-01-GGUF/resolve/main/SU-01-IQ4_XS.gguf?download=true)
#[11.8 GB](https://huggingface.co/axi0mX/SU-01-GGUF/resolve/main/SU-01-Q2_K_XL.gguf?download=true)
#[14.7 GB](https://huggingface.co/axi0mX/SU-01-GGUF/resolve/main/SU-01-Q3_K_M.gguf?download=true)
#[13.8 GB](https://huggingface.co/axi0mX/SU-01-GGUF/resolve/main/SU-01-Q3_K_XL.gguf?download=true)
#[18.6 GB](https://huggingface.co/axi0mX/SU-01-GGUF/resolve/main/SU-01-Q4_K_M.gguf?download=true)
#[17.7 GB](https://huggingface.co/axi0mX/SU-01-GGUF/resolve/main/SU-01-Q4_K_XL.gguf?download=true)
#[21.7 GB](https://huggingface.co/axi0mX/SU-01-GGUF/resolve/main/SU-01-Q5_K_M.gguf?download=true)
#[21.8 GB](https://huggingface.co/axi0mX/SU-01-GGUF/resolve/main/SU-01-Q6_K.gguf?download=true)
#[26.3 GB](https://huggingface.co/axi0mX/SU-01-GGUF/resolve/main/SU-01-Q6_K_XL.gguf?download=true)
#[32.5 GB](https://huggingface.co/axi0mX/SU-01-GGUF/resolve/main/SU-01-Q8_0.gguf?download=true)
#[36 GB](https://huggingface.co/axi0mX/SU-01-GGUF/resolve/main/SU-01-Q8_K_XL.gguf?download=true)
#[122 MB](https://huggingface.co/axi0mX/SU-01-GGUF/resolve/main/imatrix_unsloth.dat?download=true)
*agofficial/AgGPT-270M*
#[543 MB](https://huggingface.co/AGofficial/AgGPT-270M/resolve/main/aggpt-270m.gguf?download=true)
*agofficial/Zure-1b*
#[2.01 GB](https://huggingface.co/AGofficial/Zure-1b/resolve/main/zure_1b.gguf?download=true)
*agofficial/minai-flash-lite-1b*
#[2.01 GB](https://huggingface.co/AGofficial/minai-flash-lite-1b/resolve/main/minai-flash-lite-1b.gguf?download=true)
*I-Engine/Llama2-7B-Chat-gguf*
#[2.83 GB](https://huggingface.co/AI-Engine/Llama2-7B-Chat-GGUF/resolve/main/Llama2-7b-chat.q2_k.gguf?download=true)
#[4.78 GB](https://huggingface.co/AI-Engine/Llama2-7B-Chat-GGUF/resolve/main/Llama2-7b-chat.q5_k_m.gguf?download=true)
#[7.16 GB](https://huggingface.co/AI-Engine/Llama2-7B-Chat-GGUF/resolve/main/Llama2-7b-chat.q8_0.gguf?download=true)
#[4.08 GB](https://huggingface.co/AI-Engine/Llama2-7B-Chat-GGUF/resolve/main/llama2-7B-Chat.Q4_K_M.gguf?download=true)
*I-Engine/MythoMax-L2-13B-gguf*
#[5.43 GB](https://huggingface.co/AI-Engine/MythoMax-L2-13B-GGUF/resolve/main/MythoMax-L2-13B.Q2_K.gguf?download=true)
#[9.23 GB](https://huggingface.co/AI-Engine/MythoMax-L2-13B-GGUF/resolve/main/MythoMax-L2-13B.Q5_K_M.gguf?download=true)
#[13.8 GB](https://huggingface.co/AI-Engine/MythoMax-L2-13B-GGUF/resolve/main/MythoMax-L2-13B.Q8_0.gguf?download=true)
*ashraf995/codegemma-7b-Q4_K_M-gguf*
#[5.33 GB](https://huggingface.co/Aashraf995/codegemma-7b-Q4_K_M-GGUF/resolve/main/codegemma-7b-q4_k_m.gguf?download=true)
*abiray/Anima-base-v1.0-FP8-INT8*
#[870 MB](https://huggingface.co/Abiray/BitCPM4-CANN-0.5B-GGUF/resolve/main/BitCPM4-CANN-0.5B-F16.gguf?download=true)
#[235 MB](https://huggingface.co/Abiray/BitCPM4-CANN-0.5B-GGUF/resolve/main/BitCPM4-CANN-0.5B-Q3_K_M.gguf?download=true)
#[267 MB](https://huggingface.co/Abiray/BitCPM4-CANN-0.5B-GGUF/resolve/main/BitCPM4-CANN-0.5B-Q4_K_M.gguf?download=true)
#[317 MB](https://huggingface.co/Abiray/BitCPM4-CANN-0.5B-GGUF/resolve/main/BitCPM4-CANN-0.5B-Q5_K_M.gguf?download=true)
#[310 MB](https://huggingface.co/Abiray/BitCPM4-CANN-0.5B-GGUF/resolve/main/BitCPM4-CANN-0.5B-Q5_K_S.gguf?download=true)
#[358 MB](https://huggingface.co/Abiray/BitCPM4-CANN-0.5B-GGUF/resolve/main/BitCPM4-CANN-0.5B-Q6_K.gguf?download=true)
#[463 MB](https://huggingface.co/Abiray/BitCPM4-CANN-0.5B-GGUF/resolve/main/BitCPM4-CANN-0.5B-Q8_0.gguf?download=true)
*abiray/BitCPM4-CANN-0.5B-gguf*
#[1.79 GB](https://huggingface.co/Abiray/BitCPM4-CANN-3B-GGUF/resolve/main/BitCPM4-CANN-3B-Q3_K_M.gguf?download=true)
#[2.19 GB](https://huggingface.co/Abiray/BitCPM4-CANN-3B-GGUF/resolve/main/BitCPM4-CANN-3B-Q4_K_M.gguf?download=true)
#[2.09 GB](https://huggingface.co/Abiray/BitCPM4-CANN-3B-GGUF/resolve/main/BitCPM4-CANN-3B-Q4_K_S.gguf?download=true)
#[2.56 GB](https://huggingface.co/Abiray/BitCPM4-CANN-3B-GGUF/resolve/main/BitCPM4-CANN-3B-Q5_K_M.gguf?download=true)
#[2.51 GB](https://huggingface.co/Abiray/BitCPM4-CANN-3B-GGUF/resolve/main/BitCPM4-CANN-3B-Q5_K_S.gguf?download=true)
#[2.96 GB](https://huggingface.co/Abiray/BitCPM4-CANN-3B-GGUF/resolve/main/BitCPM4-CANN-3B-Q6_K.gguf?download=true)
#[3.83 GB](https://huggingface.co/Abiray/BitCPM4-CANN-3B-GGUF/resolve/main/BitCPM4-CANN-3B-Q8_0.gguf?download=true)
*abiray/BitCPM4-CANN-3B-gguf*
#[4.02 GB](https://huggingface.co/Abiray/BitCPM4-CANN-8B-GGUF/resolve/main/BitCPM4-CANN-8B-Q3_K_M.gguf?download=true)
#[4.97 GB](https://huggingface.co/Abiray/BitCPM4-CANN-8B-GGUF/resolve/main/BitCPM4-CANN-8B-Q4_K_M.gguf?download=true)
#[4.72 GB](https://huggingface.co/Abiray/BitCPM4-CANN-8B-GGUF/resolve/main/BitCPM4-CANN-8B-Q4_K_S.gguf?download=true)
#[5.81 GB](https://huggingface.co/Abiray/BitCPM4-CANN-8B-GGUF/resolve/main/BitCPM4-CANN-8B-Q5_K_M.gguf?download=true)
#[5.76 GB](https://huggingface.co/Abiray/BitCPM4-CANN-8B-GGUF/resolve/main/BitCPM4-CANN-8B-Q5_K_S.gguf?download=true)
#[6.72 GB](https://huggingface.co/Abiray/BitCPM4-CANN-8B-GGUF/resolve/main/BitCPM4-CANN-8B-Q6_K.gguf?download=true)
#[8.7 GB](https://huggingface.co/Abiray/BitCPM4-CANN-8B-GGUF/resolve/main/BitCPM4-CANN-8B-Q8_0.gguf?download=true)
*abiray/LTX-2.3-22B-DISTILLED-1.1-gguf*
#[14.7 GB](https://huggingface.co/Abiray/LTX-2.3-22B-DISTILLED-1.1-GGUF/resolve/main/LTX-2.3-22B-distilled-1.1-Q3_K_M.gguf?download=true)
#[17.8 GB](https://huggingface.co/Abiray/LTX-2.3-22B-DISTILLED-1.1-GGUF/resolve/main/LTX-2.3-22B-distilled-1.1-Q4_K_M.gguf?download=true)
#[19.4 GB](https://huggingface.co/Abiray/LTX-2.3-22B-DISTILLED-1.1-GGUF/resolve/main/LTX-2.3-22B-distilled-1.1-Q5_K_M.gguf?download=true)
#[21 GB](https://huggingface.co/Abiray/LTX-2.3-22B-DISTILLED-1.1-GGUF/resolve/main/LTX-2.3-22B-distilled-1.1-Q6_K.gguf?download=true)
#[25.5 GB](https://huggingface.co/Abiray/LTX-2.3-22B-DISTILLED-1.1-GGUF/resolve/main/LTX-2.3-22B-distilled-1.1-Q8_0.gguf?download=true)
*abiray/LTX2.3-10Eros-gguf*
#[11.1 GB](https://huggingface.co/Abiray/LTX2.3-10Eros-GGUF/resolve/main/10Eros_v1-Q3_K_M.gguf?download=true)
#[10.3 GB](https://huggingface.co/Abiray/LTX2.3-10Eros-GGUF/resolve/main/10Eros_v1-Q3_K_S.gguf?download=true)
#[13 GB](https://huggingface.co/Abiray/LTX2.3-10Eros-GGUF/resolve/main/10Eros_v1-Q4_0.gguf?download=true)
#[14.3 GB](https://huggingface.co/Abiray/LTX2.3-10Eros-GGUF/resolve/main/10Eros_v1-Q4_K_M.gguf?download=true)
#[13.2 GB](https://huggingface.co/Abiray/LTX2.3-10Eros-GGUF/resolve/main/10Eros_v1-Q4_K_S.gguf?download=true)
#[15.3 GB](https://huggingface.co/Abiray/LTX2.3-10Eros-GGUF/resolve/main/10Eros_v1-Q5_0.gguf?download=true)
#[16.1 GB](https://huggingface.co/Abiray/LTX2.3-10Eros-GGUF/resolve/main/10Eros_v1-Q5_K_M.gguf?download=true)
#[15 GB](https://huggingface.co/Abiray/LTX2.3-10Eros-GGUF/resolve/main/10Eros_v1-Q5_K_S.gguf?download=true)
#[17.8 GB](https://huggingface.co/Abiray/LTX2.3-10Eros-GGUF/resolve/main/10Eros_v1-Q6_K.gguf?download=true)
#[22.8 GB](https://huggingface.co/Abiray/LTX2.3-10Eros-GGUF/resolve/main/10Eros_v1-Q8_0.gguf?download=true)
*abiray/Lance_3B_Video-gguf*
#[4.96 GB](https://huggingface.co/Abiray/Lance_3B_Video-GGUF/resolve/main/Lance_3B_Video-Q4_K_M.gguf?download=true)
#[5.53 GB](https://huggingface.co/Abiray/Lance_3B_Video-GGUF/resolve/main/Lance_3B_Video-Q5_K_M.gguf?download=true)
#[6.12 GB](https://huggingface.co/Abiray/Lance_3B_Video-GGUF/resolve/main/Lance_3B_Video-Q6_K.gguf?download=true)
#[7.62 GB](https://huggingface.co/Abiray/Lance_3B_Video-GGUF/resolve/main/Lance_3B_Video-Q8_0.gguf?download=true)
*abiray/Qwen3.6-35B-A3B-Q4_K_M-gguf*
#[21.2 GB](https://huggingface.co/Abiray/Qwen3.6-35B-A3B-Q4_K_M-GGUF/resolve/main/Qwen3.6-35B-A3B-Q4_K_M.gguf?download=true)
#[903 MB](https://huggingface.co/Abiray/Qwen3.6-35B-A3B-Q4_K_M-GGUF/resolve/main/mmproj-BF16.gguf?download=true)
#[899 MB](https://huggingface.co/Abiray/Qwen3.6-35B-A3B-Q4_K_M-GGUF/resolve/main/mmproj-F16.gguf?download=true)
#[1.79 GB](https://huggingface.co/Abiray/Qwen3.6-35B-A3B-Q4_K_M-GGUF/resolve/main/mmproj-F32.gguf?download=true)
*abiray/Qwen3.6-35B-A3B-Q6_K-gguf*
#[28.5 GB](https://huggingface.co/Abiray/Qwen3.6-35B-A3B-Q6_K-GGUF/resolve/main/Qwen3.6-35B-A3B-Q6_K.gguf?download=true)
#[903 MB](https://huggingface.co/Abiray/Qwen3.6-35B-A3B-Q6_K-GGUF/resolve/main/mmproj-BF16.gguf?download=true)
#[899 MB](https://huggingface.co/Abiray/Qwen3.6-35B-A3B-Q6_K-GGUF/resolve/main/mmproj-F16.gguf?download=true)
#[1.79 GB](https://huggingface.co/Abiray/Qwen3.6-35B-A3B-Q6_K-GGUF/resolve/main/mmproj-F32.gguf?download=true)
*abiray/Sulphur-2-base-gguf*
#[11.1 GB](https://huggingface.co/Abiray/Sulphur-2-base-GGUF/resolve/main/sulphur_dev-Q3_K_M.gguf?download=true)
#[10.3 GB](https://huggingface.co/Abiray/Sulphur-2-base-GGUF/resolve/main/sulphur_dev-Q3_K_S.gguf?download=true)
#[13 GB](https://huggingface.co/Abiray/Sulphur-2-base-GGUF/resolve/main/sulphur_dev-Q4_0.gguf?download=true)
#[14.3 GB](https://huggingface.co/Abiray/Sulphur-2-base-GGUF/resolve/main/sulphur_dev-Q4_K_M.gguf?download=true)
#[13.2 GB](https://huggingface.co/Abiray/Sulphur-2-base-GGUF/resolve/main/sulphur_dev-Q4_K_S.gguf?download=true)
#[15.3 GB](https://huggingface.co/Abiray/Sulphur-2-base-GGUF/resolve/main/sulphur_dev-Q5_0.gguf?download=true)
#[16.1 B](https://huggingface.co/Abiray/Sulphur-2-base-GGUF/resolve/main/sulphur_dev-Q5_K_M.gguf?download=true)
#[15 GB](https://huggingface.co/Abiray/Sulphur-2-base-GGUF/resolve/main/sulphur_dev-Q5_K_S.gguf?download=true)
#[17.8 GB](https://huggingface.co/Abiray/Sulphur-2-base-GGUF/resolve/main/sulphur_dev-Q6_K.gguf?download=true)
#[22 GB](https://huggingface.co/Abiray/Sulphur-2-base-GGUF/resolve/main/sulphur_dev-Q8_0.gguf?download=true)
#[42 GB](https://huggingface.co/Abiray/Sulphur-2-base-GGUF/resolve/main/sulphur_dev_bf16.gguf?download=true)
*abiray/ZAYA1-8B-gguf*
#[4.51 GB](https://huggingface.co/Abiray/ZAYA1-8B-GGUF/resolve/main/ZAYA1-8B-Q3_K_M.gguf?download=true)
#[5.57 GB](https://huggingface.co/Abiray/ZAYA1-8B-GGUF/resolve/main/ZAYA1-8B-Q4_K_M.gguf?download=true)
#[5.26 GB](https://huggingface.co/Abiray/ZAYA1-8B-GGUF/resolve/main/ZAYA1-8B-Q4_K_S.gguf?download=true)
#[6.43 GB](https://huggingface.co/Abiray/ZAYA1-8B-GGUF/resolve/main/ZAYA1-8B-Q5_K_M.gguf?download=true)
#[7.35 GB](https://huggingface.co/Abiray/ZAYA1-8B-GGUF/resolve/main/ZAYA1-8B-Q6_K.gguf?download=true)
#[9.49 GB](https://huggingface.co/Abiray/ZAYA1-8B-GGUF/resolve/main/ZAYA1-8B-Q8_0.gguf?download=true)
*abiray/gemma-4-31B-Claude-4.6-Opus-Reasoning-Distilled-gguf*
#[15.3 GB](https://huggingface.co/Abiray/gemma-4-31B-Claude-4.6-Opus-Reasoning-Distilled-GGUF/resolve/main/gemma-4-31B-Claude-4.6-Opus-Reasoning-Distilled-Q3_K_M.gguf?download=true)
#[18.7 GB](https://huggingface.co/Abiray/gemma-4-31B-Claude-4.6-Opus-Reasoning-Distilled-GGUF/resolve/main/gemma-4-31B-Claude-4.6-Opus-Reasoning-Distilled-Q4_K_M.gguf?download=true)
#[21.8 GB](https://huggingface.co/Abiray/gemma-4-31B-Claude-4.6-Opus-Reasoning-Distilled-GGUF/resolve/main/gemma-4-31B-Claude-4.6-Opus-Reasoning-Distilled-Q5_K_M.gguf?download=true)
#[25.2 GB](https://huggingface.co/Abiray/gemma-4-31B-Claude-4.6-Opus-Reasoning-Distilled-GGUF/resolve/main/gemma-4-31B-Claude-4.6-Opus-Reasoning-Distilled-Q6_K.gguf?download=true)
#[32.6 GB](https://huggingface.co/Abiray/gemma-4-31B-Claude-4.6-Opus-Reasoning-Distilled-GGUF/resolve/main/gemma-4-31B-Claude-4.6-Opus-Reasoning-Distilled-Q8_0.gguf?download=true)
*abiray/gemma-4-E4B-Gemini-3.1-Pro-Reasoning-Distill-gguf*
#[4.85 GB](https://huggingface.co/Abiray/gemma-4-E4B-Gemini-3.1-Pro-Reasoning-Distill-GGUF/resolve/main/gemma-4-E4B-Gemini-3.1-Pro-Reasoning-Distill-Q3_K_M.gguf?download=true)
#[5.34 GB](https://huggingface.co/Abiray/gemma-4-E4B-Gemini-3.1-Pro-Reasoning-Distill-GGUF/resolve/main/gemma-4-E4B-Gemini-3.1-Pro-Reasoning-Distill-Q4_K_M.gguf?download=true)
#[5.76 GB](https://huggingface.co/Abiray/gemma-4-E4B-Gemini-3.1-Pro-Reasoning-Distill-GGUF/resolve/main/gemma-4-E4B-Gemini-3.1-Pro-Reasoning-Distill-Q5_K_M.gguf?download=true)
#[6.22 GB](https://huggingface.co/Abiray/gemma-4-E4B-Gemini-3.1-Pro-Reasoning-Distill-GGUF/resolve/main/gemma-4-E4B-Gemini-3.1-Pro-Reasoning-Distill-Q6_K.gguf?download=true)
#[8.03 GB](https://huggingface.co/Abiray/gemma-4-E4B-Gemini-3.1-Pro-Reasoning-Distill-GGUF/resolve/main/gemma-4-E4B-Gemini-3.1-Pro-Reasoning-Distill-Q8_0.gguf?download=true)
*abiray/gemma-4-E4B-it-OBLITERATED-gguf*
#[4.82 GB](https://huggingface.co/Abiray/gemma-4-E4B-it-OBLITERATED-GGUF/resolve/main/gemma-4-E4B-it-obliterated-Q3_K_M.gguf?download=true)
#[5.15 GB](https://huggingface.co/Abiray/gemma-4-E4B-it-OBLITERATED-GGUF/resolve/main/gemma-4-E4B-it-obliterated-Q4_0.gguf?download=true)
#[5.3 GB](https://huggingface.co/Abiray/gemma-4-E4B-it-OBLITERATED-GGUF/resolve/main/gemma-4-E4B-it-obliterated-Q4_K_M.gguf?download=true)
#[5.65 GB](https://huggingface.co/Abiray/gemma-4-E4B-it-OBLITERATED-GGUF/resolve/main/gemma-4-E4B-it-obliterated-Q5_0.gguf?download=true)
#[5.72 GB](https://huggingface.co/Abiray/gemma-4-E4B-it-OBLITERATED-GGUF/resolve/main/gemma-4-E4B-it-obliterated-Q5_K_M.gguf?download=true)
#[6.17 GB](https://huggingface.co/Abiray/gemma-4-E4B-it-OBLITERATED-GGUF/resolve/main/gemma-4-E4B-it-obliterated-Q6_K.gguf?download=true)
#[7.67 GB](https://huggingface.co/Abiray/gemma-4-E4B-it-OBLITERATED-GGUF/resolve/main/gemma-4-E4B-it-obliterated-Q8_0.gguf?download=true)
*acly/BiRefNet-gguf*
#[440 MB](https://huggingface.co/Acly/BiRefNet-GGUF/resolve/main/BiRefNet-F16.gguf?download=true)
#[440 MB](https://huggingface.co/Acly/BiRefNet-GGUF/resolve/main/BiRefNet-dynamic-F16.gguf?download=true)
#[88.6 MB](https://huggingface.co/Acly/BiRefNet-GGUF/resolve/main/BiRefNet-lite-F16.gguf?download=true)
*aesSedai/GLM-4.7-gguf*
#[688 MB](https://huggingface.co/AesSedai/GLM-4.7-GGUF/resolve/main/imatrix.gguf?download=true)
*aesSedai/MiMo-V2.5-gguf*
#[1.46 GB](https://huggingface.co/AesSedai/MiMo-V2.5-GGUF/resolve/main/mmproj-MiMo-V2.5-BF16.gguf?download=true)
#[1.46 GB](https://huggingface.co/AesSedai/MiMo-V2.5-GGUF/resolve/main/mmproj-MiMo-V2.5-F16.gguf?download=true)
#[2.91 GB](https://huggingface.co/AesSedai/MiMo-V2.5-GGUF/resolve/main/mmproj-MiMo-V2.5-F32.gguf?download=true)
#[781 MB](https://huggingface.co/AesSedai/MiMo-V2.5-GGUF/resolve/main/mmproj-MiMo-V2.5-Q8_0.gguf?download=true)
*aesSedai/MiMo-V2.5-Pro-gguf*
#[1.53 GB](https://huggingface.co/AesSedai/MiMo-V2.5-Pro-GGUF/resolve/main/imatrix.gguf?download=true)
*aesSedai/MiniMax-M2.5-gguf*
#[492 MB](https://huggingface.co/AesSedai/MiniMax-M2.5-GGUF/resolve/main/imatrix.gguf?download=true)
*aesSedai/MiniMax-M2.7-gguf*
#[492 MB](https://huggingface.co/AesSedai/MiniMax-M2.7-GGUF/resolve/main/imatrix.gguf?download=true)
*aesSedai/Qwen3.5-397B-A17B-gguf*
#[639 MB](https://huggingface.co/AesSedai/Qwen3.5-397B-A17B-GGUF/resolve/main/imatrix.gguf?download=true)
#[922 MB](https://huggingface.co/AesSedai/Qwen3.5-397B-A17B-GGUF/resolve/main/mmproj-Qwen3.5-397B-A17B-BF16.gguf?download=true)
#[918 MB](https://huggingface.co/AesSedai/Qwen3.5-397B-A17B-GGUF/resolve/main/mmproj-Qwen3.5-397B-A17B-F16.gguf?download=true)
#[1.82 GB](https://huggingface.co/AesSedai/Qwen3.5-397B-A17B-GGUF/resolve/main/mmproj-Qwen3.5-397B-A17B-F32.gguf?download=true)
#[624 MB](https://huggingface.co/AesSedai/Qwen3.5-397B-A17B-GGUF/resolve/main/mmproj-Qwen3.5-397B-A17B-Q8_0.gguf?download=true)
*aesSedai/Qwen3.6-35B-A3B-gguf*
#[192 MB](https://huggingface.co/AesSedai/Qwen3.6-35B-A3B-GGUF/resolve/main/imatrix.gguf?download=true)
#[903 MB](https://huggingface.co/AesSedai/Qwen3.6-35B-A3B-GGUF/resolve/main/mmproj-Qwen3.6-35B-A3B-BF16.gguf?download=true)
#[899 MB](https://huggingface.co/AesSedai/Qwen3.6-35B-A3B-GGUF/resolve/main/mmproj-Qwen3.6-35B-A3B-F16.gguf?download=true)
#[1.79 GB](https://huggingface.co/AesSedai/Qwen3.6-35B-A3B-GGUF/resolve/main/mmproj-Qwen3.6-35B-A3B-F32.gguf?download=true)
#[614 mb](https://huggingface.co/AesSedai/Qwen3.6-35B-A3B-GGUF/resolve/main/mmproj-Qwen3.6-35B-A3B-Q8_0.gguf?download=true)
*agnuxo/Mamba-Codestral-7B-v0.1-instruct-python_coding_assistant-gguf_4bit*
#[4.37 GB](https://huggingface.co/Agnuxo/Mamba-Codestral-7B-v0.1-instruct-python_coding_assistant-GGUF_4bit/resolve/main/unsloth.Q4_K_M.gguf?download=true)
*agnuxo/Mistral-Nemo-CODE-Python_assistant-gguf_8bit*
#[13 GB](https://huggingface.co/Agnuxo/Mistral-Nemo-CODE-Python_assistant-GGUF_8bit/resolve/main/unsloth.Q8_0.gguf?download=true)
*aitrepreneur/FLX*
#[12.1 GB](https://huggingface.co/Aitrepreneur/FLX/resolve/main/Qwen-Image-Edit-2509-Q4_K_S.gguf?download=true)
#[14.1 GB](https://huggingface.co/Aitrepreneur/FLX/resolve/main/Qwen-Image-Edit-2509-Q5_K_S.gguf?download=true)
#[21.8 GB](https://huggingface.co/Aitrepreneur/FLX/resolve/main/Qwen-Image-Edit-2509-Q8_0.gguf?download=true)
#[1.7 GB](https://huggingface.co/Aitrepreneur/FLX/resolve/main/Qwen-Image-Edit-Lightning-4steps-V1.0.safetensors?download=true)
#[1.7 GB](https://huggingface.co/Aitrepreneur/FLX/resolve/main/Qwen-Image-Edit-Lightning-8steps-V1.0.safetensors?download=true)
#[1.7 GB](https://huggingface.co/Aitrepreneur/FLX/resolve/main/Qwen-Image-Lightning-4steps-V1.0.safetensors?download=true)
#[1.7 GB](https://huggingface.co/Aitrepreneur/FLX/resolve/main/Qwen-Image-Lightning-8steps-V1.1.safetensors?download=true)
#[4.79 GB](https://huggingface.co/Aitrepreneur/FLX/resolve/main/Qwen2.5-VL-7B-Instruct-UD-Q4_K_S.gguf?download=true)
#[4.79 GB](https://huggingface.co/Aitrepreneur/FLX/resolve/main/Qwen2.5-VL-7B-Instruct-UD-Q4_K_XL.gguf?download=true)
#[5.46 GB](https://huggingface.co/Aitrepreneur/FLX/resolve/main/Qwen2.5-VL-7B-Instruct-UD-Q5_K_S.gguf?download=true)
#[10.2 GB](https://huggingface.co/Aitrepreneur/FLX/resolve/main/Qwen2.5-VL-7B-Instruct-UD-Q8_0.gguf?download=true)
#[1.35 GB](https://huggingface.co/Aitrepreneur/FLX/resolve/main/Qwen2.5-VL-7B-Instruct-mmproj-BF16.gguf?download=true)
#[3.66 GB](https://huggingface.co/Aitrepreneur/FLX/resolve/main/Qwen3-4B-UD-Q6_K_XL.gguf?download=true)
#[12.1 GB](https://huggingface.co/Aitrepreneur/FLX/resolve/main/Qwen_Image_Distill-Q4_K_S.gguf?download=true)
#[14.1 GB](https://huggingface.co/Aitrepreneur/FLX/resolve/main/Qwen_Image_Distill-Q5_K_S.gguf?download=true)
#[21.8 GB](https://huggingface.co/Aitrepreneur/FLX/resolve/main/Qwen_Image_Distill-Q8_0.gguf?download=true)
#[12.1 GB](https://huggingface.co/Aitrepreneur/FLX/resolve/main/Qwen_Image_Edit-Q4_K_S.gguf?download=true)
#[14.1 GB](https://huggingface.co/Aitrepreneur/FLX/resolve/main/Qwen_Image_Edit-Q5_K_S.gguf?download=true)
#[21.8 GB](https://huggingface.co/Aitrepreneur/FLX/resolve/main/Qwen_Image_Edit-Q8_0.gguf?download=true)
*akila/Mistral-of-Realms-7b-Instruct-v0.2-gguf*
#[4.37 GB](https://huggingface.co/Akila/Mistral-of-Realms-7b-Instruct-v0.2-gguf/resolve/main/Mistral-of-Realms-7b-Instruct-v0_2-Q4_K_M.gguf?download=true)
#[5.13 GB](https://huggingface.co/Akila/Mistral-of-Realms-7b-Instruct-v0.2-gguf/resolve/main/Mistral-of-Realms-7b-Instruct-v0_2-Q5_K_M.gguf?download=true)
#[14.5 GB](https://huggingface.co/Akila/Mistral-of-Realms-7b-Instruct-v0.2-gguf/resolve/main/Mistral-of-Realms-7b-Instruct-v0_2-f16.gguf?download=true)
*aldaris/Qwen3-14B-Q4_K_M-gguf*
#[9 GB](https://huggingface.co/Aldaris/Qwen3-14B-Q4_K_M-GGUF/resolve/main/qwen3-14b-q4_k_m.gguf?download=true)
*aldaris/Qwen3-8B-Q4_K_M-gguf*
#[5.03 GB](https://huggingface.co/Aldaris/Qwen3-8B-Q4_K_M-GGUF/resolve/main/qwen3-8b-q4_k_m.gguf?download=true)
*aldaris/gemma-3-4b-it-Q4_K_M-gguf*
#[2.49 GB](https://huggingface.co/Aldaris/gemma-3-4b-it-Q4_K_M-GGUF/resolve/main/gemma-3-4b-it-q4_k_m.gguf?download=true)
*lexWortega/qwen35-4b-clawd-rift-gguf*
#[2.71 GB](https://huggingface.co/AlexWortega/qwen35-4b-clawd-rift-gguf/resolve/main/clawd-rift-Q4_K_M.gguf?download=true)
#[3.07 GB](https://huggingface.co/AlexWortega/qwen35-4b-clawd-rift-gguf/resolve/main/clawd-rift-Q5_K_M.gguf?download=true)
#[4.48 GB](https://huggingface.co/AlexWortega/qwen35-4b-clawd-rift-gguf/resolve/main/clawd-rift-Q8_0.gguf?download=true)
#[8.42 GB](https://huggingface.co/AlexWortega/qwen35-4b-clawd-rift-gguf/resolve/main/clawd-rift-f16.gguf?download=true)
*alexanderKyng/Qwen3.6-27B-MTP-Custom-IQ6_K*
#[928 MB](https://huggingface.co/AlexanderKyng/Qwen3.6-27B-MTP-Custom-IQ6_K/resolve/main/mmproj-F16.gguf?download=true)
#[22.7 GB](https://huggingface.co/AlexanderKyng/Qwen3.6-27B-MTP-Custom-IQ6_K/resolve/main/qwen3.6-27B-MTP-Custom-IQ6_K.gguf?download=true)
#[13.6 MB](https://huggingface.co/AlexanderKyng/Qwen3.6-27B-MTP-Custom-IQ6_K/resolve/main/qwen3.6-27B.imatrix.dat?download=true)
*licanKiraz0/Cybersecurity-BaronLLM_Offensive_Security_LLM_Q6_K_GGUF*
#[6.6 GB](https://huggingface.co/AlicanKiraz0/Cybersecurity-BaronLLM_Offensive_Security_LLM_Q6_K_GGUF/resolve/main/baronllm-llama3.1-v1-q6_k.gguf?download=true)
*anbeeld/Qwen3.6-27B-DFlash-gguf*
#[934 MB](https://huggingface.co/Anbeeld/Qwen3.6-27B-DFlash-GGUF/resolve/main/Qwen3.6-27B-DFlash-IQ4_XS.gguf?download=true)
#[1.03 GB](https://huggingface.co/Anbeeld/Qwen3.6-27B-DFlash-GGUF/resolve/main/Qwen3.6-27B-DFlash-Q4_K_M.gguf?download=true)
#[1.23 GB](https://huggingface.co/Anbeeld/Qwen3.6-27B-DFlash-GGUF/resolve/main/Qwen3.6-27B-DFlash-Q5_K_M.gguf?download=true)
#[1.43 GB](https://huggingface.co/Anbeeld/Qwen3.6-27B-DFlash-GGUF/resolve/main/Qwen3.6-27B-DFlash-Q6_K.gguf?download=true)
#[1.85 GB](https://huggingface.co/Anbeeld/Qwen3.6-27B-DFlash-GGUF/resolve/main/Qwen3.6-27B-DFlash-Q8_0.gguf?download=true)
#[3.47 GB](https://huggingface.co/Anbeeld/Qwen3.6-27B-DFlash-GGUF/resolve/main/Qwen3.6-27B-DFlash-bf16.gguf?download=true)
*andycurrent/Gemma-3-1B-it-GLM-4.7-Flash-Heretic-Uncensored-Thinking_GGUF*
#[2.01 GB](https://huggingface.co/Andycurrent/Gemma-3-1B-it-GLM-4.7-Flash-Heretic-Uncensored-Thinking_GGUF/resolve/main/Gemma-3-1B-it-GLM-4.7-Flash-Heretic-Uncensored-Thinking_F16.gguf?download=true)
#[690 MB](https://huggingface.co/Andycurrent/Gemma-3-1B-it-GLM-4.7-Flash-Heretic-Uncensored-Thinking_GGUF/resolve/main/Gemma-3-1B-it-GLM-4.7-Flash-Heretic-Uncensored-Thinking_Q2_k.gguf?download=true)
#[722 MB](https://huggingface.co/Andycurrent/Gemma-3-1B-it-GLM-4.7-Flash-Heretic-Uncensored-Thinking_GGUF/resolve/main/Gemma-3-1B-it-GLM-4.7-Flash-Heretic-Uncensored-Thinking_Q3_k_m.gguf?download=true)
#[806 MB](https://huggingface.co/Andycurrent/Gemma-3-1B-it-GLM-4.7-Flash-Heretic-Uncensored-Thinking_GGUF/resolve/main/Gemma-3-1B-it-GLM-4.7-Flash-Heretic-Uncensored-Thinking_Q4_k_m.gguf?download=true)
#[851 MB](https://huggingface.co/Andycurrent/Gemma-3-1B-it-GLM-4.7-Flash-Heretic-Uncensored-Thinking_GGUF/resolve/main/Gemma-3-1B-it-GLM-4.7-Flash-Heretic-Uncensored-Thinking_Q5_k_m.gguf?download=true)
#[1.1 GB](https://huggingface.co/Andycurrent/Gemma-3-1B-it-GLM-4.7-Flash-Heretic-Uncensored-Thinking_GGUF/resolve/main/Gemma-3-1B-it-GLM-4.7-Flash-Heretic-Uncensored-Thinking_Q6_k.gguf?download=true)
#[1.07 GB](https://huggingface.co/Andycurrent/Gemma-3-1B-it-GLM-4.7-Flash-Heretic-Uncensored-Thinking_GGUF/resolve/main/Gemma-3-1B-it-GLM-4.7-Flash-Heretic-Uncensored-Thinking_Q8_0.gguf?download=true)
*andycurrent/Qwen3-0.6B-heretic-abliterated-uncensored-gguf*
#[383 MB](https://huggingface.co/Andycurrent/Qwen3-0.6B-heretic-abliterated-uncensored-GGUF/resolve/main/Qwen3-0.6B-heretic-abliterated-uncensored_IQ4_NL.gguf?download=true)
#[296 MB](https://huggingface.co/Andycurrent/Qwen3-0.6B-heretic-abliterated-uncensored-GGUF/resolve/main/Qwen3-0.6B-heretic-abliterated-uncensored_Q2_K.gguf?download=true)
#[347 MB](https://huggingface.co/Andycurrent/Qwen3-0.6B-heretic-abliterated-uncensored-GGUF/resolve/main/Qwen3-0.6B-heretic-abliterated-uncensored_Q3_k_m.gguf?download=true)
#[397 MB](https://huggingface.co/Andycurrent/Qwen3-0.6B-heretic-abliterated-uncensored-GGUF/resolve/main/Qwen3-0.6B-heretic-abliterated-uncensored_Q4_k_m.gguf?download=true)
#[444 MB](https://huggingface.co/Andycurrent/Qwen3-0.6B-heretic-abliterated-uncensored-GGUF/resolve/main/Qwen3-0.6B-heretic-abliterated-uncensored_Q5_k_m.gguf?download=true)
#[495 MB](https://huggingface.co/Andycurrent/Qwen3-0.6B-heretic-abliterated-uncensored-GGUF/resolve/main/Qwen3-0.6B-heretic-abliterated-uncensored_Q6_K.gguf?download=true)
#[639 MB](https://huggingface.co/Andycurrent/Qwen3-0.6B-heretic-abliterated-uncensored-GGUF/resolve/main/Qwen3-0.6B-heretic-abliterated-uncensored_Q8_0.gguf?download=true)
#[1.2 GB](https://huggingface.co/Andycurrent/Qwen3-0.6B-heretic-abliterated-uncensored-GGUF/resolve/main/Qwen3-0.6B-heretic-abliterated-uncensored_fp16.gguf?download=true)
*angelSlim/Hy-MT1.5-1.8B-2bit-gguf*
#[601 MB](https://huggingface.co/AngelSlim/Hy-MT1.5-1.8B-2bit-GGUF/resolve/main/Hy-MT1.5-1.8B-2bit.gguf?download=true)
*nilrajShinde321/Mistral-7B-Instruct-v0.1-gguf*
#[724 KB](https://huggingface.co/AnilrajShinde321/Mistral-7B-Instruct-v0.1-GGUF/resolve/main/ggml-vocab-llama.gguf?download=true)
*nilrajShinde321/Mistral-7B-Instruct1-gguf*
#[493 KB](https://huggingface.co/AnilrajShinde321/Mistral-7B-Instruct1-GGUF/resolve/main/tokenizer.model?download=true)
*nilrajShinde321/TinyLlama-1.1B-Chat-v0.3-gguf*
#[668 MB](https://huggingface.co/AnilrajShinde321/TinyLlama-1.1B-Chat-v0.3-GGUF/resolve/main/TinyLlama-1.1B-Chat-v0.3.Q4_K.gguf?download=true)
*ntonini01/physicist-Mistral*
#[4.37 GB](https://huggingface.co/Antonini01/physicist-Mistral/resolve/main/physicist-Mistral-unsloth.Q4_K_M.gguf?download=true)
*ardenzard/Qwen3.6-27B-DFlash-gguf*
#[3.47 GB](https://huggingface.co/Ardenzard/Qwen3.6-27B-DFlash-GGUF/resolve/main/Qwen3.6-27B-DFlash-F16.gguf?download=true)
#[988 MB](https://huggingface.co/Ardenzard/Qwen3.6-27B-DFlash-GGUF/resolve/main/Qwen3.6-27B-DFlash-IQ4_NL.gguf?download=true)
#[934 MB](https://huggingface.co/Ardenzard/Qwen3.6-27B-DFlash-GGUF/resolve/main/Qwen3.6-27B-DFlash-IQ4_XS.gguf?download=true)
#[1.03 GB](https://huggingface.co/Ardenzard/Qwen3.6-27B-DFlash-GGUF/resolve/main/Qwen3.6-27B-DFlash-Q4_K_M.gguf?download=true)
#[1.23 GB](https://huggingface.co/Ardenzard/Qwen3.6-27B-DFlash-GGUF/resolve/main/Qwen3.6-27B-DFlash-Q5_K_M.gguf?download=true)
#[1.43 GB](https://huggingface.co/Ardenzard/Qwen3.6-27B-DFlash-GGUF/resolve/main/Qwen3.6-27B-DFlash-Q6_K.gguf?download=true)
#[1.85 GB](https://huggingface.co/Ardenzard/Qwen3.6-27B-DFlash-GGUF/resolve/main/Qwen3.6-27B-DFlash-Q8_0.gguf?download=true)
*arliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.1-gguf*
#[4.79 GB](https://huggingface.co/ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.1-GGUF/resolve/main/ArliAI-RPMax-12B-v1.1-Q2_K.gguf?download=true)
#[6.65 GB](https://huggingface.co/ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.1-GGUF/resolve/main/ArliAI-RPMax-12B-v1.1-Q3_K_L.gguf?download=true)
#[6.08 GB](https://huggingface.co/ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.1-GGUF/resolve/main/ArliAI-RPMax-12B-v1.1-Q3_K_M.gguf?download=true)
#[5.53 GB](https://huggingface.co/ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.1-GGUF/resolve/main/ArliAI-RPMax-12B-v1.1-Q3_K_S.gguf?download=true)
#[7.48 GB](https://huggingface.co/ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.1-GGUF/resolve/main/ArliAI-RPMax-12B-v1.1-Q4_K_M.gguf?download=true)
#[7.12 GB](https://huggingface.co/ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.1-GGUF/resolve/main/ArliAI-RPMax-12B-v1.1-Q4_K_S.gguf?download=true)
#[8.73 GB](https://huggingface.co/ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.1-GGUF/resolve/main/ArliAI-RPMax-12B-v1.1-Q5_K_M.gguf?download=true)
#[8.52 GB](https://huggingface.co/ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.1-GGUF/resolve/main/ArliAI-RPMax-12B-v1.1-Q5_K_S.gguf?download=true)
#[10.1 GB](https://huggingface.co/ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.1-GGUF/resolve/main/ArliAI-RPMax-12B-v1.1-Q6_K.gguf?download=true)
#[24.5 GB](https://huggingface.co/ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.1-GGUF/resolve/main/ArliAI-RPMax-12B-v1.1-fp16.gguf?download=true)
#[13 GB](https://huggingface.co/ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.1-GGUF/resolve/main/ArliAI-RPMax-12B-v1.1-q8_0.gguf?download=true)
*aryanne/Basilisk-4B-gguf*
#[1.49 GB](https://huggingface.co/Aryanne/Basilisk-4B-gguf/resolve/main/019ba1dcd0-q2_k-basilisk-4b.gguf?download=true)
#[2 GB](https://huggingface.co/Aryanne/Basilisk-4B-gguf/resolve/main/019ba1dcd0-q4_0-basilisk-4b.gguf?download=true)
#[2.43 GB](https://huggingface.co/Aryanne/Basilisk-4B-gguf/resolve/main/019ba1dcd0-q5_0-basilisk-4b.gguf?download=true)
#[1.49 GB](https://huggingface.co/Aryanne/Basilisk-4B-gguf/resolve/main/q2_k-basilisk-4B.gguf?download=true)
#[2 GB](https://huggingface.co/Aryanne/Basilisk-4B-gguf/resolve/main/q4_0-basilisk-4B.gguf?download=true)
#[2.13 GB](https://huggingface.co/Aryanne/Basilisk-4B-gguf/resolve/main/q4_k_m-basilisk-4B.gguf?download=true)
#[2.43 GB](https://huggingface.co/Aryanne/Basilisk-4B-gguf/resolve/main/q5_0-basilisk-4B.gguf?download=true)
*aryanne/Bean-3B-ggml-and-gguf*
#[1.93 GB](https://huggingface.co/Aryanne/Bean-3B-ggml-and-gguf/resolve/main/bean-3B-ggml-q4_0.bin?download=true)
#[1.98 GB](https://huggingface.co/Aryanne/Bean-3B-ggml-and-gguf/resolve/main/bean-3B-ggufv2-q4_0.gguf?download=true)
*aryanne/Bling-Sheared-Llama-1.3B-0.1-gguf*
#[2.69 GB](https://huggingface.co/Aryanne/Bling-Sheared-Llama-1.3B-0.1-gguf/resolve/main/f16-bling-sheared-llama-1.3b-0.1.gguf?download=true)
#[775 MB](https://huggingface.co/Aryanne/Bling-Sheared-Llama-1.3B-0.1-gguf/resolve/main/q4_0-bling-sheared-llama-1.3b-0.1.gguf?download=true)
#[1.01 GB](https://huggingface.co/Aryanne/Bling-Sheared-Llama-1.3B-0.1-gguf/resolve/main/q5_1-bling-sheared-llama-1.3b-0.1.gguf?download=true)
#[1.43 GB](https://huggingface.co/Aryanne/Bling-Sheared-Llama-1.3B-0.1-gguf/resolve/main/q8_0-bling-sheared-llama-1.3b-0.1.gguf?download=true)
*aryanne/Bling-Sheared-Llama-2.7B-0.1-gguf*
#[1.54 GB](https://huggingface.co/Aryanne/Bling-Sheared-Llama-2.7B-0.1-gguf/resolve/main/q4_0-bling-sheared-llama-2.7b-0.1.gguf?download=true)
#[1.71 GB](https://huggingface.co/Aryanne/Bling-Sheared-Llama-2.7B-0.1-gguf/resolve/main/q4_1-bling-sheared-llama-2.7b-0.1.gguf?download=true)
#[2.03 GB](https://huggingface.co/Aryanne/Bling-Sheared-Llama-2.7B-0.1-gguf/resolve/main/q5_1-bling-sheared-llama-2.7b-0.1.gguf?download=true)
#[2.87 GB](https://huggingface.co/Aryanne/Bling-Sheared-Llama-2.7B-0.1-gguf/resolve/main/q8_0-bling-sheared-llama-2.7b-0.1.gguf?download=true)
*aryanne/Calypso-3B-alpha-v2-gguf*
#[1.98 GB](https://huggingface.co/Aryanne/Calypso-3B-alpha-v2-gguf/resolve/main/q4_0-calypso-alpha-v2.gguf?download=true)
#[2.19 GB](https://huggingface.co/Aryanne/Calypso-3B-alpha-v2-gguf/resolve/main/q4_1-calypso-alpha-v2.gguf?download=true)
#[2.4 GB](https://huggingface.co/Aryanne/Calypso-3B-alpha-v2-gguf/resolve/main/q5_0-calypso-alpha-v2.gguf?download=true)
*aryanne/Deacon-3B-gguf*
#[1.98 GB](https://huggingface.co/Aryanne/Deacon-3B-gguf/resolve/main/q4_0-deacon-3b.gguf?download=true)
#[2.19 GB](https://huggingface.co/Aryanne/Deacon-3B-gguf/resolve/main/q4_1-deacon-3b.gguf?download=true)
#[2.4 GB](https://huggingface.co/Aryanne/Deacon-3B-gguf/resolve/main/q5_0-deacon-3b.gguf?download=true)
*aryanne/Flan-Open-Llama-3B-gguf*
#[1.98 GB](https://huggingface.co/Aryanne/Flan-Open-Llama-3B-gguf/resolve/main/q4_0-flan-open-llama-3b.gguf?download=true)
#[2.19 GB](https://huggingface.co/Aryanne/Flan-Open-Llama-3B-gguf/resolve/main/q4_1-flan-open-llama-3b.gguf?download=true)
#[2.4 GB](https://huggingface.co/Aryanne/Flan-Open-Llama-3B-gguf/resolve/main/q5_0-flan-open-llama-3b.gguf?download=true)
*aryanne/Llama-2-4B-gguf*
#[1.49 GB](https://huggingface.co/Aryanne/Llama-2-4B-gguf/resolve/main/q2_k-llama-2-4b.gguf?download=true)
#[2 GB](https://huggingface.co/Aryanne/Llama-2-4B-gguf/resolve/main/q4_0-llama-2-4b.gguf?download=true)
#[2.43 GB](https://huggingface.co/Aryanne/Llama-2-4B-gguf/resolve/main/q5_0-llama-2-4b.gguf?download=true)
*aryanne/Mamba-gpt-3B-v4-ggml-and-gguf*
#[1.93 GB](https://huggingface.co/Aryanne/Mamba-gpt-3B-v4-ggml-and-gguf/resolve/main/q4_0-ggml-mamba-gpt-3B_v4.bin?download=true)
#[1.98 GB](https://huggingface.co/Aryanne/Mamba-gpt-3B-v4-ggml-and-gguf/resolve/main/q4_0-gguf-mamba-gpt-3B_v4.gguf?download=true)
#[2.14 GB](https://huggingface.co/Aryanne/Mamba-gpt-3B-v4-ggml-and-gguf/resolve/main/q4_1-ggml-mamba-gpt-3B_v4.bin?download=true)
#[2.19 GB](https://huggingface.co/Aryanne/Mamba-gpt-3B-v4-ggml-and-gguf/resolve/main/q4_1-gguf-mamba-gpt-3B_v4.gguf?download=true)
#[2.36 GB](https://huggingface.co/Aryanne/Mamba-gpt-3B-v4-ggml-and-gguf/resolve/main/q5_0-ggml-mamba-gpt-3B_v4.bin?download=true)
#[2.4 GB](https://huggingface.co/Aryanne/Mamba-gpt-3B-v4-ggml-and-gguf/resolve/main/q5_0-gguf-mamba-gpt-3B_v4.gguf?download=true)
#[2.57 GB](https://huggingface.co/Aryanne/Mamba-gpt-3B-v4-ggml-and-gguf/resolve/main/q5_1-ggml-mamba-gpt-3B_v4.bin?download=true)
#[2.6 GB](https://huggingface.co/Aryanne/Mamba-gpt-3B-v4-ggml-and-gguf/resolve/main/q5_1-gguf-mamba-gpt-3B_v4.gguf?download=true)
*aryanne/OmegLLaMA-3B-ggml-and-gguf*
#[1.98 GB](https://huggingface.co/Aryanne/OmegLLaMA-3B-ggml-and-gguf/resolve/main/OmegLLaMA-3B-ggufv2-q4_0.gguf?download=true)
*aryanne/Open-LLongMA-3B-gguf*
#[1.98 GB](https://huggingface.co/Aryanne/Open-LLongMA-3B-gguf/resolve/main/q4_0-open-llongma-3b.gguf?download=true)
#[2.19 GB](https://huggingface.co/Aryanne/Open-LLongMA-3B-gguf/resolve/main/q4_1-open-llongma-3b.gguf?download=true)
#[2.4 GB](https://huggingface.co/Aryanne/Open-LLongMA-3B-gguf/resolve/main/q5_0-open-llongma-3b.gguf?download=true)
*aryanne/OpenLlama-3B-v2-WizardEvol-Instruct-v2-gguf*
#[1.98 GB](https://huggingface.co/Aryanne/OpenLlama-3B-v2-WizardEvol-Instruct-v2-gguf/resolve/main/q4_0-openllama-3b-WizardEvol-v2.gguf?download=true)
#[2.19 GB](https://huggingface.co/Aryanne/OpenLlama-3B-v2-WizardEvol-Instruct-v2-gguf/resolve/main/q4_1-openllama-3b-WizardEvol-v2.gguf?download=true)
#[2.4 GB](https://huggingface.co/Aryanne/OpenLlama-3B-v2-WizardEvol-Instruct-v2-gguf/resolve/main/q5_0-openllama-3b-WizardEvol-v2.gguf?download=true)
#[2.6 GB](https://huggingface.co/Aryanne/OpenLlama-3B-v2-WizardEvol-Instruct-v2-gguf/resolve/main/q5_1-openllama-3b-WizardEvol-v2.gguf?download=true)
*aryanne/OpenLlama-Platypus-3B-gguf*
#[1.98 GB](https://huggingface.co/Aryanne/OpenLlama-Platypus-3B-gguf/resolve/main/q4_0-openllama-platypus-3b.gguf?download=true)
#[2.19 GB](https://huggingface.co/Aryanne/OpenLlama-Platypus-3B-gguf/resolve/main/q4_1-openllama-platypus-3b.gguf?download=true)
#[2.4 GB](https://huggingface.co/Aryanne/OpenLlama-Platypus-3B-gguf/resolve/main/q5_0-openllama-platypus-3b.gguf?download=true)
#[2.6 GB](https://huggingface.co/Aryanne/OpenLlama-Platypus-3B-gguf/resolve/main/q5_1-openllama-platypus-3b.gguf?download=true)
*aryanne/Orca-Mini-3B-gguf*
#[1.98 GB](https://huggingface.co/Aryanne/Orca-Mini-3B-gguf/resolve/main/q4_0-orca-mini-3b.gguf?download=true)
#[2.19 GB](https://huggingface.co/Aryanne/Orca-Mini-3B-gguf/resolve/main/q4_1-orca-mini-3b.gguf?download=true)
#[2.4 GB](https://huggingface.co/Aryanne/Orca-Mini-3B-gguf/resolve/main/q5_0-orca-mini-3b.gguf?download=true)
*aryanne/Sheared-LLaMA-1.3B-gguf*
#[2.69 GB](https://huggingface.co/Aryanne/Sheared-LLaMA-1.3B-gguf/resolve/main/f16-sheared-llama-1.3b.gguf?download=true)
#[775 MB](https://huggingface.co/Aryanne/Sheared-LLaMA-1.3B-gguf/resolve/main/q4_0-sheared-llama-1.3b.gguf?download=true)
#[1.81 GB](https://huggingface.co/Aryanne/Sheared-LLaMA-1.3B-gguf/resolve/main/q5_1-sheared-llama-1.3b.gguf?download=true)
#[1.43 GB](https://huggingface.co/Aryanne/Sheared-LLaMA-1.3B-gguf/resolve/main/q8_0-sheared-llama-1.3b.gguf?download=true)
*aryanne/Sheared-LLaMA-2.7B-gguf*
#[1.14 GB](https://huggingface.co/Aryanne/Sheared-LLaMA-2.7B-gguf/resolve/main/q2_k-sheared-llama-2.7b.gguf?download=true)
#[1.54 GB](https://huggingface.co/Aryanne/Sheared-LLaMA-2.7B-gguf/resolve/main/q4_0-sheared-llama-2.7b.gguf?download=true)
#[1.71 GB](https://huggingface.co/Aryanne/Sheared-LLaMA-2.7B-gguf/resolve/main/q4_1-sheared-llama-2.7b.gguf?download=true)
#[1.92 GB](https://huggingface.co/Aryanne/Sheared-LLaMA-2.7B-gguf/resolve/main/q5_k_m-sheared-llama-2.7b.gguf?download=true)
*aryanne/ShortKing-3B-v0.2-gguf*
#[1.98 GB](https://huggingface.co/Aryanne/ShortKing-3B-v0.2-gguf/resolve/main/q4_0-shortking-3b-v0.2.gguf?download=true)
#[2.19 GB](https://huggingface.co/Aryanne/ShortKing-3B-v0.2-gguf/resolve/main/q4_1-shortking-3b-v0.2.gguf?download=true)
#[2.4 GB](https://huggingface.co/Aryanne/ShortKing-3B-v0.2-gguf/resolve/main/q5_0-shortking-3b-v0.2.gguf?download=true)
#[2.6 GB](https://huggingface.co/Aryanne/ShortKing-3B-v0.2-gguf/resolve/main/q5_1-shortking-3b-v0.2.gguf?download=true)
*aryanne/TinyLlama-1.1B-1T-OpenOrca-gguf*
#[2.2 GB](https://huggingface.co/Aryanne/TinyLlama-1.1B-1T-OpenOrca-gguf/resolve/main/f16-tinyllama-1.1b-1t-openorca.gguf?download=true)
#[482 MB](https://huggingface.co/Aryanne/TinyLlama-1.1B-1T-OpenOrca-gguf/resolve/main/q2_k-tinyllama-1.1b-1t-openorca.gguf?download=true)
#[637 MB](https://huggingface.co/Aryanne/TinyLlama-1.1B-1T-OpenOrca-gguf/resolve/main/q4_0-tinyllama-1.1b-1t-openorca.gguf?download=true)
#[903 MB](https://huggingface.co/Aryanne/TinyLlama-1.1B-1T-OpenOrca-gguf/resolve/main/q6_k-tinyllama-1.1b-1t-openorca.gguf?download=true)
#[1.17 GB](https://huggingface.co/Aryanne/TinyLlama-1.1B-1T-OpenOrca-gguf/resolve/main/q8_0-tinyllama-1.1b-1t-openorca.gguf?download=true)
*aryanne/TinyLlama-1.1B-Chat-v0.2-gguf*
#[2.12 GB](https://huggingface.co/Aryanne/TinyLlama-1.1B-Chat-v0.2-gguf/resolve/main/f16-tinyllama-chat-1.1b-v0.2.gguf?download=true)
#[482 MB](https://huggingface.co/Aryanne/TinyLlama-1.1B-Chat-v0.2-gguf/resolve/main/q2_k-tinyllama-chat-1.1b-v0.2.gguf?download=true)
#[1.17 GB](https://huggingface.co/Aryanne/TinyLlama-1.1B-Chat-v0.2-gguf/resolve/main/q8_0-tinyllama-chat-1.1b-v0.2.gguf?download=true)
*aryanne/TinyLlama-1.1B-Chat-v0.3-gguf*
#[2.2 GB](https://huggingface.co/Aryanne/TinyLlama-1.1B-Chat-v0.3-gguf/resolve/main/f16-tinyllama-1.1b-chat-v0.3.gguf?download=true)
#[482 MB](https://huggingface.co/Aryanne/TinyLlama-1.1B-Chat-v0.3-gguf/resolve/main/q2_k-tinyllama-1.1b-chat-v0.3.gguf?download=true)
#[637 MB](https://huggingface.co/Aryanne/TinyLlama-1.1B-Chat-v0.3-gguf/resolve/main/q4_0-tinyllama-1.1b-chat-v0.3.gguf?download=true)
#[766 MB](https://huggingface.co/Aryanne/TinyLlama-1.1B-Chat-v0.3-gguf/resolve/main/q5_0-tinyllama-1.1b-chat-v0.3.gguf?download=true)
#[903 MB](https://huggingface.co/Aryanne/TinyLlama-1.1B-Chat-v0.3-gguf/resolve/main/q6_k-tinyllama-1.1b-chat-v0.3.gguf?download=true)
#[1.17 GB](https://huggingface.co/Aryanne/TinyLlama-1.1B-Chat-v0.3-gguf/resolve/main/q8_0-tinyllama-1.1b-chat-v0.3.gguf?download=true)
*aryanne/TinyLlama-1.1B-step-480K-1007B-gguf*
#[2.2 GB](https://huggingface.co/Aryanne/TinyLlama-1.1B-step-480K-1007B-gguf/resolve/main/f16-tinyllama-1.1b-1t.gguf?download=true)
#[482 MB](https://huggingface.co/Aryanne/TinyLlama-1.1B-step-480K-1007B-gguf/resolve/main/q2_k-tinyllama-1.1b-1t.gguf?download=true)
#[637 MB](https://huggingface.co/Aryanne/TinyLlama-1.1B-step-480K-1007B-gguf/resolve/main/q4_0-tinyllama-1.1b-1t.gguf?download=true)
#[701 MB](https://huggingface.co/Aryanne/TinyLlama-1.1B-step-480K-1007B-gguf/resolve/main/q4_1-tinyllama-1.1b-1t.gguf?download=true)
#[766 MB](https://huggingface.co/Aryanne/TinyLlama-1.1B-step-480K-1007B-gguf/resolve/main/q5_0-tinyllama-1.1b-1t.gguf?download=true)
#[831 MB](https://huggingface.co/Aryanne/TinyLlama-1.1B-step-480K-1007B-gguf/resolve/main/q5_1-tinyllama-1.1b-1t.gguf?download=true)
#[1.17 GB](https://huggingface.co/Aryanne/TinyLlama-1.1B-step-480K-1007B-gguf/resolve/main/q8_0-tinyllama-1.1b-1t.gguf?download=true)
*aryanne/TinyLlama-1.1B-step-720K-1510B-gguf*
#[482 MB](https://huggingface.co/Aryanne/TinyLlama-1.1B-step-720K-1510B-gguf/resolve/main/q2_k-tinyllama-1.1b-1.5t.gguf?download=true)
#[637 MB](https://huggingface.co/Aryanne/TinyLlama-1.1B-step-720K-1510B-gguf/resolve/main/q4_0-tinyllama-1.1b-1.5t.gguf?download=true)
#[903 MB](https://huggingface.co/Aryanne/TinyLlama-1.1B-step-720K-1510B-gguf/resolve/main/q6_k-tinyllama-1.1b-1.5t.gguf?download=true)
#[1.17 GB](https://huggingface.co/Aryanne/TinyLlama-1.1B-step-720K-1510B-gguf/resolve/main/q8_0-tinyllama-1.1b-1.5t.gguf?download=true)
*aryanne/Wizard-Orca-3B-gguf*
#[1.98 GB](https://huggingface.co/Aryanne/Wizard-Orca-3B-gguf/resolve/main/q4_0-wizard-orca-3b.gguf?download=true)
#[2.19 GB](https://huggingface.co/Aryanne/Wizard-Orca-3B-gguf/resolve/main/q4_1-wizard-orca-3b.gguf?download=true)
#[2.4 GB](https://huggingface.co/Aryanne/Wizard-Orca-3B-gguf/resolve/main/q5_0-wizard-orca-3b.gguf?download=true)
#[2.6 GB](https://huggingface.co/Aryanne/Wizard-Orca-3B-gguf/resolve/main/q5_1-wizard-orca-3b.gguf?download=true)
*shtonIsNotHere/CodeLlama_7B_nlp_pp*
#[7.16 GB](https://huggingface.co/AshtonIsNotHere/CodeLlama_7B_nlp_pp/resolve/main/CodeLlama_7B_nlp_pp_q8_0.gguf?download=true)
*stromNew/Dolphin-Mistral-24B-Venice-Edition-Q5_K_M-gguf*
#[16.8 GB](https://huggingface.co/AstromNew/Dolphin-Mistral-24B-Venice-Edition-Q5_K_M-GGUF/resolve/main/dolphin-mistral-24b-venice-edition-q5_k_m.gguf?download=true)
*asystemoffields/Huihui-Qwen3.5-4B-Abliterated-PMRA-gguf*
#[2.01 GB](https://huggingface.co/Asystemoffields/Huihui-Qwen3.5-4B-Abliterated-PMRA-GGUF/resolve/main/huihui_qwen35_4b_abliterated_pmra_calib_weight_blend.gguf?download=true)
*atomicChat/Qwen3.6-27B-UDT-MTP-gguf*
#[16.8 GB](https://huggingface.co/AtomicChat/Qwen3.6-27B-UDT-MTP-GGUF/resolve/main/Qwen3.6-27B-UDT-Q3_K_XL_MTP.gguf?download=true)
#[19.1 GB](https://huggingface.co/AtomicChat/Qwen3.6-27B-UDT-MTP-GGUF/resolve/main/Qwen3.6-27B-UDT-Q4_K_XL_MTP.gguf?download=true)
#[21.1 GB](https://huggingface.co/AtomicChat/Qwen3.6-27B-UDT-MTP-GGUF/resolve/main/Qwen3.6-27B-UDT-Q5_K_XL_MTP.gguf?download=true)
#[23.2 GB](https://huggingface.co/AtomicChat/Qwen3.6-27B-UDT-MTP-GGUF/resolve/main/Qwen3.6-27B-UDT-Q6_K_MTP.gguf?download=true)
#[27.3 GB](https://huggingface.co/AtomicChat/Qwen3.6-27B-UDT-MTP-GGUF/resolve/main/Qwen3.6-27B-UDT-Q8_K_XL_MTP.gguf?download=true)
#[931 MB](https://huggingface.co/AtomicChat/Qwen3.6-27B-UDT-MTP-GGUF/resolve/main/mmproj-BF16.gguf?download=true)
#[928 MB](https://huggingface.co/AtomicChat/Qwen3.6-27B-UDT-MTP-GGUF/resolve/main/mmproj-F16.gguf?download=true)
*atomicChat/gemma-4-26B-A4B-it-assistant-gguf*
#[855 MB](https://huggingface.co/AtomicChat/gemma-4-26B-A4B-it-assistant-GGUF/resolve/main/gemma-4-26B-A4B-it-assistant.F16.gguf?download=true)
#[325 MB](https://huggingface.co/AtomicChat/gemma-4-26B-A4B-it-assistant-GGUF/resolve/main/gemma-4-26B-A4B-it-assistant.Q4_K_M.gguf?download=true)
#[312 MB](https://huggingface.co/AtomicChat/gemma-4-26B-A4B-it-assistant-GGUF/resolve/main/gemma-4-26B-A4B-it-assistant.Q4_K_S.gguf?download=true)
#[342 MB](https://huggingface.co/AtomicChat/gemma-4-26B-A4B-it-assistant-GGUF/resolve/main/gemma-4-26B-A4B-it-assistant.Q5_K_M.gguf?download=true)
#[462 MB](https://huggingface.co/AtomicChat/gemma-4-26B-A4B-it-assistant-GGUF/resolve/main/gemma-4-26B-A4B-it-assistant.Q8_0.gguf?download=true)
*atomicChat/gemma-4-31B-it-assistant-gguf*
#[955 MB](https://huggingface.co/AtomicChat/gemma-4-31B-it-assistant-GGUF/resolve/main/gemma-4-31B-it-assistant.F16.gguf?download=true)
#[353 MB](https://huggingface.co/AtomicChat/gemma-4-31B-it-assistant-GGUF/resolve/main/gemma-4-31B-it-assistant.Q4_K_M.gguf?download=true)
#[349 MB](https://huggingface.co/AtomicChat/gemma-4-31B-it-assistant-GGUF/resolve/main/gemma-4-31B-it-assistant.Q4_K_S.gguf?download=true)
#[377 MB](https://huggingface.co/AtomicChat/gemma-4-31B-it-assistant-GGUF/resolve/main/gemma-4-31B-it-assistant.Q5_K_M.gguf?download=true)
#[515 MB](https://huggingface.co/AtomicChat/gemma-4-31B-it-assistant-GGUF/resolve/main/gemma-4-31B-it-assistant.Q8_0.gguf?download=true)
*atomicChat/gemma-4-E2B-it-assistant-gguf*
#[172 MB](https://huggingface.co/AtomicChat/gemma-4-E2B-it-assistant-GGUF/resolve/main/gemma-4-E2B-it-assistant.F16.gguf?download=true)
#[78.1 MB](https://huggingface.co/AtomicChat/gemma-4-E2B-it-assistant-GGUF/resolve/main/gemma-4-E2B-it-assistant.Q4_K_M.gguf?download=true)
#[77.9 MB](https://huggingface.co/AtomicChat/gemma-4-E2B-it-assistant-GGUF/resolve/main/gemma-4-E2B-it-assistant.Q4_K_S.gguf?download=true)
#[79.3 MB](https://huggingface.co/AtomicChat/gemma-4-E2B-it-assistant-GGUF/resolve/main/gemma-4-E2B-it-assistant.Q5_K_M.gguf?download=true)
#[99.4 MB](https://huggingface.co/AtomicChat/gemma-4-E2B-it-assistant-GGUF/resolve/main/gemma-4-E2B-it-assistant.Q8_0.gguf?download=true)
*atomicChat/gemma-4-E4B-it-assistant-gguf*
#[174 MB](https://huggingface.co/AtomicChat/gemma-4-E4B-it-assistant-GGUF/resolve/main/gemma-4-E4B-it-assistant.F16.gguf?download=true)
#[78.6 MB](https://huggingface.co/AtomicChat/gemma-4-E4B-it-assistant-GGUF/resolve/main/gemma-4-E4B-it-assistant.Q4_K_M.gguf?download=true)
#[78.3 MB](https://huggingface.co/AtomicChat/gemma-4-E4B-it-assistant-GGUF/resolve/main/gemma-4-E4B-it-assistant.Q4_K_S.gguf?download=true)
#[79.9 MB](https://huggingface.co/AtomicChat/gemma-4-E4B-it-assistant-GGUF/resolve/main/gemma-4-E4B-it-assistant.Q5_K_M.gguf?download=true)
#[100 MB](https://huggingface.co/AtomicChat/gemma-4-E4B-it-assistant-GGUF/resolve/main/gemma-4-E4B-it-assistant.Q8_0.gguf?download=true)
*yodele01/gemma-4-E4B-Gemini-3.1-Pro-Reasoning-Distill-gguf*
#[15.1 GB](https://huggingface.co/Ayodele01/gemma-4-E4B-Gemini-3.1-Pro-Reasoning-Distill-GGUF/resolve/main/gemma-4-E4B-Gemini-3.1-Pro-Reasoning-Distill-F16.gguf?download=true)
#[4.85 GB](https://huggingface.co/Ayodele01/gemma-4-E4B-Gemini-3.1-Pro-Reasoning-Distill-GGUF/resolve/main/gemma-4-E4B-Gemini-3.1-Pro-Reasoning-Distill-Q3_K_M.gguf?download=true)
#[5.34 GB](https://huggingface.co/Ayodele01/gemma-4-E4B-Gemini-3.1-Pro-Reasoning-Distill-GGUF/resolve/main/gemma-4-E4B-Gemini-3.1-Pro-Reasoning-Distill-Q4_K_M.gguf?download=true)
#[5.76 GB](https://huggingface.co/Ayodele01/gemma-4-E4B-Gemini-3.1-Pro-Reasoning-Distill-GGUF/resolve/main/gemma-4-E4B-Gemini-3.1-Pro-Reasoning-Distill-Q5_K_M.gguf?download=true)
#[8.01 GB](https://huggingface.co/Ayodele01/gemma-4-E4B-Gemini-3.1-Pro-Reasoning-Distill-GGUF/resolve/main/gemma-4-E4B-Gemini-3.1-Pro-Reasoning-Distill-Q8_0.gguf?download=true)
*aznor/llama-2-chat-13b-q4_0*
#[7.37 GB](https://huggingface.co/Aznor/llama-2-chat-13b-q4_0/resolve/main/ggml-model-q4_0.gguf?download=true)
*znor/llama-2-chat-13b-q5_0*
#[8.97 GB](https://huggingface.co/Aznor/llama-2-chat-13b-q5_0/resolve/main/ggml-model-q5_0.gguf?download=true)
*znor/llama-2-chat-7b-q4_0*
#[3.83 GB](https://huggingface.co/Aznor/llama-2-chat-7b-q4_0/resolve/main/ggml-model-q4_0.gguf?download=true)