Inference Providers
Active filters: 6-bit
MaziyarPanahi/Yi-Coder-9B-Chat-GGUF
Text Generation
• 9B • Updated • 113k
• 9
lmstudio-community/Qwen3-Coder-Next-MLX-6bit
80B • Updated • 269k
• 6
Jundot/Qwen3.6-27B-oQ6-mtp
7B • Updated • 877
• 2
Jundot/Qwen3.6-27B-oQ6-fp16-mtp
7B • Updated • 690
• 2
MaziyarPanahi/Synatra-7B-v0.3-RP-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 151
• 1
MaziyarPanahi/Mixtral-8x22B-v0.1-GGUF
Text Generation
• 141B • Updated • 116k
• 77
MaziyarPanahi/Mistral-Nemo-Instruct-2407-GGUF
Text Generation
• 12B • Updated • 114k
• 52
MaziyarPanahi/gemma-3-12b-it-GGUF
Text Generation
• 12B • Updated • 113k
• 19
lmstudio-community/Hermes-4-70B-MLX-6bit
71B • Updated • 77.5k
• 1
qurk41/MiMo-VL-7B-RL-2508-mlx-6Bit
Image-Text-to-Text
• 8B • Updated • 124
• 1
mlx-community/Unslopper-30B-A3B-6bit
Text Generation
• 31B • Updated • 15
• 1
mlx-community/DeepSeek-V4-Flash-6bit
Text Generation
• 284B • Updated • 4.3k
• 1
IHateCrickets/Huihui-Qwen3.6-35B-A3B-Claude-4.7-Opus-abliterated-MLX-6bit
Image-Text-to-Text
• 8B • Updated • 1.69k
• 1
blockblockblock/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-exl3-6.0bpw
Text Generation
• 14B • Updated • 373
• 3
wangkezun/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-Text-MLX-oQ6
Text Generation
• 8B • Updated • 1.87k
• 3
mlx-community/Qwen3.6-27B-AEON-Ultimate-Uncensored-BF16-mlx-6Bit
Text Generation
• 27B • Updated • 1.83k
• 4
Tranquil-Flow/Carnice-V2-27b-MLX-6bit
Text Generation
• 27B • Updated • 250
• 1
samuelfaj/Ornstein-Hermes-3.6-27B-SABER-6bit-MTPLX-Optimized-Speed
Text Generation
• 6B • Updated • 181
• 1
deepsweet/Qwen3.6-27B-MLX-oQ6
Text Generation
• 6B • Updated • 683
• 2
sentiuminc/holler-0.6b-6bit
Text-to-Speech
• 0.5B • Updated • 131
• 1
daslab-testing/Apertus-8B-Instruct-MLX-INT6
Text Generation
• 8B • Updated • 43
• 1
numind/NuExtract3-mlx-6bits
1B • Updated • 15
• 1
inferencerlabs/Qwen3.5-122B-A10B-MLX-6.5bit
Text Generation
• 122B • Updated • 1.07k
• 5
LoneStriker/Yi-6B-200K-6.0bpw-h6-exl2
Text Generation
• Updated • 6
• 1
Text Generation
• 3B • Updated • 233
• 6
MaziyarPanahi/Tess-XS-v1-3-yarn-128K-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
• 7B • Updated • 1.21k
• 6
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
• 7B • Updated • 891
• 4
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.2-GGUF
Text Generation
• 7B • Updated • 971
• 5
MaziyarPanahi/NeuralPipe-7B-slerp-GGUF
Text Generation
• 7B • Updated • 112
• 3
MaziyarPanahi/NeuralPipe-7B-slerp-v0.2-GGUF
Text Generation
• 7B • Updated • 224
• 2