Tested on:
Qwen2.5-Coder-0.5B-Instruct-Q3_K_L.gguf (369 MB)
Clear Cached Model
Copy Output
Copy Console Log
Select a Qwen2.5 GGUF model file to start inference...
Engine Console