radix
CCConvex Community
•Created by Mugi on 5/6/2025 in #show-and-tell
Qwisine14B: FINAL Evaluation of a Fine-Tuned Model on Convex
Q4_K would bring it down to 7 GB with acceptable performance, Q3_0 to ~5.6 GB but quality would be a bit lower
66 replies
CCConvex Community
•Created by Mugi on 5/6/2025 in #show-and-tell
Qwisine14B: FINAL Evaluation of a Fine-Tuned Model on Convex
If you quantize with ollama I think you can make it fit
66 replies
CCConvex Community
•Created by Viscision on 4/17/2025 in #support-community
Auth Provider Discovery Failed
so you can use either, it was because both were using older versions of convex
25 replies
CCConvex Community
•Created by Viscision on 4/17/2025 in #support-community
Auth Provider Discovery Failed
they merged
25 replies
CCConvex Community
•Created by Viscision on 4/17/2025 in #support-community
Auth Provider Discovery Failed
I sent a patch to both coolify and dokploy
25 replies
CCConvex Community
•Created by Viscision on 4/17/2025 in #support-community
Auth Provider Discovery Failed
Actually it works now
25 replies
CCConvex Community
•Created by Mugi on 5/6/2025 in #show-and-tell
Qwisine14B: FINAL Evaluation of a Fine-Tuned Model on Convex
I just came across this while browsing the discord. If you haven't already, you could use unsloth to cut down on the training requirements (almost by half), it also has ollama and vllm exporter so the model you train could directly be used by most people (if you open-source it) or used for chef easily
66 replies