Xylight

joined 2 years ago
sorted by: new top controversial old
1
defend yourself against flock cameras with this simple trick (i.redd.it)
 
1
Qwen3 VL support merged into llama.cpp (github.com)
submitted 3 months ago* (last edited 3 months ago) by Xylight@lemdro.id to c/localllama@sh.itjust.works
0 comments fedilink
 

Benchmarks look pretty good, even better than some of the text only models, make sure to take them with a grain of salt tho

Benchmarks

Qwen3 VL 30b a3b (No Thinking)

Visual benchmarks for Qwen3 VL 235 A22B (Thinking)

1
My 8gb vram system as i try to load GLM-4.6-Q0.00001_XXXS.gguf: (media1.tenor.com)
submitted 3 months ago* (last edited 3 months ago) by Xylight@lemdro.id to c/localllama@sh.itjust.works
0 comments fedilink
 
1
Light image editing models? (lemdro.id)
 

Qwen image edit seems to be the best one available right now, but I can't run it. It would take too long on my system, especially at 40 steps.

For general image generation, Flux schnell works great and can generate on my system in about 60 seconds. I was hoping to see Flux kontext-schnell, but it doesn't exist, only kontext-dev.

1
llama.cpp now has a Sveltekit based UI (github.com)
 

It uses shadcn-svelte for nice looking components, and it should be faster than the old React-based UI.