
▲ 48 r/LocalLLaMA
LM Studio finally added support for MTP Speculative Decoding
update to 0.4.14 Build 2 (Beta) and make sure your llama.cpp engine is 2.15.0
you also must select "Manually choose model load parameters" and enable MTP in those before loading the model it is NOT on by default
u/pigeon57434 — 3 hours ago