MTP for Speculative Drafting

[momendo]

MTP is now merged in upstream llama.cpp for Qwen models. How could MTP be used to replace and possibly improve speculative drafting performance than using a separate small draft model?

[davide221]

@momendo thanks for the question! MTP will be integrated soon to use it together with DFlash,depending on the context both can be useful 💪