KD-LoRA accepted at NeurIPS ENLSP Workshop.