PRIVATE
ACTIVE
Research
FisherKD-Unified
Fisher Information-guided adaptive knowledge distillation framework implementing 12+ distillation methods
Python
PyTorch
Transformers
WandB