Comparison of Best Student Models by Metric
This report presents the best student models for each evaluation metric, comparing their performance with the teacher model. The report shows the optimal hyperparameters (model type, temperature, and alpha) for each metric.
Models were trained using knowledge distillation to transfer knowledge from a complex teacher model to simpler, more efficient student models.
Metric | Best Model Type | Temp | Alpha | Teacher Value | Student Value | Difference | Retention % |
---|---|---|---|---|---|---|---|
{{ model.display_name }}{% if model.minimize %} (lower is better){% endif %} | {{ model.model_type }} | {{ model.temperature }} | {{ model.alpha }} | {{ "%.3f"|format(model.teacher_value) if model.teacher_value is not none else 'N/A' }} | {{ "%.3f"|format(model.value) }} | {% if model.difference is defined and model.teacher_value is not none %} {% if model.minimize %} {{ "+%.3f"|format(model.difference) if model.difference > 0 else "%.3f"|format(model.difference) }} {% else %} {{ "%.3f"|format(model.difference) }} {% endif %} {% else %} N/A {% endif %} | {% if model.retention is defined and model.retention is not none %} {{ "%.1f"|format(model.retention) }}% {% else %} N/A {% endif %} |
Based on the overall performance, we recommend: