Distillation

Differential Neural Networks for Robust Nonlinear Control: Identification, State Estimation and Trajectory Tracking

Alexander S. Poznyak, Edgar N. Sánchez, Wen Yu

Citations: 155 • 2001

SurgiNet: Pyramid Attention Aggregation and Class-wise Self-Distillation for Surgical Instrument Segmentation

Zhen-Liang Ni, Xiao-Hu Zhou, Guan-An Wang, Wen-Qian Yue, Zhen Li, Gui‐Bin Bian, Zeng‐Guang Hou

Citations: 55 • 2021

Semi-supervised deep learning and low-cost cameras for the semantic segmentation of natural images in viticulture

Ángela Casado-García, Jónathan Heras, Annalisa Milella, Roberto Marani

Citations: 52 • 2022

Cross-modal distillation for RGB-depth person re-identification

Frank M. Hafner, Amran Bhuyian, Julian F. P. Kooij, Éric Granger

Citations: 32 • 2022

Divide and Distill: New Outlooks on Knowledge Distillation for Environmental Sound Classification

Achyut Mani Tripathi, Om Jee Pandey

Citations: 25 • 2023

Crack segmentation-guided measurement with lightweight distillation network on edge device

Jianqi Zhang, Ling Ding, Wei Wang, Hainian Wang, Ioannis Brilakis, Diana Davletshina, Rauno Heikkilä, Xu Yang

Citations: 23 • 2025

Excellent tomato detector based on pruning and distillation to balance accuracy and lightweight

Lixiang Huang, Jiqing Chen, Hongwei Li, Yang Huang, Kairong She, Kewei Hao

Citations: 22 • 2024

Edge Devices Friendly Self-Supervised Monocular Depth Estimation via Knowledge Distillation

Wei Gao, D. Rajeswara Rao, Yang Yang, Jie Chen

Citations: 20 • 2023

In Defense of Knowledge Distillation for Task Incremental Learning and Its Application in 3D Object Detection

Yun Peng, Yuxuan Liu, Ming Liu

Citations: 20 • 2021

Feature-Level Knowledge Distillation for Place Recognition Based on Soft-Hard Labels Teaching Paradigm

Zhenyu Li, Pengjie Xu, Zhenbiao Dong, Ruirui Zhang, Zhaojun Deng

Citations: 20 • 2024

A multi-scale graph pyramid attention network with knowledge distillation towards edge computing robotic fault diagnosis

Chong Chen, Tao Wang, Dong Mao, Ying Liu, Lianglun Cheng

Citations: 20 • 2024

Network lightweight method based on knowledge distillation is applied to RV reducer fault diagnosis

Feifei He, Chang Liu, Mengdi Wang, Enshan Yang, Xiaoqin Liu

Citations: 19 • 2023

Model Adaptation through Hypothesis Transfer with Gradual Knowledge Distillation

Song Tang, Yuji Shi, Zhiyuan Ma, Jian Li, Jianzhi Lyu, Qingdu Li, Jianwei Zhang

Citations: 19 • 2021

Revisiting Distillation for Continual Learning on Visual Question Localized-Answering in Robotic Surgery

Long Bai, Mobarakol Islam, Hongliang Ren

Citations: 19 • 2023

Continual Reinforcement Learning deployed in Real-life using Policy Distillation and Sim2Real Transfer

René Traoré, Hugo Caselles-Dupré, Timothée Lesort, Te Sun, Natalia Díaz-Rodríguez, David Filliat

Citations: 17 • 2019

Cyclic policy distillation: Sample-efficient sim-to-real reinforcement learning with domain randomization

Yuki Kadokawa, Lingwei Zhu, Yoshihisa Tsurumine, Takamitsu Matsubara

Citations: 16 • 2023

Underwater image super-resolution using multi-stage information distillation networks

Huan Wang, Hao Wu, Qian Hu, Jianning Chi, Xiaosheng Yu, Chengdong Wu

Citations: 16 • 2021

Cognition of grape cluster picking point based on visual knowledge distillation in complex vineyard environment

Jinhai Wang, Xuemin Lin, Lufeng Luo, Mingyou Chen, Huiling Wei, Lijia Xu, Shaoming Luo

Citations: 16 • 2024

Knowledge Distillation for Model-Agnostic Meta-Learning

Min Zhang, Sibo Gai

Citations: 15 • 2020

TraKDis: A Transformer-Based Knowledge Distillation Approach for Visual Reinforcement Learning With Application to Cloth Manipulation

Wei Chen, Nicolás Rojas

Citations: 15 • 2024