Informatics Institute faculty member Behçet Uğur Töreyin and research assistant Reyhan Kevser Keser coauthored paper titled  'Averager Student: Distillation from Undistillable Teacher' in 'ICL 2023 Tiny Papers' on 29 May 2023.

DOI: could not be found
Substitute links: https://openreview.net/forum?id=4isz71_aZN , https://github.com/rkevser/AveragerStudent

Abstract: Today, some companies release their black-box model as a service for users, where users can see the model’s output corresponding to their input. However, these models can be stolen via knowledge distillation by malicious users. Recently, undistillable teacher (Ma et al., 2021) is introduced in order to prevent the knowledge leakage. In this study, with the aim of contributing to solutions for model intellectual property (IP) protection, we propose a novel method which improves the distillation from an undistillable teacher whose goal is make the distillation difficult for students, with the purpose of model protection. The codes are released at https://github.com/rkevser/AveragerStudent.

İTÜ Informatics Institute

bilisim-anasayfa-hakkimizda

ITU Informatics Institute provides graduate-level education and research in applied informatics, computer sciences, computational science and engineering, communication systems under the following programs.

Faculty members and students conduct research supported by national and international organızatıons in the fields of electromagnetic fields, communication systems/regulations, computational materials design, computational chemistry/biology, cryptography, signal/data processing/visualization, big data management, climate and ocean sciences, 

  • List of Most Influential Scientists; Associate Professor. B. Uğur Töreyin (article by Dr. John PA Ioannidis, K. W. Boyack and J. Baas published in the journal PLOS Biology)
  • Beltus Nkwawir Wiysobunri, the best project award in the Science category, in the 2020 International Students Project Competition
  • Argenit company, of which Dr. Abdulkerim Çapar is among the founding partners, received the "National-International Supports" First Prize of ITU ARI Teknokent.
  • TÜBİTAK 2242 University Students Project Competition in Priority Areas: Istanbul region first place - Ahmet Burak Özyurt
  • Best Presentation Award at ICAT'18 Conference: Sena Efsun Cebeci, 2018
  • Tubitak Incentive Award; 2016 Assoc. Prof. Adem Tekin
  • “Technical Paper” and “Willis H. Carrier” Award by the American Heating, Cooling and Air Conditioning Association; 2016 Assist. Prof. Dr. H. Salih Erden
  • Science Heroes Association Young Scientist of the Year Award; 2016 Assoc. B. Uğur Töreyin Best Poster Award at PRACEdays 2016 conference; Samet Demir
  • ITU Most Successful Thesis Award; 2016 Hatice Gokcan

There is also a High Performance Computing Laboratory established with the support of the State Planning Organization within the Institute.