DEvS: Data Distillation Algorithm Based on Evolution Strategy
Loading...
Date
2022
Authors
Shvai, Nadiya
Llanza, Arcadi
Hasnat, Abul
Nakib, Amir
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
The development of machine learning solutions often relies on training using large labeled datasets. This raises challenges in terms of data storage, data privacy protection, and longer model training time. One of the possible solutions to overcome these problems is called dataset distillation – a process of creating a smaller dataset while maximizing the preservation of its task-related information. In this paper, a new dataset distillation algorithm is proposed, called DEvS, which uses an evolutionary strategy approach to condense the training samples initially available for an image classification task, while minimizing the loss of classification accuracy. Experiments on CIFAR-10 demonstrate the competitiveness of the proposed approach. Also, contrary to recent trends, DEvS is derivative-free image generation, and therefore has greater scalability on larger input image sizes.
Description
Keywords
dataset distillation, image classification, neural networks, evolution strategy, optimization, conference materials
Citation
DEvS: Data Distillation Algorithm Based on Evolution Strategy / Shvai Nadiya, Llanza Arcadi, Hasnat Abul, Nakib Amir // Proceedings of the Genetic and Evolutionary Computation Conference Companion, 9-13 July 2022. - 2022. - P. 292-295. - https://doi.org/10.1145/3520304.3528819