Variable Selection in Data Analysis: A Synthetic Data Toolkit (With Full text)

Date

2024-02

Journal Title

Journal ISSN

Volume Title

Publisher

Multidisciplinary Digital Publishing Institute (MDPI)

Abstract

Variable (feature) selection plays an important role in data analysis and mathematical modeling. This paper aims to address the significant lack of formal evaluation benchmarks for feature selection algorithms (FSAs). To evaluate FSAs effectively, controlled environments are required, and the use of synthetic datasets offers significant advantages. We introduce a set of ten synthetically generated datasets with known relevance, redundancy, and irrelevance of features, derived from various mathematical, logical, and geometric sources. Additionally, eight FSAs are evaluated on these datasets based on their relevance and novelty. The paper first introduces the datasets and then provides a comprehensive experimental analysis of the performance of the selected FSAs on these datasets including testing the FSAs’ resilience on two types of induced data noise. The analysis has guided the grouping of the generated datasets into four groups of data complexity. Lastly, we provide public access to the generated datasets to facilitate bench-marking of new feature selection algorithms in the field via our Github repository. The contributions of this paper aim to foster the development of novel feature selection algorithms and advance their study. © 2024 by the authors.

Description

Keywords

data analysis, feature selection algorithms, synthetic data generation, synthetic datasets, variable selection

Citation

Mitra, R., Ali, E., Varam, D., Sulieman, H., & Kamalov, F. (2024). Variable selection in data analysis: A synthetic data toolkit. Mathematics (Basel), 12(4), 570. https://doi.org/10.3390/math12040570

DOI