SOAP: Efficient Feature Selection of Numeric Attributes

The attribute selection techniques for supervised learning, used in the preprocessing phase to emphasize the most relevant attributes, allow making models of classification simpler and easy to understand. Depending on the method to apply: starting point, search organization, evaluation strategy, and...

Full description

Bibliographic Details
Authors: Ruiz Sánchez, Roberto, Aguilar Ruiz, Jesús Salvador, Riquelme Santos, José Cristóbal
Format: book part
Status:Published version
Publication Date:2002
Country:España
Institution:Universidad de Sevilla (US)
Repository:idUS. Depósito de Investigación de la Universidad de Sevilla
OAI Identifier:oai:idus.us.es:11441/39157
Online Access:http://hdl.handle.net/11441/39157
https://doi.org/10.1007/3-540-36131-6_24
Access Level:Open access
Keyword:Artificial Intelligence (incl. Robotics)
Computation by Abstract Devices
Description
Summary:The attribute selection techniques for supervised learning, used in the preprocessing phase to emphasize the most relevant attributes, allow making models of classification simpler and easy to understand. Depending on the method to apply: starting point, search organization, evaluation strategy, and the stopping criterion, there is an added cost to the classification algorithm that we are going to use, that normally will be compensated, in greater or smaller extent, by the attribute reduction in the classification model. The algorithm (SOAP: Selection of Attributes by Projection) has some interesting characteristics: lower computational cost (O(mn log n) m attributes and n examples in the data set) with respect to other typical algorithms due to the absence of distance and statistical calculations; with no need for transformation. The performance of SOAP is analysed in two ways: percentage of reduction and classification. SOAP has been compared to CFS [6] and ReliefF [11]. The results are generated by C4.5 and 1NN before and after the application of the algorithms.