Using boosting to prune bagging ensembles
This is the author’s version of a work that was accepted for publication in Pattern Recognition Letters. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Change...
| Autores: | , |
|---|---|
| Tipo de recurso: | artículo |
| Fecha de publicación: | 2007 |
| País: | España |
| Institución: | Universidad Autónoma de Madrid |
| Repositorio: | Biblos-e Archivo. Repositorio Institucional de la UAM |
| Idioma: | inglés |
| OAI Identifier: | oai:repositorio.uam.es:10486/664134 |
| Acceso en línea: | http://hdl.handle.net/10486/664134 https://dx.doi.org/10.1016/j.patrec.2006.06.018 |
| Access Level: | acceso abierto |
| Palabra clave: | Bagging Boosting Decision trees Ensemble pruning Ensembles Machine learning Informática |
| id |
ES_f7d062279eb7e44a9521c8a59d5a6104 |
|---|---|
| oai_identifier_str |
oai:repositorio.uam.es:10486/664134 |
| network_acronym_str |
ES |
| network_name_str |
España |
| repository_id_str |
|
| spelling |
Using boosting to prune bagging ensemblesMartínez Muñoz, GonzaloSuárez González, AlbertoBaggingBoostingDecision treesEnsemble pruningEnsemblesMachine learningInformáticaThis is the author’s version of a work that was accepted for publication in Pattern Recognition Letters. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in Pattern Recognition Letters 28.1 (2007): 156 – 165, DOI: 10.1016/j.patrec.2006.06.018Boosting is used to determine the order in which classifiers are aggregated in a bagging ensemble. Early stopping in the aggregation of the classifiers in the ordered bagging ensemble allows the identification of subensembles that require less memory for storage, classify faster and can improve the generalization accuracy of the original bagging ensemble. In all the classification problems investigated pruned ensembles with 20 % of the original classifiers show statistically significant improvements over bagging. In problems where boosting is superior to bagging, these improvements are not sufficient to reach the accuracy of the corresponding boosting ensembles. However, ensemble pruning preserves the performance of bagging in noisy classification tasks, where boosting often has larger generalization errors. Therefore, pruned bagging should generally be preferred to complete bagging and, if no information about the level of noise is available, it is a robust alternative to AdaBoost.The authors acknowledge financial support from the Spanish Dirección General de Investigación, project TIN2004-07676-C02-02.Elsevier BVDepartamento de Ingeniería InformáticaEscuela Politécnica SuperiorAprendizaje Automático (ING EPS-001)20072007-01-01research articlehttp://purl.org/coar/resource_type/c_2df8fbb1AMhttp://purl.org/coar/version/c_ab4af688f83e57aainfo:eu-repo/semantics/articleapplication/pdfhttp://hdl.handle.net/10486/664134https://dx.doi.org/10.1016/j.patrec.2006.06.018reponame:Biblos-e Archivo. Repositorio Institucional de la UAMinstname:Universidad Autónoma de MadridInglésengopen accesshttp://purl.org/coar/access_right/c_abf2info:eu-repo/semantics/openAccessoai:repositorio.uam.es:10486/6641342026-06-23T12:46:27Z |
| dc.title.none.fl_str_mv |
Using boosting to prune bagging ensembles |
| title |
Using boosting to prune bagging ensembles |
| spellingShingle |
Using boosting to prune bagging ensembles Martínez Muñoz, Gonzalo Bagging Boosting Decision trees Ensemble pruning Ensembles Machine learning Informática |
| title_short |
Using boosting to prune bagging ensembles |
| title_full |
Using boosting to prune bagging ensembles |
| title_fullStr |
Using boosting to prune bagging ensembles |
| title_full_unstemmed |
Using boosting to prune bagging ensembles |
| title_sort |
Using boosting to prune bagging ensembles |
| dc.creator.none.fl_str_mv |
Martínez Muñoz, Gonzalo Suárez González, Alberto |
| author |
Martínez Muñoz, Gonzalo |
| author_facet |
Martínez Muñoz, Gonzalo Suárez González, Alberto |
| author_role |
author |
| author2 |
Suárez González, Alberto |
| author2_role |
author |
| dc.contributor.none.fl_str_mv |
Departamento de Ingeniería Informática Escuela Politécnica Superior Aprendizaje Automático (ING EPS-001) |
| dc.subject.none.fl_str_mv |
Bagging Boosting Decision trees Ensemble pruning Ensembles Machine learning Informática |
| topic |
Bagging Boosting Decision trees Ensemble pruning Ensembles Machine learning Informática |
| description |
This is the author’s version of a work that was accepted for publication in Pattern Recognition Letters. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in Pattern Recognition Letters 28.1 (2007): 156 – 165, DOI: 10.1016/j.patrec.2006.06.018 |
| publishDate |
2007 |
| dc.date.none.fl_str_mv |
2007 2007-01-01 |
| dc.type.none.fl_str_mv |
research article http://purl.org/coar/resource_type/c_2df8fbb1 AM http://purl.org/coar/version/c_ab4af688f83e57aa |
| dc.type.openaire.fl_str_mv |
info:eu-repo/semantics/article |
| format |
article |
| dc.identifier.none.fl_str_mv |
http://hdl.handle.net/10486/664134 https://dx.doi.org/10.1016/j.patrec.2006.06.018 |
| url |
http://hdl.handle.net/10486/664134 https://dx.doi.org/10.1016/j.patrec.2006.06.018 |
| dc.language.none.fl_str_mv |
Inglés eng |
| language_invalid_str_mv |
Inglés |
| language |
eng |
| dc.rights.none.fl_str_mv |
open access http://purl.org/coar/access_right/c_abf2 |
| dc.rights.openaire.fl_str_mv |
info:eu-repo/semantics/openAccess |
| rights_invalid_str_mv |
open access http://purl.org/coar/access_right/c_abf2 |
| eu_rights_str_mv |
openAccess |
| dc.format.none.fl_str_mv |
application/pdf |
| dc.publisher.none.fl_str_mv |
Elsevier BV |
| publisher.none.fl_str_mv |
Elsevier BV |
| dc.source.none.fl_str_mv |
reponame:Biblos-e Archivo. Repositorio Institucional de la UAM instname:Universidad Autónoma de Madrid |
| instname_str |
Universidad Autónoma de Madrid |
| reponame_str |
Biblos-e Archivo. Repositorio Institucional de la UAM |
| collection |
Biblos-e Archivo. Repositorio Institucional de la UAM |
| repository.name.fl_str_mv |
|
| repository.mail.fl_str_mv |
|
| _version_ |
1869424918185115648 |
| score |
15,301629 |