demo10.cpp File Reference

Example 10: Basic Filter-based feature selection. More...

#include <boost/smart_ptr.hpp>
#include <exception>
#include <iostream>
#include <cstdlib>
#include <string>
#include <vector>
#include "error.hpp"
#include "global.hpp"
#include "subset.hpp"
#include "data_intervaller.hpp"
#include "data_splitter.hpp"
#include "data_splitter_5050.hpp"
#include "data_scaler.hpp"
#include "data_scaler_void.hpp"
#include "data_accessor_splitting_memTRN.hpp"
#include "data_accessor_splitting_memARFF.hpp"
#include "criterion_normal_gmahalanobis.hpp"
#include "distance_euclid.hpp"
#include "classifier_knn.hpp"
#include "seq_step_straight.hpp"
#include "search_seq_sfs.hpp"

Include dependency graph for demo10.cpp:

Functions
int	main ()

---

Detailed Description

Example 10: Basic Filter-based feature selection.

---

Function Documentation

int main

(

)

Example 10: Basic Filter-based feature selection.

This is a simple example of filter-based feature selection, as described in the seminal book by Devijver and Kittler from 1982 - Pattern Recognition: A Statistical Approach. Features are selected here using the Sequential Forward Selection (SFS) procedure so as to maximize the Generalized Mahalanobis probabilistic class distance based on the assumption of normality of the data. Generalized Mahalanobis is evaluated on the first 50% of data samples. The selected subset is eventually verified by means of 3-NN classifier accuracy estimation on the second 50% (independent test) part of the data. SFFS is called here in d-parametrized setting, invoked by nonzero parameter d in search(d,...). In this scenario the user has to decide about the target subset size.

Note:

With arbitrary data the assumption of normality may not be fulfilled what would negatively affect the feature seleciton results based on Mahalanobis, Bhattacharyya or Divergence.

Examples:

demo10.cpp, demo11.cpp, demo11t.cpp, demo12t.cpp, demo20.cpp, demo21.cpp, demo22.cpp, demo23.cpp, demo24.cpp, demo24t.cpp, demo25t.cpp, demo26.cpp, demo30.cpp, demo31.cpp, demo32t.cpp, demo33.cpp, demo33t.cpp, demo34.cpp, demo35t.cpp, demo40.cpp, demo40t.cpp, demo41.cpp, demo42.cpp, demo43.cpp, demo50.cpp, demo51.cpp, demo52t.cpp, demo53.cpp, demo54.cpp, demo55.cpp, demo56.cpp, demo60.cpp, demo61.cpp, demo62.cpp, and demo63.cpp.

References FST::Search_SFS< RETURNTYPE, DIMTYPE, SUBSET, CRITERION, EVALUATOR >::search(), and FST::Search_SFS< RETURNTYPE, DIMTYPE, SUBSET, CRITERION, EVALUATOR >::set_search_direction().