Notice

This is not the latest version of this item. The latest version can be found at: https://repository.kaust.edu.sa/handle/10754/662832

Show simple item record

dc.contributor.authorZaib, Alam
dc.contributor.authorBallal, Tarig
dc.contributor.authorKhattak, Shahid
dc.contributor.authorAl-Naffouri, Tareq Y.
dc.date.accessioned2020-05-14T12:14:20Z
dc.date.available2020-05-14T12:14:20Z
dc.date.issued2020-04-28
dc.identifier.urihttp://hdl.handle.net/10754/662832.1
dc.description.abstractLinear discriminant analysis (LDA) based classifiers tend to falter in many practical settings where the training data size is smaller than, or comparable to, the number of features. As a remedy, regularized LDA (RLDA) methods have been proposed. However, the classification performance of these methods vary depending on the size of training and test data. In this paper, we propose a doubly regularized LDA classifier that we denote as R2LDA. In the proposed R2LDA approach, two regularization operations are carried out; one involving only the training data set, while the other also includes the given test data sample. The proposed R2LDA algorithm, unlike the classical RLDA techniques, caters for errors due to training data as well as the possible noise in the test data. Choosing the two regularization parameters in R2LDA can be automated through existing methods based on least squares (LS). Particularly, we show that a constrained perturbation regularization approach (COPRA) is well suited for the regularization parameter selection task needed for the proposed R2LDA classifier. Results obtained from both synthetic and real data demonstrate the consistency and effectiveness of the proposed R2LDA-COPRA classifier, especially in scenarios involving noisy test data.
dc.publisherarXiv
dc.relation.urlhttps://arxiv.org/pdf/2004.13335
dc.rightsArchived with thanks to arXiv
dc.titleA Doubly Regularized Linear Discriminant Analysis Classifier with Automatic Parameter Selection
dc.typePreprint
dc.contributor.departmentComputer, Electrical and Mathematical Sciences and Engineering (CEMSE) Division
dc.contributor.departmentElectrical Engineering Program
dc.eprint.versionPre-print
dc.contributor.institutionCOMSATS University Islamabad (CUI), Abbottabad Campus, Abbottabad, Pakistan.
dc.identifier.arxivid2004.13335
kaust.personBallal, Tarig
kaust.personAl-Naffouri, Tareq Y.
refterms.dateFOA2020-05-14T12:14:49Z


Files in this item

Thumbnail
Name:
Preprintfile1.pdf
Size:
210.6Kb
Format:
PDF
Description:
Pre-print

This item appears in the following Collection(s)

Show simple item record

VersionItemEditorDateSummary

*Selected version