Full-Text Search:
Home|Journal Papers|About CNKI|User Service|FAQ|Contact Us|中文
《Control and Decision》 2006-01
Add to Favorite Get Latest Update

AlignLoo Model Selection Approach for Regularized Least-squares Classification

YANG Hui-hua~(1,2),WANG Xing-yu~1,WANG Yong~(1,3),GAO Haihua~1(1.College of Information Science and Engineering,East China University of Science & Technology,Shanghai 200237,China;2.Department of Computer, Guilin University of Electronic Technology,Guilin 541004,China;3.Network Information Center,Guilin University of Electronic Technology,Guilin 541004,China.  
Regularized Least-Squares Classification(RLSC) is a kind of kernel-based square loss regularization network,and its generalization performance is severely influenced by the setting of its kernel and hyper parameters.A novel approach named AlignLoo is presented for optimal parameters selection,and the key of this approach lies in tuning the kernel parameter and hyper parameter sequentially.First,the optimal kernel parameter is selected by maximizing kernel target alignment,and then the optimal hyper-parameter is determined via minimizing RLSC's leave-one-out error bound.The experimental results on IDA benchmark datasets demonstrate that the proposed approach is superior to traditional grid search method in that it is much more time efficient and it needs no independent validation set.
【Key Words】: Kernel function Regularization Least-squares methods Classification Model selection Support vector machines
【Fund】: 国家重点基础研究发展规划项目(2002CB312200);; 高等学校博士点基金项目(20040251010)
【CateGory Index】: O241.5
Download(CAJ format) Download(PDF format)
CAJViewer7.0 supports all the CNKI file formats; AdobeReader only supports the PDF format.
【References】
Chinese Journal Full-text Database 1 Hits
1 ZHANG Xiang-Rong1,2, YANG Chun1,2, JIAO Li-Cheng1,2 1(Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education of China, Xidian University, Xi’an 710071, China) 2(Institute of Intelligent Information Processing, Xidian University, Xi’an 710071, China);Semi-Supervised SAR Target Recognition Based on Laplacian Regularized Least Squares Classification[J];Journal of Software;2010-04
【Co-citations】
Chinese Journal Full-text Database 10 Hits
1 GUO Li-ping et al(China University of Geosciences,Beijing 100083);Research Advances in Remote Sensing Image Fusion and Classification Using Support Vector Machine[J];Journal of Anhui Agricultural Sciences;2010-17
2 XIE Jun,HU Jun-chuan,DA Liang-long,LI Yu-yang (Underwater Acoustical Database Center,Naval Submarine Academy,Qingdao 266071,China);SVM Application in Pattern Classification[J];Ordnance Industry Automation;2009-10
3 FENG Jun1,2), XIE Bin1), HAO Weidong1), YANG Yang1) 1) Information Engineering School, University of Science and Technology Beijing, Beijing 100083, China 2) Department of Computer Science, Shijiazhuang Institute of Railway, Shijiazhuang 050043, China;Automatic model selection method for support vector machines classifiers[J];Journal of University of Science and Technology Beijing;2006-01
4 Xu Hongmin Wang Haiying Liang Jin Huang Shuai(Beijing Institute of Petro-chemical Technology,Beijing 102617,China);Support Vector Machine Regression Algorithm and Its Application[J];Journal of Beijing Institute of Petro-Chemical Technology;2010-01
5 CHEN Lin-yan,FENG Jun (Information Engineering School, UST Inner Mongolia, Baotou 014010,China;Department of Computer Science, Shijiazhuang Institute of Railway, Shijiazhuang 050043, China);Study on some key problems of support vector machine classifier[J];Journal of Baotou University fo Iron and Steel Technology;2005-04
6 WANG Zheng-jun1,ZHANG Pei-lin1,REN Guo-quan1,CAO Jian-jun1,LIU Kun-lun2(1.Ordnance Engineering College,Self-Propelled Gun Staff,Shijiazhuang 050003,China;2.The military representative office of No.167 factory in Long Quan-yi District,Chengdu 610110,China);Research on Ferrous Metal Part Wear States Discrimination of IC Engine[J];Vehicle Engine;2008-01
7 WANG An-na,QIU Zeng,WU Jie,QU Fu-ming (School of Information Science & Engineering,Northeastern University,Shenyang 110004,China.);SVM-Based Multi-classifying Algorithm for Soft Fault Diagnosis of Analog Circuits[J];Journal of Northeastern University(Natural Science);2008-07
8 WANG Yu1,ZHOU Shui-sheng2,LIU Hong-wei2 (1.Computer Science Department,Xi'an Institute of Post and Telecommunications,Xi'an 710121,China;2.School of Science,Xidian University,Xi'an 710071,China);Bi-criterion optimization for kernel parameters selection[J];Electronics Optics & Control;2007-06
9 YU Ying (Software College,Dongguan University of Technology,Dongguan 523808,China);Building Support Vector Machine with Reduced Feature Complexity[J];Journal of Dongguan University of Technology;2007-03
10 ZHOU Jin-zhu,DUAN Bao-yan,HUANG Jin,and LI Hua-ping(Key Lab of Electronic Equipment Structure of Ministry of Education,Xidian University Xi’an 710071);Prediction of Plane Slotted-Array Antenna Electrical Performance Affected by Manufacturing Precision[J];Journal of University of Electronic Science and Technology of China;2009-06
China Proceedings of conference Full-text Database 10 Hits
1 PENG Xiyuan,WU Hongxing,PENG Yu Dept of Automatic Test and Control(Harbin Institute of Technology),Science Park of Harbin Institute of Technology,P.O.Box 3033,Harbin Heilongjiang China,150080;The Feature Selection Method for SVM with Discrete Particle Swarm Optimization Algorithm[A];[C];2007
2 SHI Yah~(1*),LI Xiao-Min~1,QI Xiao-Hui~1,LIANG Xiang~2 1.Department of Optics and Electrics Engineering,Ordnance Engineering College,Shijiazhuang China;2.Scientific Research Department of Unit 93469 Shijiazhuang China;The Fault Diagnosis Research of Support Vector Machine with Optimized Parameters Based on Genetic Algorithm[A];[C];2009
3 Shao Xiaojian;Duan Hua;He Guoping Colleg of Information Science and Engineering, SUST-Taian, 271019 Dept. of Mathematics, Shanghai Jiaotong University, Shanghai, 200240;An Improved Minimal Kernel Classifiers[A];[C];2004
4 Xiaoyan Yang1,Hongwei Ge2 The School of Information Technology,Southern YangTze University Wuxi,Jiangshu,People's Republic of China;Optimization of SVM Kernels and Application to Down Category Recognition[A];[C];2006
5 LIU Guang-li,ZHANG Yue-feng College of Information and Electrical Engineering, China Agricultural University,Beijing 100083,China.;A new early-warning indices selection method[A];[C];2005
6 Li Jie, Gao Feng, Guan Xiaohong, Zhou Dianming(SKLMS, Systems Engineering Institute, Xi'an Jiaotong University, Shan'xi Xi'an, 710049);Hyper Parameters Selection for SVR Based on Steady-State Genetic Algorithm[A];[C];2005
7 He Weixing Chen Xiaoping Chen Jiyun Lu Senlin (School of Electrical and Information Engineering, Jiangsu University, Zhenjiang 212013);Fault Diagnosis for Transmission Rolling Bearings of Petroleum Drilling[A];[C];2008
8 WANG Xin-feng, QIU Jing, LIU Guan-jun Mechatronics Engineering and Automation Institute, NUDT, Changsha 410073, China;Feature Selection Method Based on SVM for Machine Fault Diagnosis[A];[C];2004
9 Qiang Jun, Zhou Ming-zheng, Wang Jun, Chu Ning (Dept. of Comp. Sci & Engn., Anhui University of Technology and Science, Wuhu 241000,China);Endoscopic Image Recognition Based on Kernel Learning Algorithms[A];[C];2005
10 Sa Kwang Song Information and Communications University Daejeon Yun JIN Chungnam National University Daejeon Sung Hyon Myaeng Information and Communications University Daejeon;Abbreviation Disambiguation Using Semantic Abstraction of Symbols and Numeric Terms[A];[C];2005
【Co-references】
Chinese Journal Full-text Database 3 Hits
1 Han Ping Wu Renbiao Wang Zhaohua Wang Yunhong (Institute of Electronic Information Eng., Tianjin University, Tianjin 300072, China) (Inst. of Comm. and Signal Proc., Civil Aviation Univ. of China, Tianjin 300300, China) (Nat. Key Lab of Pattern Recognition, Inst. of Automation, CAS, Beijing 100080, China);SAR AUTOMATIC TARGET RECOGNITION BASED ON KPCA CRITERION[J];Journal of Electronics and Information Technology;2003-10
2 Luo Siwei and Zhao Lianwei (School of Computer and Information Technology, Beijing Jiaotong University, Beijing 100044);Manifold Learning Algorithms Based on Spectral Graph Theory[J];Journal of Computer Research and Development;2006-07
3 ZHANG Cui, LI Su-dan, ZOU Tao, WANG Zheng-zhi (Department of Automatic Control, NUDT, ChangSha 410073);An Automatic Target Recognition Method in SAR Imagery Using Peak Feature Matching[J];Journal of Image and Graphics;2002-07
【Secondary References】
Chinese Journal Full-text Database 1 Hits
1 Yu Guo-xian① Zhang Guo-ji② Wei Jia① Ren Ya-zhou① ①(School of Computer Science and Engineering,South China University of Technology,Guangzhou 510006,China) ②(School of Sciences,South China University of Technology,Guangzhou 510640,China);A Multi Graphs Based Transductive Ensemble Classification Method[J];Journal of Electronics & Information Technology;2011-08
©2006 Tsinghua Tongfang Knowledge Network Technology Co., Ltd.(Beijing)(TTKN) All rights reserved