Full-Text Search:
Home|Journal Papers|About CNKI|User Service|FAQ|Contact Us|中文
《Automation of Electric Power Systems》 2009-15
Add to Favorite Get Latest Update

A Massive COMTRADE Data Parallel Parsing Algorithm

GUI Xun1,YAO Lan2,QIAN Qingquan3(1.University of Electronic Science and Technology of China,Chengdu 610054,China;2.Chengdu University of Information Technology,Chengdu 610225,China;3.Southwest Jiaotong University,Chengdu 610031,China)  
In light of the tendency of transient supervised data in a power system toward massive development and the pressure brought about on various serial programming analysis software,a massive common format for transient data exchange(COMTRADE) data parallel parsing algorithm based on the multi-core and pipeline design idea is studied.For the parallel parsing algorithm in the binary data format,two phases are adopted,the first is for file reading and the second,multi-thread parsing.For the parallel load algorithm in the ASCII format,three phases are adopted,the first and second phase are the same as the binary data format,the third is for block edge data parsing,which subverts the traditional serial parsing algorithm of the ASCII text.In the algorithm presented,the sequence number that is overlooked in the past is effectively used in the COMTRADE data file,greatly improving the degree of parallelism.Test results show that a fairly high acceleration ratio can be achieved using the algorithm presented,while the linear acceleration ratio can be obtained with an increase of the core number and COMTRADE data.
【CateGory Index】: TM769
Download(CAJ format) Download(PDF format)
CAJViewer7.0 supports all the CNKI file formats; AdobeReader only supports the PDF format.
【References】
Chinese Journal Full-text Database 5 Hits
1 ZHANG Yanjun1,ZHAI Yuanyuan2,CHEN Yong2(1.Liaoning Electric Power Dispatching Center,Shenyang 110006,Liaoning Province,China;2.China Electric Power Research Institute,Haidian District,Beijing 100192,China);Comparison of Power Collaborative System With PSASP and Its Application[J];Power System Technology;2013-03
2 GUI Xun;School of Aeronautics and Astronautics,University of Electronic Science and Technology of China;;Calculation Parallelization for Massive COMTRADE Data Based on Recursive Algorithms[J];Automation of Electric Power Systems;2014-01
3 ZHANG Yi;YANG Honggeng;Fujian Electric Power Research Institute;School of Electrical Engineering and Information,Sichuan University;;Fast parsing of massive PQDIF files[J];Electric Power Automation Equipment;2013-12
4 QU Guanglong;YANG Honggeng;ZHANG Yi;School of Electrical Engineering and Information,Sichuan University;Fujian Electric Power Research Institute;;A Fast Parallel Parsing Scheme for Massive PQDIF Files With Map-Reduce Model[J];Power System Technology;2014-06
5 LI Hui-jun12,,TANGY i1,LI Xue-ming2,CAOY i-zhong2 (1.School of Electrical Engineering,Southeast University,Nanjing 210096,China; 2.State Grid Electric Power Research Institute,NARI Group Corporation,Nanjing 210003,China);Analysis of the typical schemes for security and stability control systems of electric power transmission and the devices’main and auxiliary operation configuration principles[J];Power System Protection and Control;2011-04
【Citations】
Chinese Journal Full-text Database 5 Hits
1 YUE Quan-ming, YU Wei-yung, BAI Chuan-jun, FEI Ming-wei, DU Jun-hong ( Shanghai Jiaotong University, Shanghai 200240, China) (NARI-Relays Electric Co Ltd, Nanjing 211100, China) (Lin'an Power Supply Bureau, Lin'an 311300, China);Novel Compression Scheme of Fault Recording Data in Power Systems Based on Lifting Algorithm[J];Automation of Electric Power Systems;2005-05
2 GUI Xun, LIU Zhigang, QIAN Qingquan(Southwest Jiaotong University, Chengdu 610031, China);General Extensible Fault Analysis Software for Power System Based on Patterns[J];Automation of Electric Power Systems;2007-15
3 ZHOU Rui,BAO Wen,YU Xiao,HE Huixin,LIU Jinfu(Harbin Institute of Technology,Harbin 150001,China);Data Compression Method Based on Lifting Wavelet Transform and Hybrid Entropy Coding[J];Automation of Electric Power Systems;2007-22
4 SONG Dun-wen, JIANG Yi-guo, XU Yong (Electric Power Research Institute China, Beijing 100085, China);DESIGN OF VERSATILE ANALYSIS SOFTWARE FOR WAVEFORM DATA[J];Power System Technology;2002-11
5 GUI Xun, GUO Kai, TAN Yong-dong, QIAN Qing-quan (School of Electrical Engineering, Southwest Jiaotong University, Chengdu 610031, China);All-graphic software system for fault record analysis based on network[J];Relay;2004-24
【Co-citations】
Chinese Journal Full-text Database 10 Hits
1 SUN Jing-feng1, ZHOU Guo-zhu2, MA Hong-lin2, WANG Xue-wei1 (1. College of Information Science and Technology, Beijing University of Chemical Technology, Beijing 100029, China;2. Beijing Electronic Science and Technology Vocational College, Beijing 100029, China);Integer wavelet threshold compression algorithm based on ARM9 and its EVC realization[J];Electrical Measurement & Instrumentation;2007-09
2 Zhang Ming Li Kaicheng Hu Yisheng(Huazhong University of Science and Technology Wuhan 430074 China);Power Quality Disturbance Data Compression Using JPEG2000[J];Transactions of China Electrotechnical Society;2011-10
3 YAN Jiang-hai(Yuncheng Power Supply Sub-Company,Yuncheng 044000,China);Application of Inserted Linux System in Fault Information Management System of Relay Protection[J];Journal of Electric Power;2006-02
4 FEI Ming-wei , YUE Quan-ming , ZHANG Pei-chao , YU Wei-yong , WANG Zhong-min ZHANG Qi-ming , ZHOU Lan (Shanghai Jiaotong University, Shanghai 200240, China) (Shanghai Electric Power Company, Shanghai 200122, China);Wavelets Selection of Compression and Reconstruction Algorithm Based on Digital Recorded Data from a Faulted Power System[J];Automation of Electric Power Systems;2005-17
5 ZHAO Yanfen YANG Honggeng (Sichuan University,Chengdu 610065,China);Data Compression Method Using 2-Dimensional Discrete Wavelet Transform for Power Quality Detection[J];Automation of Electric Power Systems;2006-15
6 YUE Quanming , FEI Mingwei , ZHANG Peichao , YU Weiyong , ZHANG Qiming, WANG Zhongmin , ZHOU Lan ( Shanghai Jiaotong University, Shanghai 200240, China) ( Shanghai Electrical Power Company, Shanghai 200122, China);A Novel Self-adaptive Algorithm for Compressing Fault Recorded Data from the EHV Power Network[J];Automation of Electric Power Systems;2006-21
7 GUI Xun, LIU Zhigang, QIAN Qingquan(Southwest Jiaotong University, Chengdu 610031, China);General Extensible Fault Analysis Software for Power System Based on Patterns[J];Automation of Electric Power Systems;2007-15
8 GUI Xun,LIU Zhigang,QIAN Qingquan(Southwest Jiaotong University,Chengdu 610031,China);3-D Analysis Method for Wave Record Fault Analysis[J];Automation of Electric Power Systems;2007-17
9 ZHOU Rui,BAO Wen,YU Xiao,HE Huixin,LIU Jinfu(Harbin Institute of Technology,Harbin 150001,China);Data Compression Method Based on Lifting Wavelet Transform and Hybrid Entropy Coding[J];Automation of Electric Power Systems;2007-22
10 GUI Xun1, YAO Lan2, QIAN Qingquan1(1. Southwest Jiaotong University, Chengdu 610031, China; 2. Chengdu University of Information Technology, Chengdu 610225, China);A Fault-tolerance Parsing Algorithm of COMTRADE[J];Automation of Electric Power Systems;2008-22
【Co-references】
Chinese Journal Full-text Database 10 Hits
1 LI Xiao ping, YAN Guang wei, WANG Xuan feng, LI De zhi, ZHANG Yang, ZHANG Lin (Dept. of Computer Science and Engineering, Beijing Institute of Technology, Beijing100081, China);Single Sign-On (SSO) System Based on Public-Key Infrastructure[J];Journal of Beijing Institute of Technology;2002-02
2 Zhang Lihua,Xu Wenli,Chang Cheng,F eng Dawei Tsinghua University,Beijing100084,China;NEW RECURSIVE DFT FOR COMPUTER RELAY[J];Automation of Electric Power Systems;2000-05
3 Su Wenhui, Li Gang (NARI Technology Development Limited Company, Nanjing 210003, China);AN IMPROVED FULL-WAVE FOURIER ALGORITHM FOR FILTRATING DECAYING DC COMPONENT[J];Automation of Electric Power Systems;2002-23
4 Huang Kai, Sun Lingsheng(Shanghai Jiaotong University, Shanghai 200030, China);A COMPACT ALGORITHM FOR FILTERING DECAYING DC COMPONENT IN RELAY PROTECTION FOURIER ALGORITHM[J];Automation of Electric Power Systems;2003-04
5 Wang Yongli , Xu Hongbing , Dong Yisheng , Qian Jiangbo , Liu Xuejun ( Southeast University, Nanjing 210096, China; Jiamusi University, Jiamusi 154007, China);DESIGN OF DISTRIBUTION AUTOMATION SYSTEM SUPPORTING DSMS[J];Automation of Electric Power Systems;2004-13
6 BAI Qing-gang, XIA Rui-hua, ZHOU Hai-bin, LIAO Xiao-chun (North China Electric Power University, Beijing 102206, China) (Wuhan Power Instrument Factory, Wuhan 430000, China);Design of Fault Wave Recording Device Using High Performance Integrated Microchip[J];Automation of Electric Power Systems;2005-22
7 HE Yixuan, LUO Yi, TU Guangyu (Huangzhong University of Science & Technology, Wuhan 430074, China);Design of the Frame of Data Stream Management System for the Energy Management System[J];Automation of Electric Power Systems;2006-24
8 MU Longhua, JIN Min(Tongji University, Shanghai 200092, China);Analysis of Fourier Algorithm in Microcomputer-based Protection[J];Automation of Electric Power Systems;2007-06
9 GUI Xun, LIU Zhigang, QIAN Qingquan(Southwest Jiaotong University, Chengdu 610031, China);General Extensible Fault Analysis Software for Power System Based on Patterns[J];Automation of Electric Power Systems;2007-15
10 XUE Yusheng1,FEI Shengying2,BU Fanqiang1(1.Nanjing Automation Research Institute,Nanjing 210003,China;2.Jiangsu Electric Power Company,Nanjing 210024,China);Upgrading the Blackout Defense Scheme Against Extreme Disasters Part Ⅰ New Challenges and Reflection[J];Automation of Electric Power Systems;2008-09
【Secondary References】
Chinese Journal Full-text Database 3 Hits
1 CHEN Jinchang;CHEN Xinghua;WU Guobing;MO Wenbo;FU Wencai;Guangdong Power Grid Power Dispach and Control Center;Jiangsu Hrt Technology Co.Ltd.;;Function-integrated Design of Load Shedding Implementation Station and Automatic Switchover Based on Stability Control Platform[J];Automation of Electric Power Systems;2014-01
2 QU Guanglong;YANG Honggeng;ZHANG Yi;School of Electrical Engineering and Information,Sichuan University;Fujian Electric Power Research Institute;;A Fast Parallel Parsing Scheme for Massive PQDIF Files With Map-Reduce Model[J];Power System Technology;2014-06
3 WANG Wei,CHEN Jun,YU Rui,ZHU Xiao-hong(Sichuan Electric Power Dispatching Center,Chengdu 610041,China);Analysis of non-fault tripping criterion operation for area-based stability control device[J];Power System Protection and Control;2012-02
【Secondary Citations】
Chinese Journal Full-text Database 10 Hits
1 Ju Gaofeng, Luo An (Central South University, Changsha 410083, China);DWT APPLICATION TO REAL-TIME COMPRESSION OF POWER QUALITY DISTURBANCE DATA[J];Automation of Electric Power Systems;2002-19
2 Zhang Zhaoning 1,2 , Yu Weiyong 2, Zhang Yigang 2(1. Civil Aviation University of China, Tianjin 300300, China) (2. Shanghai Jiaotong University, Shanghai 200030, China);POWER SYSTEM FAULT DATA COMPRESSION USING THE WAVELET PACKET TRANSFORM AND VECTOR QUANTIFICATION[J];Automation of Electric Power Systems;2003-01
3 Liu Zhichao 1, Huang Jun 2, Cheng Wenxin 2 (1. Guodian Nanjing Automation Co Ltd, Nanjing 210003, China) (2. Nanjing Sifang Epower Automation Co Ltd, Nanjing 211000, China);IMPLEMENTATION OF MANAGEMENT INFORMATION SYSTEM FOR PROTECTIVE RELAYING AND FAULT RECORDER[J];Automation of Electric Power Systems;2003-01
4 YUE Quan-ming, YU Wei-yung, BAI Chuan-jun, FEI Ming-wei, DU Jun-hong ( Shanghai Jiaotong University, Shanghai 200240, China) (NARI-Relays Electric Co Ltd, Nanjing 211100, China) (Lin'an Power Supply Bureau, Lin'an 311300, China);Novel Compression Scheme of Fault Recording Data in Power Systems Based on Lifting Algorithm[J];Automation of Electric Power Systems;2005-05
5 FEI Ming-wei , YUE Quan-ming , ZHANG Pei-chao , YU Wei-yong , WANG Zhong-min ZHANG Qi-ming , ZHOU Lan (Shanghai Jiaotong University, Shanghai 200240, China) (Shanghai Electric Power Company, Shanghai 200122, China);Wavelets Selection of Compression and Reconstruction Algorithm Based on Digital Recorded Data from a Faulted Power System[J];Automation of Electric Power Systems;2005-17
6 BAI Qing-gang, XIA Rui-hua, ZHOU Hai-bin, LIAO Xiao-chun (North China Electric Power University, Beijing 102206, China) (Wuhan Power Instrument Factory, Wuhan 430000, China);Design of Fault Wave Recording Device Using High Performance Integrated Microchip[J];Automation of Electric Power Systems;2005-22
7 DU Xinwei, LI Yuan, LIU Dichen (Wuhan University, Wuhan 430072, China);Integrated Processing System for Power Fault Recording Data[J];Automation of Electric Power Systems;2006-12
8 JIANG Jianning~1 ZHANG Jianmin~(2,3) 1.Zhejiang Power Dispatching and Communication Center,Hangzhou 310007,China 2.Hangzhou Dianzi University,Hangzhou 310037,China 3.Hangzhou State Power Information Technology Ltd,Hangzhou 310012,China;Primary Fault Information Modeling and Identification for Grid Relay Protection and Fault Information System[J];Automation of Electric Power Systems;2006-16
9 HUANG Xian feng,QIAN Lu jiang, FU Li jun (Electrical Engineering College of Wuhan University,Wuhan 430072,China);Compression of Fault Recording Signals of Power System[J];Electric Power Automation Equipment;2001-11
10 ZHANG Hao, LIU Pei (Huazhong University of Science and Technology, Wuhan 430074, Hubei Province, China);BI-ORTHOGONAL WAVELET BASED DATA COMPRESSION ALGORITHM FOR POWER SYSTEM FAULT RECORDER[J];POWER SYSTEM TECHNOLOGY;2000-11
©2006 Tsinghua Tongfang Knowledge Network Technology Co., Ltd.(Beijing)(TTKN) All rights reserved