网络大数据平台异常风险监测系统设计Design of abnormal risk monitoring system for network big data platform
张利峰,邵斐
摘要(Abstract):
采用支持向量机进行网络大数据平台异常风险监测时,建模效率低导致对异常风险的监测结果存在较高的误差,设计基于Hadoop的网络大数据平台异常风险监测系统。依据云计算Hadoop系统作业原理,通过Map/Reduce分布式模式对大数据进行分类筛选等操作,通过控制模块中的SDN控制器对大数据流量进行分流处理,将网络大数据分类反馈到监测模块中,采用监测模块通过预处理端和存储端对异常数据风险进行监测,通过预处理端实现大数据的有效分流监测;系统软件通过最小二乘支持向量机对网络大数据进行高效率建模,实现网络大数据异常监测。实验结果表明,所设计系统具有监测效率和稳定性高、性能佳的优势。
关键词(KeyWords): 网络大数据;异常风险;监测系统;控制模块;Hadoop;最小二乘支持向量机
基金项目(Foundation): 江苏省教育厅批准项目(17KJB520008);; 江苏省高校自然科学研究重大项目(17KJA520001)~~
作者(Author): 张利峰,邵斐
DOI: 10.16652/j.issn.1004-373x.2018.22.035
参考文献(References):
- [1]张科星.网络大数据平台中的特征数据分类系统设计与实现[J].现代电子技术,2017,40(8):25-28.ZHANG Kexing. Design and implementation of feature data classification system in network big data platform[J]. Modern electronics technique,2017,40(8):25-28.
- [2]任华,张玲,叶煜.数字化校园中用户网络行为大数据的分析与监控[J].计算机与数字工程,2017,45(9):1814-1818.REN Hua,ZHANG Ling,YE Yu. Analysis and monitoring of big data of user′s network behavior in digital campus[J]. Computer and digital engineering,2017,45(9):1814-1818.
- [3]路鹤晴,张晓峰,李斌.基于物联网的高危妊娠监测预警网络平台的设计与应用[J].中国医疗器械杂志,2017,41(5):327-329.LU Heqing,ZHANG Xiaofeng,LI bin. Design and application of high-risk pregnancy monitoring&warning Internet platform based on Internet of Things[J]. Chinese journal of medical instrumentation,2017,41(5):327-329.
- [4]曾胜.重大危险源动态智能监测监控大数据平台框架设计[J].中国安全科学学报,2014,24(11):166-171.ZENG Sheng. Framework design of large data platform for monitoring and controlling major hazards dynamically and intelligently[J]. China safety science journal,2014,24(11):166-171.
- [5]张成军,刘超,郭强.大数据网络环境下异常节点数据定位方法仿真[J].计算机仿真,2017,34(5):273-276.ZHANG Chengjun,LIU Chao,GUO Qiang. Simulation of abnormal node data location in large data network environment[J]. Statistical research,Computer simulation,2017,34(5):273-276.
- [6]唐晓彬,周志敏,董莉.大数据背景下网络突发事件动态监测研究[J].统计研究,2017,34(2):44-54.TANG Xiaobin,ZHOU Zhimin,DONG Li. Research on monitoring Internet burst events dynamically from the big data perspective[J]. Statistical research,2017,34(2):44-54.
- [7]张威,敖乃翔,王德勇,等.基于异常用电行为识别的社会治安风险预警方法[J].中国电子科学研究院学报,2016,11(6):594-598.ZHANG Wei,AO Naixiang,WANG Deyong,et al. Public security risk preception based on anomaly detection of electrical behavior[J]. Journal of China Academy of Electronics and Information Technology,2016,11(6):594-598.
- [8]胡为艳,艾民,周光彬,等.基于大数据的信令监测系统的设计与实现[J].电视技术,2016,40(1):95-101.HU Weiyan,AI Min,ZHOU Guangbin,et al. Design and implementation of big data based signaling monitoring system[J].Video engineering,2016,40(1):95-101.
- [9] WANG S,LI Y,ZHAO X,et al. Intrusion detection system design of cloud computing based on abnormal traffic identification[J]. International journal of reasoning-based intelligent systems,2015,7(3):186-192.
- [10] XUE Y W,ZHANG P Z,FAN J. Design and realization of supervision platform of simulating capital abnormal flow in complex financial network[J]. Systems engineering-theory methodology application,2005,14(5):449-453.