云计算环境下的大数据特征挖掘技术研究Research on big data feature mining technology in cloud computing environment
张文,苏玉
摘要(Abstract)：
基于梯度采样的大数据特征挖掘方法在大数据挖掘过程中,逻辑性较差,仅从单层角度进行大数据特征挖掘,极大降低大数据特征挖掘的精度。对此,提出基于云计算环境下大数据特征挖掘模型的特征挖掘方法,其大数据存储体系层包括多源信息资源服务层、核心技术层、多源信息资源平台服务层以及多源信息资源基础层,采用大数据特征分布函数实施大数据特征匹配,实现大数据特征初步挖掘;大数据特征挖掘处理层对存储体系层中的大数据进行抽取、转换、清洗、集成与加载实现大数据预处理,采用FP-tree对预处理后的大数据进行准确特征挖掘,通过用户层将获取的大数据特征挖掘结果反馈给用户,完成云计算环境下大数据特征挖掘。实验结果表明,所提方法在云计算环境下大数据特征挖掘方面准确率较高,具有低能量开销的优势。
关键词(KeyWords)： 云计算;梯度采样;大数据;存储体系;特征挖掘;能量开销
基金项目(Foundation): 2018年河南省重大科技项目(182102210597)~~
作者(Author): 张文,苏玉
DOI: 10.16652/j.issn.1004-373x.2018.20.039
参考文献(References)：
- [1]张晋芳,王清心,丁家满,等.一种云计算环境下大数据动态迁移策略[J].计算机工程,2016,42(5):13-17.ZHANG Jinfang,WANG Qingxin,DING Jiaman,et al. A big data dynamic migration strategy in cloud computing environment[J]. Computer engineering,2016,42(5):13-17.
- [2]王欣,周晓梅.云计算环境下大数据合理分流技术研究与仿真[J].计算机仿真,2016,33(3):292-295.WANG Xin,ZHOU Xiaomei. Research and simulation on big data reasonable splitting technology in cloud computing environment[J]. Computer simulation,2016,33(3):292-295.
- [3] MANIKYAM N R H,KUMAR S M. Methods and techniques to deal with big data analytics and challenges in cloud computing environment[J]. International journal of civil engineering&technology,2017,8(4):669-678.
- [4]申琢.基于云计算和大数据挖掘的矿山事故预警系统研究与设计[J].中国煤炭,2017,43(12):109-114.SHEN Zhuo. Study on early warning system of coal mine accidents based on cloud computing and big data crunching platform[J]. China coal,2017,43(12):109-114.
- [5] GHORBEL A,GHORBEL M,JMAIEL M. Privacy in cloud computing environments:a survey and research challenges[J].Journal of supercomputing,2017,73(6):2763-2800.
- [6] LIAO L,HUANG Y,LIU X. Study on the mining method for specific fault data of multimedia sensor networks in cloud computing environment[J]. Multimedia tools&applications,2016,76(16):1-16.
- [7]楼凤丹,裴旭斌,王志强,等.基于云计算及大数据技术的电力搜索引擎技术研究[J].电网与清洁能源,2016,32(12):86-92.LOU Fengdan,PEI Xubin,WANG Zhiqiang,et al. Research on power search engine technology based on cloud computing and large data[J]. Advances of power system&hydroelectric engineering,2016,32(12):86-92.
- [8] GOLI-MALEKABADI Z,SARGOLZAEI-JAVAN M,AKBARI M K. An effective model for store and retrieve big health data in cloud computing[J]. Computer methods and programs in biomedicine,2016,132:75-82.
- [9] HUA M A,ZHI-GANG H U,ZHANG H Y,et al. Personalized fusion method of service trust evaluation in cloud computing environment[J]. Journal of Chinese computer systems,2014,35(4):776-780.
- [10]吴凯峰,刘万涛,李彦虎,等.基于云计算的电力大数据分析技术与应用[J].中国电力,2015,48(2):111-116.WU Kaifeng,LIU Wantao,LI Yanhu,et al. Cloud-computing based power big data analysis technology and its application[J]. Electric power,2015,48(2):111-116.