Research and Implementation of Real-time Data Processing Platform Based on Storm Technology

Guizhou Vocational Technology College of Electronics & Information Qiandongnan Vocational & Technical College for Nationalities

Download:

PDF(0KB)
Export: BibTeX | EndNote (RIS)

Abstract Aiming at the problems of poor real-time performance, long processing time, and slow resource request of the existing big data processing platform, this paper uses Storm real-time computing technology, combined with Flume, Kafka, Zookeeper and other big data processing components to design a real-time data processing platform. It uses tornado+WSGI+Apache technology to build a Web server, and uses Echarts technology to visually analyze the processing results. This article uses the website access log as the da- ta source to verify the platform. Through the test, the platform can complete the real-time calculation of the website's click-through rate and the number of visitors. It has the characteristics of stability, reliability and simple operation.

Key words： big data Storm real-time computing technology data visualization click-through rate number of visitors

Published: 24 February 2021

	Service

	E-mail this article
	Add to my bookshelf
	Add to citation manager
	E-mail Alert
	RSS
	Articles by authors
	YANG Yu XU Wang-ming

Cite this article:

YANG Yu XU Wang-ming . Research and Implementation of Real-time Data Processing Platform Based on Storm Technology. Computer & Telecommunication, 2021, 1(1): 51-.

URL:

http://www.computertelecom.com.cn/EN/ OR http://www.computertelecom.com.cn/EN/Y2021/V1/I1/51

[1]	LIU Hui-fang. Research and Application of Anti-fraud Model Based on Big Data of Communication Operator[J]. 电脑与电信, 2021, 1(7): 46-52.
[2]	WANG Jia-hao. Risk Evaluation of Telecom Big Data Application Project Based on AHP-entropy Weight Method[J]. 电脑与电信, 2021, 1(7): 53-55.
[3]	YAO Jian-sheng LIU Yan-ling. Teaching Reform and Practice of Smart Tourism Data Science Course[J]. 电脑与电信, 2021, 1(4): 9-11.
[4]	SONG Man. Research on Talents Training Program of Big Data Majors in Higher Vocational Colleges ——Taking Guangzhou City Construction College as an Example[J]. 电脑与电信, 2021, 1(4): 16-22.
[5]	LI Ai-sheng. Exploration and Practice of Intelligent Training Based on CDL Architecture ——Take the Major of Information Security and Management as an Example[J]. 电脑与电信, 2021, 1(4): 81-85.
[6]	SONG Zhi-yang ZHOU-Chen ZHANG Juan CHEN Ying-ying. Design and Implementation of PositionAnalysis System of Recruitment Website[J]. 电脑与电信, 2020, 1(9): 6-10.
[7]	LIU Yi-xuan. Research on theApplication of MongoDB in Urban Drainage[J]. 电脑与电信, 2020, 1(8): 55-.
[8]	ZHENG Dan ZHOU Xiao-long. Research and Exploration on Smart FinancialAid in Colleges and Universities in the Background of Big Data[J]. 电脑与电信, 2020, 1(7): 25-27.
[9]	WANG Chen-hao JIAHai-tian. Consumption Behavior Guidance and Risk Prevention of College Students Based on Big Data[J]. 电脑与电信, 2020, 1(7): 51-.
[10]	ZHOU Hong-cheng FENG Kai-zheng XIAO Feng . Intelligent Forestry System Design Based on Big Data[J]. 电脑与电信, 2020, 1(4): 56-59.
[11]	YAN Si-jing. Research on Online Learning Behavior Elements of Five-year Higher Vocational Nursing Students Based on Big Data[J]. 电脑与电信, 2020, 1(3): 9-11.
[12]	ZHOU Xiao-juan. Discussion on the Computer Network Security and Preventive Measures in the Era of Big Data[J]. 电脑与电信, 2020, 1(3): 41-43.
[13]	. Design and Key Technology Research onAutomobile Remote Diagnosis System[J]. 电脑与电信, 2020, 1(3): 52-54.
[14]	HUANG Xiao-hua. Construction of Wisdom Classroom Evaluation andAssessment System Based on "Dynamic Learning DataAnalysis"[J]. 电脑与电信, 2020, 1(1-2): 25-27.
[15]	ZHANG Juan LI Qin-yi LV Tai-zhi. Design and Implementation of Freshman Data Visualization System[J]. 电脑与电信, 2020, 1(11): 26-28.

Viewed

Full text

Abstract

Cited

Shared

Discussed