Research and Implementation of Real-time Data Processing Platform Based on Storm Technology

YANG Yu XU Wang-ming

Computer & Telecommunication ›› 2021, Vol. 1 ›› Issue (1) : 51.

Computer & Telecommunication ›› 2021, Vol. 1 ›› Issue (1) : 51.

Research and Implementation of Real-time Data Processing Platform Based on Storm Technology

Author information +
History +

Abstract

Aiming at the problems of poor real-time performance, long processing time, and slow resource request of the existing big data processing platform, this paper uses Storm real-time computing technology, combined with Flume, Kafka, Zookeeper and other big data processing components to design a real-time data processing platform. It uses tornado+WSGI+Apache technology to build a Web server, and uses Echarts technology to visually analyze the processing results. This article uses the website access log as the da- ta source to verify the platform. Through the test, the platform can complete the real-time calculation of the website's click-through rate and the number of visitors. It has the characteristics of stability, reliability and simple operation.

Key words

big data / Storm / real-time computing technology / data visualization / click-through rate / number of visitors

Cite this article

Download Citations
YANG Yu XU Wang-ming. Research and Implementation of Real-time Data Processing Platform Based on Storm Technology[J]. Computer & Telecommunication. 2021, 1(1): 51

Accesses

Citation

Detail

Sections
Recommended

/