基于大数据分析乐器全员营销系统开发 Based on big data analysis musical instrument marketing system development第 1 页 共 34 页摘 要当今时代互联网发展非常迅猛，大数据也处于快速发展状态，各行各业或多或少都与大数据息息相关。随着互联网的发展和进步，也产生了巨量的交互数据信息。怎么在这海量的数据中搜索和提取出自己需要的信息变得非常重要。本文主要是运用到业界最好的大数据分析框架 Spark,对乐器营销网站的日志进行实时和离线分析。为实现乐器全员营销搭建好基层建设，以在未来为更加先进的数据挖掘与数据分析提供健康的数据来源，从而获取更大的商机。本 文 使 用 了 业 界 内 非 常 成 熟 的 Spark 框 架 ， 具 体 是 Spark Streaming、Spark SQL、Spark Core。运用这些非常流行而且强大的Spark 框架进行离线数据的统计计算和实时数据的统计计算。本项目实现了四大模块，如用户访问 Session 离线分析、网页单跳转化率离线统计、热点商品离线统计、广告流量实时统计。关键词：乐器电商日志信息， Spark， 离线统计，实时统计第 2 页 共 34 页 AbstractNowadays, with the rapid development of Internet and big data, all walks of life are more or less closely related to big data. With the development and progress of the Internet, a huge amount of interactive data information has been generated. How to search and extract the needed information from the massive data becomes very important.This paper mainly uses spark, the best big data analysis framework in the industry, to analyze the logs of musical instrument marketing websites in real time and offline. In order to achieve the goal of building a good basic level of musical instrument marketing, in order to provide more advanced data mining and data analysis with healthy data sources in the future, so as to obtain greater business opportunities.This article uses a very mature spark framework in the industry, specifically spark streaming, spark SQL and spark core. These popular and power...
