A simple Spark test project

作者: NickYang 分类: 大数据,技术文章 发布时间: 2016-08-10 20:31

I start to learn Spark to process some log files, here is a simple example.

How to build Spark, please see http://spark.apache.org/docs/latest/building-spark.html

Scala file

sbt file(use sbt to build this example)

The result is  in result directory, two files, one is _SUCCESS that tells us the right result, the other one is “part-00000”, contains words and words’ count in this text file.

(Because, 1)


BTW. this article is written in Ubuntu, haven’t Chinese input method(English version).



电子邮件地址不会被公开。 必填项已用*标注