Get Spark from the downloads page of the project website. This documentation is for Spark version 2.3.1. Spark uses Hadoop’s client libraries for HDFS and YARN. Downloads are pre-packaged for a handful of popular Hadoop versions. Users can also download a “Hadoop free” binary and run Spark with any Hadoop version by augmenting Spark’s classpath. Scala and Java users can include Spark in their projects using its Maven coordinates and in the future Python users can also install Spark from PyPI.
If you’d like to build Spark from source, visit Building Spark.
Spark runs on both Windows and UNIX-like systems (e.g. Linux, Mac OS). It’s easy to run locally on one machine — all you need is to have java installed on your system PATH, or the JAVA_HOME environment variable pointing to a Java installation.
Spark runs on Java 8+, Python 2.7+/3.4+ and R 3.1+. For the Scala API, Spark 2.3.1 uses Scala 2.11. You will need to use a compatible Scala version (2.11.x).
Note that support for Java 7, Python 2.6 and old Hadoop versions before 2.6.5 were removed as of Spark 2.2.0. Support for Scala 2.10 was removed as of 2.3.0.
spark core、spark sql以及spark streaming 的Scala、java项目混合框架搭建以及大数据案例
需积分: 49 196 浏览量
2018-09-10
16:32:14
上传
评论 5
收藏 144.05MB ZIP 举报
spark core、spark sql以及spark streaming 的Scala、java项目混合框架搭建以及大数据案例 （388个子文件） 
RDD2DataFrameReflection$.class 8KB JsonDataSource$.class 6KB JsonDataSource.class 5KB RDD2DataFrameReflection.class 5KB DailyUV$.class 5KB StringCount.class 3KB TransformBlackList.class 3KB updateStateByKeyWordCount$.class 3KB RDD2DataFrameReflection$Student.class 3KB RDD2DataFrameReflection.class 3KB TransformBlackList$.class 3KB updateStateByKeyWordCount.class 3KB SecondarySortKey.class 3KB sortWordCount.class 3KB TransformBlackList$$anonfun$2.class 2KB DataFrameOperation$.class 2KB TransformBlackList$2.class 2KB RDD2DataFrameReflection$Student$.class 2KB WordCount$.class 2KB updateStateByKeyWordCount$$anonfun$4.class 2KB GroupTop3$2.class 2KB HiveDataSource.class 2KB updateStateByKeyWordCount$3.class 2KB WordCountLocal.class 2KB DataFrameCreate.class 2KB WordCountCluster.class 2KB JsonDataSource$$anonfun$4.class 2KB SecondSort.class 2KB RDD2DataFrameReflection$$anonfun$7.class 2KB TransformationOperation.class 2KB GroupTop3$3.class 2KB GroupTop3.class 2KB TransformationOperation$1.class 2KB TransformBlackList$$anonfun$2$$anonfun$3.class 2KB TransformBlackList$2$1.class 2KB WordCountFlatMap$.class 2KB parallelizeCollection.class 2KB WordCountFlatMap.class 2KB TransformBlackList$2$2.class 2KB JsonDataSource$$anonfun$JsonDataSource$1.class 2KB RDD2DataFrameReflection$$anonfun$4.class 2KB RDD2DataFrameReflection$$anonfun$6.class 2KB RDD2DataFrameReflection$$anonfun$8.class 2KB RDD2DataFrameReflection$$anonfun$3.class 2KB DailyUV$$anonfun$1.class 2KB WordCount$$anonfun$WordCount$1.class 2KB WordCountCluster$4.class 2KB RDD2DataFrameReflection$$anonfun$2.class 2KB WordCountLocal$4.class 2KB TransformBlackList$$anonfun$2$$anonfun$4.class 2KB sortWordCount$6.class 2KB SecondSort$1.class 2KB updateStateByKeyWordCount$$anonfun$4$$anonfun$apply$1.class 2KB RDD2DataFrameReflection$1.class 2KB RDD2DataFrameReflection$$typecreator5$1.class 1KB RDD2DataFrameReflection$$anonfun$5.class 1KB parallelizeCollection$.class 1KB JsonDataSource$4.class 1KB updateStateByKeyWordCount$$anonfun$2.class 1KB DailyUV$$anonfun$2.class 1KB JsonDataSource$2.class 1KB JsonDataSource$3.class 1KB WordCountFlatMap$$anonfun$1.class 1KB WordCount$$anonfun$2.class 1KB DataFrameCreate$.class 1KB RDD2DataFrameReflection$2.class 1KB updateStateByKeyWordCount$$anonfun$3.class 1KB updateStateByKeyWordCount$1.class 1KB JsonDataSource$$anonfun$2.class 1KB JsonDataSource$$anonfun$3.class 1KB GroupTop3$1.class 1KB sortWordCount$5.class 1KB sortWordCount$4.class 1KB TransformBlackList$$anonfun$1.class 1KB TransformBlackList$$anonfun$2$$anonfun$3$$anonfun$apply$1.class 1KB WordCountCluster$1.class 1KB WordCountFlatMap$1.class 1KB updateStateByKeyWordCount$2.class 1KB SecondSort$2.class 1KB WordCountLocal$1.class 1KB sortWordCount$1.class 1KB WordCount$$anonfun$3.class 1KB updateStateByKeyWordCount$$anonfun$4$$anonfun$1.class 1KB TransformBlackList$1.class 1KB WordCountFlatMap$$anonfun$WordCountFlatMap$1.class 1KB WordCountCluster$2.class 1KB WordCountLocal$2.class 1KB sortWordCount$2.class 1KB parallelizeCollection$$anonfun$1.class 1KB parallelizeCollection$1.class 1KB WordCountCluster$3.class 1KB WordCountLocal$3.class 1KB sortWordCount$3.class 1KB RDD2DataFrameReflection$$anonfun$1.class 1KB WordCount$$anonfun$1.class 1KB DailyUV$$anonfun$3.class 1KB JsonDataSource$$anonfun$1.class 1KB JsonDataSource$1.class 1KB WordCountFlatMap$2.class 1KB SecondSort$3.class 1006B共 388 条
- 1
- 2
- 3
- 4
评论0
最新资源