# Spark-TPC-DS
Spark job for the TPC-DS benchmark.
This code uses this library from Databricks: https://github.com/databricks/spark-sql-perf
To compile put the jar compiled from the above library in lib/ and then run `build/sbt assembly`
To execute the following arguments must be provided:
1. HDFS data location ("/user/test/tpcds-data")
2. scale factor (10)
3. HDFS result location ("/user/test/tpcds-results")
4. N. iterations
5. query to execute:
- impalakit
- interactive
- reporting
- deepAnalytics
- simple
6. dsdgenDir
Spark-TPC-DS:用于 TPC-DS 基准测试的 Spark 作业
需积分: 50 156 浏览量
2021-05-30
10:05:27
上传
评论
收藏 13KB ZIP 举报
Spark-TPC-DS-master.zip （10个子文件） 
Spark-TPC-DS-master 
.gitignore 185B README.md 538B build.sbt 914B LICENSE 11KB src main scala fr eurecom dsg spark main.scala 2KB build sbt-launch-lib.bash 5KB sbt 4KB lib 
spark-sql-perf_2.10-0.0.1-SNAPSHOT.jar 77B project plugins.sbt 372B build.properties 79B
评论0