spark-csv2mongodb：一个可扩展的库，允许使用spark 2.4.6将csv数据加载到mongodb中
需积分: 10 65 浏览量
2021-02-15
19:42:42
上传
评论
收藏 12.11MB ZIP 举报
spark-csv2mongodb-master.zip （39个子文件） 
spark-csv2mongodb-master project 
build.properties 19B plugins.sbt 56B .github workflows integration-test.yaml 2KB src test scala com org batch schemas SchemaManagerTest.scala 957B config files parser ParserTest.scala 927B readers CsvReaderTest.scala 1KB resources schemas parser movies_metadata.json 4KB data movies_metadata.csv 5KB integration_test run_spark_job.sh 678B spark_job_polling.sh 434B mongo_query.js 38B reader_config movies_metadata.json 1KB main scala com org batch utils Utils.scala 354B transformations BaseTransformation.scala 421B NoOpTransformation.scala 616B factory ReaderFactory.scala 1KB TransformationFactory.scala 1KB JobFactory.scala 881B WriterFactory.scala 1KB core SparkJob.scala 1KB writers MongoDBWriter.scala 519B BaseWriter.scala 350B types Management.scala 605B schemas SchemaManager.scala 4KB config JobConfig.scala 50B files Parser.scala 1KB GlobalConfig.scala 4KB jobs Csv2Mongo.scala 3KB Main.scala 426B readers CsvReader.scala 1KB BaseReader.scala 435B resources schemas Readme.md 1KB parser movies_metadata.json 4KB reader movies_metadata.json 2KB data movies_metadata.csv 32.85MB reader_config movies_metadata.json 242B build.sbt 2KB README.md 20B docker-compose.yaml 2KB资源评论
