没有合适的资源?快使用搜索试试~
我知道了~
文库首页
开发技术
其它
data_engineering_solutions
data_engineering_solutions
共27个文件
yaml:12个
py:5个
md:3个
Python
需积分: 5
0 下载量
89 浏览量
2021-04-12
04:12:17
上传
评论
收藏
105KB
ZIP
举报
温馨提示
立即下载
如何进行Bootcamp-数据工程 :rocket: 学习如何在大数据生态系统中构建数据工程产品。 数据基础架构即代码 CI / CD +测试 数据湖 Apache气流和流媒体 资料建模
资源详情
资源评论
收起资源包目录
data_engineering_solutions-main.zip
(27个子文件)
data_engineering_solutions-main
.github
workflows
2.jinja_test.yaml
792B
2.jinja_production.yaml
1KB
1.github_actions.yaml
3KB
.vscode
launch.json
650B
requirements.txt
50B
README.md
415B
2_continuous_integration_and_tests
2.jinja
process_template.py
878B
deploy.py
4KB
redshift.yaml.j2
6KB
config.yaml
628B
redshift-bkp.yaml
5KB
1.github_actions
bucket_github_actions.yaml
497B
deploy.py
3KB
tests
test_dummy.py
33B
requirements.txt
6B
.gitignore
2KB
1_infrastructure_as_code
0.yaml_vs_json
exemplo.json
196B
exemplo.yaml
135B
Readme.md
188B
4.kinesis
Readme.md
1KB
put_records_in_kinesis.py
1024B
kinesis.yaml
2KB
2.redshift
redshift.yaml
4KB
3.permissions
permissions.yaml
3KB
general_permission.yaml
3KB
1.bucket
bucket.yaml
935B
Final Architecture.png
81KB
共 27 条
1
评论
收藏
内容反馈
立即下载
评论0
去评论
最新资源
pod-tomcat.yaml
This module implements the Requests API.
Delphi 12 控件之unidac-10.2.1-d29pro.exe
keyword.other.package.java
Apple//DTD PLIST 1.0//EN
comment.block.documentation.rust
there is no way to distinguish perfectly
数据库管理工具:dbeaver-ce-24.0.2-x86-64-setup.exe
Objective-C.tmLanguage
数据库管理工具:dbeaver-ce-24.0.2-macos-x86-64.dmg
tafan
粉丝: 36
资源:
4652
私信
上传资源 快速赚钱
前往需求广场,查看用户热搜
相关推荐
data-engineering-projects
面罩评级预测 带有Selenium网络自动化功能的亚马逊对口罩产品的评论和评分被刮掉了。 使用python,numpy和pandas进行数据清理和EDA。 数据可视化seaborn和matplotlib。 使用NTLK处理和编码文本。 使用scikit-learn,keras和tensorflow建模,训练和测试神经网络。 在Heroku上进行流式部署的应用程序。 | |
data_engineering
项目简介: 这个项目是关于Postgres中的维度建模概念以及具有提取转换和加载数据的数据建模 数据库设计: 用于分析数据通过使用SQL和星型方案(也使用关系数据库),Sparkify还可以对其数据库执行广告分析。 ETL流程: 使用Sparkify分析他们的数据,创建了一个关系数据库架构,可以用ETL管道填充它。 所谓的星型方案使公司可以从多个维度查看用户行为。 事实表用于存储包含“ N
data-engineering
该存储库解决了数据工程中以下两个问题。 源代码使用Python。 您需要Python 2.7及更高版本才能运行该程序。 运行run.sh以在wc_output目录中查看输出。 在数据工程中遇到的第一个问题是字数统计,它从目录中获取一个文本文件或一组文本文件,并输出每个字的出现次数。 例如,包含以下段落的文件的字数统计: So call a big meeting, Get everyone
data-engineering-project
去做 设置Spark集群 设置hdfs集群 复制数据 预处理 分析数据 写报告
data_engineering:用于data_engineering
“#data_engineering”
Machine Learning, Optimization,Big Data_Third International Conference, MOD 2017
The key role of machine learning, reinforcement learning, artificial intelligence, large-scale optimization, and big data for developing solutions to some of the greatest challenges we are facing is .
Practical Data Science with Python3
As data science projects gets continuously larger and more complex, software engineering knowledge and experience is crucial to produce evolvable solutions. You'll see how to create maintainable ...
Cluster Analysis and Data Mining: An Introduction
Cluster analysis is used in data mining and is a common technique for statistical data analysis used in many fields of study, such as the medical & life sciences, behavioral & social sciences, ...
Scala: Guide for Data Science Professionals
• Build data science and data engineering solutions with ease • An in-depth look at each stage of the data analysis process — from reading and collecting data to distributed analytics • Explore a ...
4星 · 用户满意度95%
data-engineering-concepts
数据工程概念 数据工程技能和工具 语言:Python,SQL 数据库:Postgres,Mysql,AWS RDS,DynamoDB,RedShift,Apache Cassandra 建模:维度数据建模 批处理ETL:Python,SparkSQL 工作流管理:气流 数据工程项目/所学概念 资料建模 创建了关系和NoSQL数据模型,以适应数据使用者的各种需求。 使用ETL在Postgre
data_engineering_task
数据工程任务 数据工程任务包含Kafka和Spark示例项目。 Kafka示例项目 Kafka示例项目为Kafka应用程序开发和三个示例应用程序提供了完整的环境设置: CSV来源的数据生产者, Kafka Streams应用程序用于数据转换和 kafka使用者可以汇入PostgresDB。 可在/kafka_example文件夹中的README.md中找到启动Kafka示例项目的指南。 Sp
R for data science solutions
R for data science习题答案..................................................................
DEND-data-engineering
数据工程纳米度 朱俊 项目清单:
data-engineering-bootcamp
数据工程训练营
Big Data and Computational Intelligence in Networking-CRC(2018).pdf
Industry engineers from IT companies, service providers, content providers, network operators, and equipment manufacturers can get to know the engineering design issues and cor- responding solutions
Communication Protocol Engineering 2nd Edition pdf
The book aims to enable the reader to master the engineering of communication protocols, which are amply present nowadays in mobile phones, tablets, laptops, smart appliances, and service providers' .
Software Engineering with UML-CRC(2017).pdf
Rapidly changing tech- nologies for development, crunching time to produce working solutions, unpredictable business and legal environments, exploding data, cross-platform testing, globally dispersed
Mastering Data Mining with Python(PACKT,2016)
We will then implement example solutions using real-world data from the domain of software engineering, and we will spend time learning how to understand and interpret the results we get. By the end
4星 · 用户满意度95%
Introduction to Data Mining and its Applications
2.2 Evolving Data Mining into Solutions for Insights . . . . . . . . . . . 35 2.2.1 Trends and Challenges . . . . . . . . . . . . . . . . . . . . . . . . . . 36 2.3 Knowledge Extraction Through Data .
5星 · 资源好评率100%
gpu solutions to multi-scale problem in science and engineering
Editor: David A. Yuen Long Wang Xuebin Chi Lennart Johnsson Wei Ge Yaolin Shi
measurement and data analysis for engineering and science 电子书
first edition Patrick F.Dunn University of notre dame,indiana,usa
engineering-of-big-data-processing.pdf
engineering-of-big-data-processing.pdf
Robust solutions of LP contaminated with uncertain data.pdf
Robust solutions of LP contaminated with uncertain data.pdfRobust solutions of LP contaminated with uncertain data.pdfRobust solutions of LP contaminated with uncertain data.pdf
data-engineering-studies:使用PySpark的Python代码
数据工程研究 PySpark,CRUD等
Web Data Mining and the Development of Knowledge-Based Decision Systems2017
This book presents recent investigations and enhancements in the field of Decision Support Systems, Web Data Mining, web engineering, with specific emphasis on development of Decision Support Sys- ...
Mastering.Data.Mining.with.Python.1785889958
We will then implement example solutions using real-world data from the domain of software engineering, and we will spend time learning how to understand and interpret the results we get. By the end
Mobile Big Data: A Roadmap from Models to Technologies
It presents novel approaches and applications in which mobile big data is being applied from an engineering standpoint and addresses future theoretical and practical challenges related to the big ...
Empirical Modeling and Data Analysis for Engineers and Applied Scientists [2016]
This textbook teaches advanced undergraduate and first-year graduate students in Engineering and Applied Sciences to gather and analyze empirical observations (data) in order to aid in making design .
资源上传下载、课程学习等过程中有任何疑问或建议,欢迎提出宝贵意见哦~我们会及时处理!
点击此处反馈
安全验证
文档复制为VIP权益,开通VIP直接复制
信息提交成功
评论0
最新资源