# Dinky
[![License](https://img.shields.io/badge/license-Apache%202-4EB1BA.svg?style=socialflat-square&)](https://www.apache.org/licenses/LICENSE-2.0.html)
[![Total Lines](https://img.shields.io/github/stars/DataLinkDC/dinky?style=socialflat-square&label=stars)](https://github.com/DataLinkDC/dinky/stargazers)
[![CN doc](https://img.shields.io/badge/文档-中文版-blue.svg?style=socialflat-square&)](README_zh_CN.md)
[![EN doc](https://img.shields.io/badge/document-English-blue.svg?style=socialflat-square&)](README.md)
[![Stargazers over time](https://starchart.cc/DataLinkDC/dinky.svg)](https://starchart.cc/DataLinkDC/dinky)
## Introduction
Dinky is an out-of-the-box, one-stop, real-time computing platform dedicated to the construction and practice of Unified Streaming & Batch and Unified Data Lake & Data Warehouse. Based on Apache Flink, Dinky provides the ability to connect many big data frameworks including OLAP and Data Lake.
## Feature
Its main features are as follows:
- Immersive Flink SQL Data Development: Dinky provides automatic prompt completion, syntax highlighting, statement beautification, online debugging, syntax verification, execution plan, MetaStore, lineage, version comparison, and more.
- Support FlinkSQL multi-version development and execution modes: Dinky supports multiple development and execution modes for FlinkSQL, including Local, Standalone, Yarn/Kubernetes Session, Yarn Per-Job, and Yarn/Kubernetes Application.
- Support FlinkSQL syntax enhancement: Dinky enhances FlinkSQL with features like database synchronization, execution environments, global variables, statement
merging, table-valued aggregate functions, load dependency, and row-level permissions.
- Supports real-time warehousing and lake entry of the entire FlinkCDC database, multi-database output, and automatic table creation.
- Support SQL job development: You can develop SQL jobs for various databases, including ClickHouse, Doris, Hive, MySQL, Oracle, Phoenix, PostgreSQL, Presto, SQL Server, StarRocks, and more.
- Support real-time online debugging:preview Table, ChangeLog, statistical chart and UDF.
- Support Flink Catalog, data source metadata online query and management.
- Support real-time task operation and maintenance: Online and offline, job information, cluster information, job snapshot, exception information, data map, data exploration, historical version, alarm record, etc.
- Support as multi-version FlinkSQL Server and OpenApi capability.
- Support real-time job alarm and alarm group: DingTalk, WeChat, Feishu, E-mail, etc.
- Support automatically managed SavePoint/CheckPoint recovery and triggering mechanisms: latest, earliest, specified, etc.
- Support resource management: Cluster instance, cluster configuration, jar, data source, alarm group, alarm instance, document, global variable, system configuration, etc.
- Support enterprise-level management: multi-tenant, user, role, project space.
- More hidden features await exploration by our users.
## Principle
![dinky_principle](https://raw.githubusercontent.com/DataLinkDC/dinky/dev/images/main/dinky_principle.png)
## Run the Screenshot
> FlinkSQL Studio
![datastudio](https://raw.githubusercontent.com/DataLinkDC/dinky/dev/images/070/datastudio.png)
> Grammar Check
![checksql](https://raw.githubusercontent.com/DataLinkDC/dinky/dev/images/070/checksql.png)
> Version Management
![versiondiff](https://raw.githubusercontent.com/DataLinkDC/dinky/dev/images/070/versiondiff.png)
> lineage
![lineage](https://raw.githubusercontent.com/DataLinkDC/dinky/dev/images/070/lineage.png)
> BI Charts
![charts](https://raw.githubusercontent.com/DataLinkDC/dinky/dev/images/070/charts.png)
> Metadata Query
![metadata](https://raw.githubusercontent.com/DataLinkDC/dinky/dev/images/070/metadata.png)
> Task Monitoring
![monitor](https://raw.githubusercontent.com/DataLinkDC/dinky/dev/images/070/monitor.png)
> Job Information
![jobinfo](https://raw.githubusercontent.com/DataLinkDC/dinky/dev/images/070/jobinfo.png)
## Participate in Contributions
[![PRs Welcome](https://img.shields.io/badge/PRs-welcome-brightgreen.svg?style=flat-square)](https://github.com/DataLinkDC/dinky/pulls)
Welcome to join the community, build a win-win situation, please refer to the contribution process: [How to contribute](https://github.com/DataLinkDC/dinky/blob/dev/docs/docs/developer_guide/contribution/how_contribute.md).
Thank you to all the people who already contributed to Dinky!
[![contrib graph](https://contrib.rocks/image?repo=DataLinkDC/dinky)](https://github.com/DataLinkDC/dinky/graphs/contributors)
## How to Deploy
- The dev branch is the 0.8 reconstructed version, which is still unstable.
- The 0.7 branch is the current stable version. Please use this branch for compilation and debugging.
See [source code compilation](https://github.com/DataLinkDC/dinky/blob/dev/docs/docs/deploy_guide/compile.mdx) and [installation and deployment](https://github.com/DataLinkDC/dinky/blob/dev/docs/docs/deploy_guide/deploy.mdx) for details.
## How to Upgrade
Due to the numerous functionalities, there are several bugs and optimization points that need attention.. It is strongly recommended to use or upgrade to the latest version.
Upgrade steps:
(1) Upgrade the app: Replace all dependencies of latest Dinky.
(2) Upgrade the DDL: Execute the relevant version upgrade statements in the sql/upgrade directory, and execute them in the order of the version numbers.
## Thanks
Standing on the shoulders of giants, Dinky was born. For this we express our heartfelt thanks to all the open source software used and its communities! We also hope that we are not only beneficiaries of open source, but also contributors to open source. We also hope that partners who share our enthusiasm and belief in open source will join us in contributing to the open-source community.
Below is a partial list of acknowledgements:
[Apache Flink](https://github.com/apache/flink)
[FlinkCDC](https://github.com/ververica/flink-cdc-connectors)
[Apache Flink Table Store](https://github.com/apache/flink-table-store)
[Apache Dolphinscheduler](https://github.com/apache/dolphinscheduler)
[Apache Doris](https://github.com/apache/doris)
[Druid](https://github.com/alibaba/druid)
[Ant-Design-Pro](https://github.com/ant-design/ant-design-pro)
[Mybatis Plus](https://github.com/baomidou/mybatis-plus)
[Monaco Editor](https://github.com/Microsoft/monaco-editor)
[Sa Token](https://github.com/dromara/Sa-Token)
[SpringBoot]()
Thanks to [JetBrains](https://www.jetbrains.com/?from=dlink) for providing a free open-source license.
[![JetBrains](https://raw.githubusercontent.com/DataLinkDC/dinky/dev/images/main/jetbrains.svg)](https://www.jetbrains.com/?from=dlink)
## Get Help
1.Create an issue and provide a clear description.
2.Visit the [official website](http://www.dinky.org.cn/#/) website to read the latest documentation manual.
3.It is recommended to scan the code to enter the DingTalk group.
<img src="https://raw.githubusercontent.com/DataLinkDC/dinky/dev/images/main/dinkydingding.jpg" alt="dinkydingding" style="zoom:30%;" />
4.Enter the WeChat user community group (recommended, add WeChat `wenmo_ai` to invite into the group) and QQ user community group (**543709668**) to communicate, and apply for the remarks "Dinky + company name + position".
5.Follow the WeChat public account to get the latest official articles: [Dinky Open Source](https://mmbiz.qpic.cn/mmbiz_jpg/dyicwnSlTFTp6w4PuJruFaLV6uShCJDkzqwtnbQJrQ90yKDuuIC8tyMU5DK69XZibibx7EPPBRQ3ic81se5UQYs21g/0?wx_fmt=jpeg).
6.Follow bilibili UP master (Shi Wen Mo A) to get the latest video teaching.
## Copyright
Please refer to the [LICENSE](https://github.com/DataLinkDC/dinky/blob/dev/LICENSE) document.
# Contributors
<a href="https://github.com/DataLinkDC/dinky/graphs/contributors">
<img src="https://contrib.rocks/image?repo=DataLinkDC/dinky" />
</a>
没有合适的资源?快使用搜索试试~ 我知道了~
Dinky一站式实时计算平台 v1.0.0.zip
共2000个文件
java:1095个
tsx:310个
md:302个
1.该资源内容由用户上传,如若侵权请联系客服进行举报
2.虚拟产品一经售出概不退款(资源遇到问题,请及时私信上传者)
2.虚拟产品一经售出概不退款(资源遇到问题,请及时私信上传者)
版权申诉
0 下载量 182 浏览量
2024-03-18
21:21:04
上传
评论
收藏 7.39MB ZIP 举报
温馨提示
Dinky一站式实时计算平台 v1.0.0.zip
资源推荐
资源详情
资源评论
收起资源包目录
Dinky一站式实时计算平台 v1.0.0.zip (2000个子文件)
mvnw.cmd 7KB
custom.css 9KB
index.module.css 3KB
styles.module.css 1KB
index.css 901B
org.dinky.metadata.driver.Driver 42B
org.dinky.metadata.driver.Driver 42B
org.dinky.metadata.driver.Driver 41B
org.dinky.metadata.driver.Driver 41B
org.dinky.metadata.driver.Driver 39B
org.dinky.metadata.driver.Driver 38B
org.dinky.metadata.driver.Driver 38B
org.dinky.metadata.driver.Driver 37B
org.dinky.metadata.driver.Driver 37B
org.dinky.metadata.driver.Driver 36B
.editorconfig 245B
org.apache.flink.table.factories.Factory 66B
说明.htm 4KB
YarnClusterDescriptor.java 82KB
YarnClusterDescriptor.java 81KB
YarnClusterDescriptor.java 81KB
YarnClusterDescriptor.java 78KB
YarnClusterDescriptor.java 75KB
DinkyMysqlCatalog.java 47KB
DinkyMysqlCatalog.java 47KB
DinkyMysqlCatalog.java 47KB
DinkyMysqlCatalog.java 47KB
DinkyMysqlCatalog.java 47KB
TaskServiceImpl.java 41KB
ExtractionUtils.java 38KB
AbstractJdbcDriver.java 35KB
Utils.java 31KB
Utils.java 30KB
Utils.java 30KB
Utils.java 28KB
Utils.java 26KB
RelMdColumnOrigins.java 22KB
RelMdColumnOrigins.java 22KB
RelMdColumnOrigins.java 22KB
RelMdColumnOrigins.java 22KB
RelMdColumnOrigins.java 22KB
Status.java 22KB
UserServiceImpl.java 22KB
CatalogueServiceImpl.java 20KB
UDFUtil.java 20KB
JobManager.java 20KB
AbstractSinkBuilder.java 19KB
ResourceServiceImpl.java 19KB
Explainer.java 18KB
SQLLineageBuilder.java 17KB
SchedulerServiceImpl.java 17KB
CheckPointOverView.java 17KB
Submitter.java 16KB
DataSourceController.java 16KB
YarnGateway.java 16KB
LineageUtils.java 16KB
PythonOptions.java 16KB
SystemConfiguration.java 15KB
CustomTableEnvironmentImpl.java 15KB
FlinkAPI.java 15KB
DataBaseServiceImpl.java 14KB
CustomTableEnvironmentImpl.java 14KB
CustomTableResultImpl.java 14KB
MapParseUtils.java 14KB
KubernetesClusterDescriptor.java 14KB
PrestoDriver.java 14KB
JobRefreshHandler.java 13KB
MenuServiceImpl.java 13KB
JdbcDynamicTableFactory.java 13KB
OssTemplate.java 13KB
ConfigFile.java 12KB
GitController.java 12KB
HiveDriver.java 12KB
ClusterInstanceServiceImpl.java 12KB
JobInstanceServiceImpl.java 12KB
JdbcLookupFunction.java 12KB
PaimonUtil.java 12KB
ClickHouseDriver.java 12KB
JobInstanceController.java 12KB
AbstractSqlSinkBuilder.java 12KB
SqlSelect.java 11KB
SqlSelect.java 11KB
SqlSelect.java 11KB
JobAlertHandler.java 11KB
KafkaSinkJsonBuilder.java 11KB
SqlSelect.java 11KB
SqlSelect.java 11KB
CDCSource.java 11KB
Executor.java 11KB
TaskService.java 11KB
MavenUtil.java 11KB
TokenService.java 11KB
MysqlCDCBuilder.java 11KB
VariableManager.java 11KB
PackagedProgramUtils.java 10KB
PackagedProgramUtils.java 10KB
PackagedProgramUtils.java 10KB
PackagedProgramUtils.java 10KB
PackagedProgramUtils.java 10KB
KubernetesApplicationGateway.java 10KB
共 2000 条
- 1
- 2
- 3
- 4
- 5
- 6
- 20
资源评论
芝麻粒儿
- 粉丝: 6w+
- 资源: 2万+
上传资源 快速赚钱
- 我的内容管理 展开
- 我的资源 快来上传第一个资源
- 我的收益 登录查看自己的收益
- 我的积分 登录查看自己的积分
- 我的C币 登录后查看C币余额
- 我的收藏
- 我的下载
- 下载帮助
安全验证
文档复制为VIP权益,开通VIP直接复制
信息提交成功