![DSS](images/en_US/readme/DSS_logo.png)
====
[![License](https://img.shields.io/badge/license-Apache%202-4EB1BA.svg)](https://www.apache.org/licenses/LICENSE-2.0.html)
English | [中文](README-ZH.md)
## Introduction
DataSphere Studio (DSS for short) is WeDataSphere, a one-stop data application development management portal developed by WeBank.
With the pluggable integrated framework design and the Linkis, a computing middleware, DSS can easily integrate various upper-layer data application systems, making data development simple and easy to use.
DataSphere Studio is positioned as a data application development portal, and the closed loop covers the entire process of data application development. With a unified UI, the workflow-like graphical drag-and-drop development experience meets the entire lifecycle of data application development from data import, desensitization cleaning, data analysis, data mining, quality inspection, visualization, scheduling to data output applications, etc.
With the connection, reusability, and simplification capabilities of Linkis, DSS is born with financial-grade capabilities of high concurrency, high availability, multi-tenant isolation, and resource management.
## UI preview
Please be patient, it will take some time to load gif.
![DSS-V1.0 GIF](images/en_US/readme/DSS_gif.gif)
## Core features
### 1. One-stop, full-process application development management UI
DSS is highly integrated. Currently integrated components include(**DSS version compatibility for the above components, please visit: [Compatibility list of integrated components](README.md#4-integrated-data-application-components)**):
1. Data Development IDE Tool - [Scriptis](https://github.com/WeBankFinTech/Scriptis)
2. Data Visualization Tool - [Visualis](https://github.com/WeBankFinTech/Visualis) (Based on the open source project [Davinci](https://github.com/edp963/davinci ) contributed by CreditEase)
3. Data Quality Management Tool - [Qualitis](https://github.com/WeBankFinTech/Qualitis)
4. Workflow scheduling tool - [Schedulis](https://github.com/WeBankFinTech/Schedulis)
5. Data Exchange Tool - [Exchangis](https://github.com/WeBankFinTech/Exchangis)
6. Data Api Service - [DataApiService](https://github.com/WeBankFinTech/DataSphereStudio-Doc/blob/main/en_US/Using_Document/DataApiService_Usage_Documentation.md)
7. Streaming Application Development Management Tool - [Streamis](https://github.com/WeBankFinTech/Streamis)
8. One-stop machine Learning Platform - [Prophecis](https://github.com/WeBankFinTech/Prophecis)
9. Workflow Task Scheduling Tool - DolphinScheduler (**In Code Merging**)
10. Help documentation and beginner's guide - UserGuide (**In Code Merging**)
11. Data Model Center - DataModelCenter (**In development**)
**DSS version compatibility for the above components, please visit: [Compatibility list of integrated components](README.md#4-integrated-data-application-components)**.
With a pluggable framework architecture, DSS is designed to allow users to quickly integrate new data application tools, or replace various tools that DSS has integrated. For example, replace Scriptis with Zeppelin, and replace Schedulis with DolphinScheduler...
![DSS one-stop video](images/en_US/readme/onestop.gif)
### 2. AppConn, based on Linkis,defines a unique design concept
AppConn is the core concept that enables DSS to easily and quickly integrate various upper-layer web systems.
AppConn, an application connector, defines a set of unified front-end and back-end three-level integration protocols, allowing external data application systems to easily and quickly becoming a part of DSS data application development.
The three-level specifications of AppConn are: the first-level SSO specification, the second-level organizational structure specification, and the third-level development process specification.
DSS arranges multiple AppConns in series to form a workflow that supports real-time execution and scheduled execution. Users can complete the entire process development of data applications with simple drag and drop operations.
Since AppConn is integrated with Linkis, the external data application system shares the capabilities of resource management, concurrent limiting, and high performance. AppConn also allows sharable context across system level and thus makes external data application completely gets away from application silos.
### 3. Workspace, as the management unit
With Workspace as the management unit, it organizes and manages business applications of various data application systems, defines a set of common standards for collaborative development of workspaces across data application systems, and provides user role management capabilities.
### 4. Integrated data application components
DSS has integrated a variety of upper-layer data application systems by implementing multiple AppConns, which can basically meet the data development needs of users.
**If desired, new data application systems can also be easily integrated to replace or enrich DSS's data application development process.** [Click me to learn how to quickly integrate new application systems](https://github.com/WeBankFinTech/DataSphereStudio-Doc/blob/main/en_US/Development_Documentation/Third-party_System_Access_Development_Guide.md)
|Component | Description | DSS0.X compatible version (DSS0.9.1 recommended) | DSS1.0 compatible version (DSS1.1.0 recommended) |
| --------------- | -------------------------------------------------------------------- | --------- | ---------- |
| [**Linkis**](https://github.com/apache/incubator-linkis) | Computing middleware Apache Linkis, by providing standard interfaces such as REST/WebSocket/JDBC/SDK, upper-layer applications can easily connect and access underlying engines such as MySQL/Spark/Hive/Presto/Flink. | Linkis0.11.0 is recommended (**Released* *) | >= Linkis1.1.1 (**released**) |
| [**DataApiService**](https://github.com/WeBankFinTech/DataSphereStudio-Doc/blob/main/en_US/Using_Document/DataApiService_Usage_Documentation.md) | (DSS has built-in third-party application tools) data API service. The SQL script can be quickly published as a Restful interface, providing Rest access capability to the outside world. | Not supported | DSS1.1.0 recommended (**released**)|
| [**Scriptis**](https://github.com/WeBankFinTech/DataSphereStudio) | (DSS has built-in third-party application tools) support online writing of SQL, Pyspark, HiveQL and other scripts, and submit to [Linkis](https ://github.com/WeBankFinTech/Linkis) data analysis web tool. | Recommended DSS0.9.1 (**Released**) | Recommended DSS1.1.0 (**Released**) |
| [**Schedulis**](https://github.com/WeBankFinTech/Schedulis) | Workflow task scheduling system based on Azkaban secondary development, with financial-grade features such as high performance, high availability and multi-tenant resource isolation. | Recommended Schedulis0.6.1 (**released**) | >= Schedulis0.7.0 (**Released**) |
| **EventCheck** | (a third-party application tool built into DSS) provides signal communication capabilities across business, engineering, and workflow. | Recommended DSS0.9.1 (**Released**) | Recommended DSS1.1.0 (**Released**) |
| **SendEmai
没有合适的资源?快使用搜索试试~ 我知道了~
DataSphereStudio一站式数据应用开发管理门户 v1.1.2.zip
共2000个文件
java:1143个
vue:329个
js:258个
1.该资源内容由用户上传,如若侵权请联系客服进行举报
2.虚拟产品一经售出概不退款(资源遇到问题,请及时私信上传者)
2.虚拟产品一经售出概不退款(资源遇到问题,请及时私信上传者)
版权申诉
0 下载量 155 浏览量
2024-03-18
21:19:04
上传
评论
收藏 61.02MB ZIP 举报
温馨提示
DataSphereStudio一站式数据应用开发管理门户 v1.1.2.zip
资源推荐
资源详情
资源评论
收起资源包目录
DataSphereStudio一站式数据应用开发管理门户 v1.1.2.zip (2000个子文件)
demo.css 8KB
iconfont.css 5KB
style.css 2KB
index.css 767B
demo_index.html 79KB
index.html 1KB
DSSMigrateRestful.java 38KB
OrchestratorServiceImpl.java 36KB
DSSFlowServiceImpl.java 35KB
DSSWorkspaceServiceImpl.java 34KB
ApiServiceCoreRestfulApi.java 29KB
OrchestratorFrameworkServiceImpl.java 29KB
ApiServiceImpl.java 26KB
AssetServiceImpl.java 25KB
Status.java 24KB
Props.java 23KB
ImportDSSOrchestratorPluginImpl.java 23KB
ContextServiceImpl.java 22KB
WorkflowNodeServiceImpl.java 21KB
OrchestratorPluginServiceImpl.java 21KB
DefaultWorkFlowManager.java 21KB
DSSProjectServiceImpl.java 20KB
DSSFrameworkProjectServiceImpl.java 20KB
DataCheckerDao.java 20KB
ApiServiceQueryServiceImpl.java 20KB
FlowRestfulApi.java 19KB
SparkEtlRefExecutionOperation.java 19KB
DSSWorkspaceRestful.java 18KB
MigrateServiceImpl.java 17KB
WorkFlowExportServiceImpl.java 17KB
WorkFlowInputServiceImpl.java 17KB
ApiServiceExecuteRestfulApi.java 17KB
WorkspaceDBHelper.java 17KB
NodeRestfulApi.java 17KB
DSSFrameworkProjectRestfulApi.java 16KB
ApiConfigServiceImpl.java 15KB
LinkisNodeExecutionImpl.java 15KB
DSSFrameworkOrchestratorRestful.java 15KB
ExportDSSOrchestratorPluginImpl.java 15KB
AbstractAppConnManager.java 15KB
HttpClientUtil.java 13KB
HttpClientUtil.java 13KB
DSSWorkspaceUserRestful.java 13KB
DSSFlowEditLockManager.java 12KB
DevelopmentOperationUtils.java 12KB
FlowEntranceRestfulApi.java 11KB
CodeParser.java 11KB
OrchestratorIERestful.java 10KB
ExecuteCodeHelper.java 10KB
StringUtils.java 10KB
AzkabanDssJobType.java 10KB
BuildJobActionImpl.java 10KB
DateUtil.java 10KB
OrchestratorCopyJob.java 10KB
KnowledgeGuideAdminRestful.java 9KB
DssAdminUserServiceImpl.java 9KB
GuideCatalogServiceImpl.java 9KB
WorkflowPersistenceEngine.java 9KB
DSSProjectUserServiceImpl.java 9KB
AzkanbanBuilder.java 9KB
SSOHelper.java 9KB
ExecutionRequestRefContext.java 9KB
AppConnResourceServiceImpl.java 8KB
MetaInfoMapperImpl.java 8KB
AssetTblRestful.java 8KB
AppConnResourceServiceImpl.java 8KB
EventChecker.java 8KB
DssAdminDeptServiceImpl.java 8KB
PageGuideAdminRestful.java 8KB
PublishServiceImpl.java 8KB
NodeInputServiceImpl.java 8KB
ZipHelper.java 8KB
MdAnalysis.java 8KB
AzkabanWorkflowToRelSynchronizer.java 8KB
DSSProjectDO.java 8KB
AbstractDolphinSchedulerTokenManager.java 8KB
AsyncExecutionResponseRef.java 8KB
AbstractEventCheckReceiver.java 8KB
AppConnManagerRestfulApi.java 7KB
DssFrameworkAdminUserController.java 7KB
GuideGroupServiceImpl.java 7KB
DolphinSchedulerTokenManager_1_X.java 7KB
FlowExecutionRestfulApi.java 7KB
DSSWorkspacePrivRestful.java 7KB
ApiServiceVo.java 7KB
DataDruidFactory.java 7KB
SchedulisProjectCreationOperation.java 7KB
DSSOrchestratorInfo.java 7KB
DssProxyUserController.java 7KB
AppConnRefreshThread.java 7KB
DSSOrchestratorCopyInfo.java 7KB
WorkflowToAzkbanRelConverter.java 7KB
TestApiServiceDBOperation.java 7KB
OrchestratorConversionJob.java 7KB
LongTermRefExecutionOperation.java 6KB
DssJobManager.java 6KB
OrchestrationDevelopmentOperationUtils.java 6KB
DSSExceptionUtils.java 6KB
ThirdlyRequestRef.java 6KB
Builder.java 6KB
共 2000 条
- 1
- 2
- 3
- 4
- 5
- 6
- 20
资源评论
芝麻粒儿
- 粉丝: 6w+
- 资源: 2万+
上传资源 快速赚钱
- 我的内容管理 展开
- 我的资源 快来上传第一个资源
- 我的收益 登录查看自己的收益
- 我的积分 登录查看自己的积分
- 我的C币 登录后查看C币余额
- 我的收藏
- 我的下载
- 下载帮助
安全验证
文档复制为VIP权益,开通VIP直接复制
信息提交成功