<p align="center">
<a href="https://gnes.ai">
<img src=".github/gnes-github-banner.png?raw=true" alt="GNES Generic Neural Elastic Search, logo made by Han Xiao">
</a>
</p>
<p align="center">
<a href="https://cloud.drone.io/gnes-ai/gnes">
<img src="https://cloud.drone.io/api/badges/gnes-ai/gnes/status.svg" />
</a>
<a href="https://pypi.org/project/gnes/">
<img alt="PyPI" src="https://img.shields.io/pypi/v/gnes.svg">
</a>
<a href='https://doc.gnes.ai/'>
<img src='https://readthedocs.org/projects/gnes/badge/?version=latest' alt='Documentation Status' />
</a>
<a href="https://www.codacy.com/app/gnes-ai/gnes?utm_source=github.com&utm_medium=referral&utm_content=gnes-ai/gnes&utm_campaign=Badge_Grade">
<img src="https://api.codacy.com/project/badge/Grade/a9ce545b9f3846ba954bcd449e090984"/>
</a>
<a href="https://codecov.io/gh/gnes-ai/gnes">
<img src="https://codecov.io/gh/gnes-ai/gnes/branch/master/graph/badge.svg" />
</a>
<a href='https://github.com/gnes-ai/gnes/blob/master/LICENSE'>
<img alt="PyPI - License" src="https://img.shields.io/pypi/l/gnes.svg">
</a>
</p>
<p align="center">
<a href="#highlights">Highlights</a> â¢
<a href="#overview">Overview</a> â¢
<a href="#install-gnes">Install</a> â¢
<a href="#getting-started">Getting Started</a> â¢
<a href="#documentation">Documentation</a> â¢
<a href="#tutorial">Tutorial</a> â¢
<a href="#contributing">Contributing</a> â¢
<a href="./CHANGELOG.md">Release Notes</a> â¢
<a href="https://hanxiao.github.io/2019/07/29/Generic-Neural-Elastic-Search-From-bert-as-service-and-Go-Way-Beyond/">Blog</a>
</p>
<h2 align="center">What is it</h2>
GNES [<i>jee-nes</i>] is **Generic Neural Elastic Search**, a cloud-native semantic search system based on deep neural network.
GNES enables large-scale index and semantic search for **text-to-text**, **image-to-image**, **video-to-video** and *any-to-any* content form.
<h2 align="center">Highlights</h2>
<p align="center">
<a href="https://hanxiao.github.io/2019/07/29/Generic-Neural-Elastic-Search-From-bert-as-service-and-Go-Way-Beyond/">ð To know more about the key tenets of GNES, read this blog post</a>
</p>
<center>
<table>
<tr>
<th><h3>âï¸</h3><h3>Cloud-Native & Elastic</h3></th>
<th><h3>ð£</h3><h3>Easy-to-Use</h3></th>
<th><h3>ð¬</h3><h3>State-of-the-Art</h3></th>
</tr>
<tr>
<td width="33%"><sub>GNES is <i>all-in-microservice</i>! Encoder, indexer, preprocessor and router are all running in their own containers. They communicate via versioned APIs and collaborate under the orchestration of Docker Swarm/Kubernetes etc. Scaling, load-balancing, automated recovering, they come off-the-shelf in GNES.</sub></td>
<td width="33%"><sub>How long would it take to deploy a change that involves just switching a layer in VGG? In GNES, this is just one line change in a YAML file. We abstract the encoding and indexing logic to a YAML config, so that you can change or stack encoders and indexers without even touching the codebase.</sub></td>
<td width="33%"><sub>Taking advantage of fast-evolving AI/ML/NLP/CV communities, we learn from best-of-breed deep learning models and plug them into GNES, making sure you always enjoy the state-of-the-art performance.</sub></td>
</tr>
<tr>
<th><h3>ð</h3><h3>Generic & Universal</h3></th>
<th><h3>ð¦</h3><h3>Model as Plugin</h3></th>
<th><h3>ð¯</h3><h3>Best Practice</h3></th>
</tr>
<tr>
<td width="33%"><sub>Searching for texts, image or even short-videos? Using Python/C/Java/Go/HTTP as the client? Doesn't matter which content form you have or which language do you use, GNES can handle them all. </sub></td>
<td width="33%"><sub>When built-in models do not meet your requirments, simply build your own with <i>one Python file and one YAML file</i>. No need to rebuilt GNES framework, as your models will be loaded as plugins and directly rollout online.</sub></td>
<td width="33%"><sub>We love to learn the best practice from the community, helping our GNES to achieve the next level of availability, resiliency, performance, and durability. If you have any ideas or suggestions, feel free to contribute.</sub></td>
</tr>
</table>
</center>
<h2 align="center">Overview</h2>
<p align="center">
<a href="https://gnes.ai">
<img src=".github/gnes-component-overview.svg" alt="component overview">
</a>
</p>
<h2 align="center">Install GNES</h2>
There are two ways to get GNES, either as a Docker image or as a PyPi package. **For cloud users, we highly recommend using GNES via Docker**.
### Run GNES as a Docker Container
```bash
docker run gnes/gnes:latest-alpine
```
This command downloads the latest GNES image (based on [Alpine Linux](https://alpinelinux.org/)) and runs it in a container. When the container runs, it prints an informational message and exits.
#### ð¡ Choose the right GNES image
Besides the `alpine` image optimized for the space, we also provide Buster (Debian 10.0), Ubuntu 18.04 and Ubuntu 16.04-based images. The table below summarizes [all available GNES tags](https://cloud.docker.com/u/gnes/repository/docker/gnes/gnes). One can fill in `{ver}` with `latest`, `stable` or `v0..xx`. `latest` refers to the **latest master** of this repository, which [may not be stable](./CONTRIBUTING.md#Merging-Process). We recommend you to use an official release by changing the `latest` to a version number, say `v0.0.24`, or simply using `stable` for the last release, e.g. `gnes:stable-ubuntu`
<table>
<tr>
<th>Tag</th>
<th>Size and layers</th>
<th>Description</th>
</tr>
<tr>
<td><code>{ver}-alpine</code></td>
<td><a href="https://microbadger.com/images/gnes/gnes:latest-alpine" title="Get your own image badge on microbadger.com"><img src="https://images.microbadger.com/badges/image/gnes/gnes:latest-alpine.svg"></a></td>
<td>based on Alpine Linux;<br>no deep learning libraries;<br>extremely lightweight and portable, enables fast scaling on even edge devices.</td>
</tr>
<tr>
<td><code>{ver}-buster</code></td>
<td><a href="https://microbadger.com/images/gnes/gnes:latest-buster" title="Get your own image badge on microbadger.com"><img src="https://images.microbadger.com/badges/image/gnes/gnes:latest-buster.svg"></a></td>
<td>based on Debian 10.0;<br>no deep learning libraries;<br>recommended for building or extending a GNES-Hub image.</td>
</tr>
<tr>
<td><code>{ver}-ubuntu18</code></td>
<td><a href="https://microbadger.com/images/gnes/gnes:latest-ubuntu18" title="Get your own image badge on microbadger.com"><img src="https://images.microbadger.com/badges/image/gnes/gnes:latest-ubuntu18.svg"></a></td>
<td>based on Ubuntu 18.04;<br>no deep learning libraries.</td>
</tr>
<tr>
<td><code>{ver}-full</code></td>
<td><a href="https://microbadger.com/images/gnes/gnes:latest-full" title="Get your own image badge on microbadger.com"><img src="https://images.microbadger.com/badges/image/gnes/gnes:latest-full.svg"></a></td>
<td>based on Ubuntu 16.04;<br>python-3.6.8, cuda-10.0, tf1.14, pytorch1.1, faiss, multiple pretrained models; <br>heavy but self-contained, useful in testing GNES end-to-endly.</td>
</tr>
</table>
We also provide a public mirror hosted on Tencent Cloud, from which Chinese mainland users can pull the image faster.
```bash
docker login --username=xxx ccr.ccs.tencentyun.com # login to Tencent Cloud so that we can pull from it
docker run ccr.ccs.tencentyun.com/gnes/gnes:latest-alpine
```
The table below shows the status of the build pipeline.
<table>
<tr><th>Registry</th><th>Build status</th></tr>
<tr>
<td><sub>Docker Hub</sub><br><code>gnes/gnes:[tag]</code></td>
<td><a href="https://drone.gnes.ai/gnes-ai/gnes"><img src="https://drone.gnes.ai/api/badges/gnes-ai/gnes/status.svg" /></a></td>
</tr>
<tr>
<td><sub>Tencent Cloud</sub><br><code>ccr.ccs.tencentyun.com/gnes/gnes:[tag]</code></td>
<td><a href="http://193.112
没有合适的资源?快使用搜索试试~ 我知道了~
PyPI 官网下载 | gnes-0.0.29.tar.gz
1.该资源内容由用户上传,如若侵权请联系客服进行举报
2.虚拟产品一经售出概不退款(资源遇到问题,请及时私信上传者)
2.虚拟产品一经售出概不退款(资源遇到问题,请及时私信上传者)
版权申诉
0 下载量 145 浏览量
2022-01-11
12:38:09
上传
评论
收藏 129KB GZ 举报
温馨提示
共154个文件
py:137个
txt:5个
pyx:2个
资源来自pypi官网。 资源全名:gnes-0.0.29.tar.gz
资源推荐
资源详情
资源评论
收起资源包目录
PyPI 官网下载 | gnes-0.0.29.tar.gz (154个子文件)
setup.cfg 38B
gnes-board.html 29KB
MANIFEST.in 34B
README.md 28KB
not-zip-safe 1B
PKG-INFO 35KB
PKG-INFO 35KB
gnes_pb2.py 50KB
base.py 27KB
test_router.py 18KB
inception_v4.py 18KB
helper.py 17KB
base.py 17KB
parser.py 16KB
__init__.py 15KB
model.py 11KB
helper.py 10KB
test_image_preprocessor.py 9KB
ffmpeg.py 7KB
test_yaml.py 6KB
__init__.py 6KB
indexer.py 6KB
incep_mixture.py 6KB
sliding_window.py 6KB
hash.py 5KB
test_stream_grpc.py 5KB
http.py 5KB
__init__.py 5KB
key_only.py 5KB
test_encoder.py 5KB
test_video_preprocessor.py 4KB
gpt.py 4KB
model.py 4KB
segmentation.py 4KB
base.py 4KB
base.py 4KB
gnes_pb2_grpc.py 4KB
frontend.py 4KB
setup.py 4KB
__init__.py 4KB
test_onnx_image_encoder.py 4KB
test_service_mgr.py 4KB
test_image_encoder.py 4KB
annoy.py 4KB
leveldb.py 3KB
faiss.py 3KB
inception_utils.py 3KB
shotdetect.py 3KB
flask.py 3KB
inception.py 3KB
test_batching.py 3KB
cli.py 3KB
torch_transformers.py 3KB
test_load_dump_pipeline.py 3KB
test_grpc_service.py 3KB
base.py 3KB
cvae.py 3KB
vlad.py 3KB
pq.py 3KB
pca.py 3KB
test_preprocessor.py 3KB
encoder.py 3KB
__init__.py 3KB
tf_pq.py 3KB
test_bindexer.py 3KB
test_compose.py 3KB
grpc.py 3KB
base.py 2KB
api.py 2KB
elmo.py 2KB
numpy.py 2KB
bert.py 2KB
onnx.py 2KB
doc_sum.py 2KB
w2v.py 2KB
test_leveldbindexerasync.py 2KB
test_simple_indexer.py 2KB
benchmark.py 2KB
base.py 2KB
base.py 2KB
router.py 2KB
chunk_sum.py 2KB
audio_vanilla.py 2KB
flair.py 2KB
test_leveldbindexer.py 2KB
chunk.py 2KB
test_pretrain_encoder.py 2KB
test_euclidean_indexer.py 2KB
simple.py 2KB
test_audio_preprocessor.py 2KB
test_video_shotdetect_preprocessor.py 2KB
concat.py 2KB
__init__.py 2KB
mfcc.py 2KB
document.py 2KB
__init__.py 2KB
test_hash_indexer.py 2KB
base.py 2KB
preprocessor.py 2KB
test_hash_encoder.py 1KB
共 154 条
- 1
- 2
资源评论
挣扎的蓝藻
- 粉丝: 13w+
- 资源: 15万+
上传资源 快速赚钱
- 我的内容管理 展开
- 我的资源 快来上传第一个资源
- 我的收益 登录查看自己的收益
- 我的积分 登录查看自己的积分
- 我的C币 登录后查看C币余额
- 我的收藏
- 我的下载
- 下载帮助
最新资源
- 批量word文件内容替换工具1.0 (批量实现多个 Word 文档文件文字替换利器).exe
- Cartoon GUI Pack 1.2.zip
- 【数据集和代码】基于加速度传感器的步态识别行人分类实验(可做步态识别)
- 我分享个魔兽内存修改器
- Python毕业设计基于Django的网易云数据分析可视化大屏系统的设计与实现+使用说明+全部资料(优秀项目).zip
- mp3 idv2,idv1,frame分析工具
- Python毕业设计基于Django的网易云数据分析可视化大屏系统的设计与实现+使用说明+全部资料(高分项目).zip
- 人工兔优化算法ARO MATLAB源码, 应用案例为函数极值求解以及优化svm进行分类,代码注释详细,可结合自身需求进行应用
- 人才网站设计-asp.net+sql-(系统源码)
- asp.net+sql人才网站设计-含系统源码
资源上传下载、课程学习等过程中有任何疑问或建议,欢迎提出宝贵意见哦~我们会及时处理!
点击此处反馈
安全验证
文档复制为VIP权益,开通VIP直接复制
信息提交成功