<h1 align="center">
<br>
<img height="300" src="https://github.com/go-skynet/LocalAI/assets/2420543/0966aa2a-166e-4f99-a3e5-6c915fc997dd"> <br>
LocalAI
<br>
</h1>
<p align="center">
<a href="https://github.com/go-skynet/LocalAI/fork" target="blank">
<img src="https://img.shields.io/github/forks/go-skynet/LocalAI?style=for-the-badge" alt="LocalAI forks"/>
</a>
<a href="https://github.com/go-skynet/LocalAI/stargazers" target="blank">
<img src="https://img.shields.io/github/stars/go-skynet/LocalAI?style=for-the-badge" alt="LocalAI stars"/>
</a>
<a href="https://github.com/go-skynet/LocalAI/pulls" target="blank">
<img src="https://img.shields.io/github/issues-pr/go-skynet/LocalAI?style=for-the-badge" alt="LocalAI pull-requests"/>
</a>
<a href='https://github.com/go-skynet/LocalAI/releases'>
<img src='https://img.shields.io/github/release/go-skynet/LocalAI?&label=Latest&style=for-the-badge'>
</a>
</p>
> :bulb: Get help - [âFAQ](https://localai.io/faq/) [ðDiscussions](https://github.com/go-skynet/LocalAI/discussions) [:speech_balloon: Discord](https://discord.gg/uJAeKSAGDy) [:book: Documentation website](https://localai.io/)
>
> [ð» Quickstart](https://localai.io/basics/getting_started/) [ð£ News](https://localai.io/basics/news/) [ ð« Examples ](https://github.com/go-skynet/LocalAI/tree/master/examples/) [ ð¼ï¸ Models ](https://localai.io/models/)
[![tests](https://github.com/go-skynet/LocalAI/actions/workflows/test.yml/badge.svg)](https://github.com/go-skynet/LocalAI/actions/workflows/test.yml)[![Build and Release](https://github.com/go-skynet/LocalAI/actions/workflows/release.yaml/badge.svg)](https://github.com/go-skynet/LocalAI/actions/workflows/release.yaml)[![build container images](https://github.com/go-skynet/LocalAI/actions/workflows/image.yml/badge.svg)](https://github.com/go-skynet/LocalAI/actions/workflows/image.yml)[![Bump dependencies](https://github.com/go-skynet/LocalAI/actions/workflows/bump_deps.yaml/badge.svg)](https://github.com/go-skynet/LocalAI/actions/workflows/bump_deps.yaml)[![Artifact Hub](https://img.shields.io/endpoint?url=https://artifacthub.io/badge/repository/localai)](https://artifacthub.io/packages/search?repo=localai)
**LocalAI** is a drop-in replacement REST API that's compatible with OpenAI API specifications for local inferencing. It allows you to run LLMs (and not only) locally or on-prem with consumer grade hardware, supporting multiple model families that are compatible with the ggml format, pytorch and more. Does not require GPU.
<p align="center"><b>Follow LocalAI </b></p>
<p align="center">
<a href="https://twitter.com/LocalAI_API" target="blank">
<img src="https://img.shields.io/twitter/follow/LocalAI_API?label=Follow: LocalAI_API&style=social" alt="Follow LocalAI_API"/>
</a>
<a href="https://discord.gg/uJAeKSAGDy" target="blank">
<img src="https://dcbadge.vercel.app/api/server/uJAeKSAGDy?style=flat-square&theme=default-inverted" alt="Join LocalAI Discord Community"/>
</a>
<p align="center"><b>Connect with the Creator </b></p>
<p align="center">
<a href="https://twitter.com/mudler_it" target="blank">
<img src="https://img.shields.io/twitter/follow/mudler_it?label=Follow: mudler_it&style=social" alt="Follow mudler_it"/>
</a>
<a href='https://github.com/mudler'>
<img alt="Follow on Github" src="https://img.shields.io/badge/Follow-mudler-black?logo=github&link=https%3A%2F%2Fgithub.com%2Fmudler">
</a>
</p>
<p align="center"><b>Share LocalAI Repository</b></p>
<p align="center">
<a href="https://twitter.com/intent/tweet?text=Check%20this%20GitHub%20repository%20out.%20LocalAI%20-%20Let%27s%20you%20easily%20run%20LLM%20locally.&url=https://github.com/go-skynet/LocalAI&hashtags=LocalAI,AI" target="blank">
<img src="https://img.shields.io/twitter/follow/_LocalAI?label=Share Repo on Twitter&style=social" alt="Follow _LocalAI"/></a>
<a href="https://t.me/share/url?text=Check%20this%20GitHub%20repository%20out.%20LocalAI%20-%20Let%27s%20you%20easily%20run%20LLM%20locally.&url=https://github.com/go-skynet/LocalAI" target="_blank"><img src="https://img.shields.io/twitter/url?label=Telegram&logo=Telegram&style=social&url=https://github.com/go-skynet/LocalAI" alt="Share on Telegram"/></a>
<a href="https://api.whatsapp.com/send?text=Check%20this%20GitHub%20repository%20out.%20LocalAI%20-%20Let%27s%20you%20easily%20run%20LLM%20locally.%20https://github.com/go-skynet/LocalAI"><img src="https://img.shields.io/twitter/url?label=whatsapp&logo=whatsapp&style=social&url=https://github.com/go-skynet/LocalAI" /></a> <a href="https://www.reddit.com/submit?url=https://github.com/go-skynet/LocalAI&title=Check%20this%20GitHub%20repository%20out.%20LocalAI%20-%20Let%27s%20you%20easily%20run%20LLM%20locally.
" target="blank">
<img src="https://img.shields.io/twitter/url?label=Reddit&logo=Reddit&style=social&url=https://github.com/go-skynet/LocalAI" alt="Share on Reddit"/>
</a> <a href="mailto:?subject=Check%20this%20GitHub%20repository%20out.%20LocalAI%20-%20Let%27s%20you%20easily%20run%20LLM%20locally.%3A%0Ahttps://github.com/go-skynet/LocalAI" target="_blank"><img src="https://img.shields.io/twitter/url?label=Gmail&logo=Gmail&style=social&url=https://github.com/go-skynet/LocalAI"/></a> <a href="https://www.buymeacoffee.com/mudler" target="_blank"><img src="https://cdn.buymeacoffee.com/buttons/default-orange.png" alt="Buy Me A Coffee" height="23" width="100" style="border-radius:1px"></a>
</p>
<hr>
In a nutshell:
- Local, OpenAI drop-in alternative REST API. You own your data.
- NO GPU required. NO Internet access is required either
- Optional, GPU Acceleration is available in `llama.cpp`-compatible LLMs. See also the [build section](https://localai.io/basics/build/index.html).
- Supports multiple models
- ð Once loaded the first time, it keep models loaded in memory for faster inference
- â¡ Doesn't shell-out, but uses C++ bindings for a faster inference and better performance.
LocalAI was created by [Ettore Di Giacinto](https://github.com/mudler/) and is a community-driven project, focused on making the AI accessible to anyone. Any contribution, feedback and PR is welcome!
Note that this started just as a [fun weekend project](https://localai.io/#backstory) in order to try to create the necessary pieces for a full AI assistant like `ChatGPT`: the community is growing fast and we are working hard to make it better and more stable. If you want to help, please consider contributing (see below)!
## ð¥ð¥ [Hot topics / Roadmap](https://localai.io/#-hot-topics--roadmap)
## ð [Features](https://localai.io/features/)
- ð [Text generation with GPTs](https://localai.io/features/text-generation/) (`llama.cpp`, `gpt4all.cpp`, ... [:book: and more](https://localai.io/model-compatibility/index.html#model-compatibility-table))
- ð£ [Text to Audio](https://localai.io/features/text-to-audio/)
- ð [Audio to Text](https://localai.io/features/audio-to-text/) (Audio transcription with `whisper.cpp`)
- ð¨ [Image generation with stable diffusion](https://localai.io/features/image-generation)
- ð¥ [OpenAI functions](https://localai.io/features/openai-functions/) ð
- ð§ [Embeddings generation for vector databases](https://localai.io/features/embeddings/)
- âï¸ [Constrained grammars](https://localai.io/features/constrained_grammars/)
- ð¼ï¸ [Download Models directly from Huggingface ](https://localai.io/models/)
## :book: ð¥ [Media, Blogs, Social](https://localai.io/basics/news/#media-blogs-social)
- [Create a slackbot for teams and OSS projects that answer to documentation](https://mudler.pm/posts/smart-slackbot-for-teams/)
- [LocalAI meets k8sgpt](https://www.youtube.com/watch?v=PKrDNuJ_dfE)
- [Question Answering on Documents locally with LangChain, LocalAI, Chroma, and GPT4All](https://mudler.pm/posts/localai-question-answering/)
- [Tutorial to use k8sgpt with LocalAI](https://medium.com/@tyler_97636/k8sgpt-localai-unlock-kubernetes-superpowers-for-free-584790de9b65)
## ð» U
没有合适的资源?快使用搜索试试~ 我知道了~
本地OpenAI:Go编写的项目是一个自托管、社区驱动的简单本地OpenAI兼容API
共356个文件
go:105个
md:39个
py:38个
1.该资源内容由用户上传,如若侵权请联系客服进行举报
2.虚拟产品一经售出概不退款(资源遇到问题,请及时私信上传者)
2.虚拟产品一经售出概不退款(资源遇到问题,请及时私信上传者)
版权申诉
0 下载量 40 浏览量
2023-11-18
09:53:57
上传
评论
收藏 712KB ZIP 举报
温馨提示
这个用Go编写的项目是一个自托管、社区驱动的简单本地OpenAI兼容API。它可以在使用消费级硬件的CPU上作为OpenAI的替代品运行,支持ggml兼容模型,例如:LLaMA、alpaca、gpt4all、vicuna、koala、gpt4all-j、cerebras.
资源推荐
资源详情
资源评论
收起资源包目录
本地OpenAI:Go编写的项目是一个自托管、社区驱动的简单本地OpenAI兼容API (356个子文件)
install_requirements.bat 3KB
start_windows.bat 3KB
cmd_windows.bat 792B
chat-completions -long-.bru 2KB
chat-completions -stream-.bru 469B
chat completion -simple- 1 message-.bru 462B
-completions.bru 371B
Generate image.bru 355B
add model gallery.bru 349B
-embeddings.bru 347B
model gallery apply.bru 340B
-tts.bru 333B
-edits.bru 324B
model gallery apply -gist-.bru 312B
backend-shutdown.bru 252B
delete model gallery.bru 243B
list MODELS in galleries.bru 153B
list model GALLERIES.bru 149B
backend monitor.bru 143B
get models list.bru 134B
localhost.bru 91B
Dockerfile.build 323B
grpc-server.cpp 76KB
Dockerfile 7KB
Dockerfile 479B
PY.Dockerfile 172B
Dockerfile 151B
JS.Dockerfile 140B
.dockerignore 80B
Earthfile 110B
.env 3KB
.env.example 2KB
.env.example 585B
.env.example 557B
.env.example 525B
.env.example 276B
.env.example 211B
.gitattributes 17B
.gitignore 603B
.gitignore 124B
.gitignore 60B
.gitignore 53B
.gitignore 43B
.gitignore 38B
.gitignore 20B
.gitignore 15B
.gitignore 8B
backend.pb.go 77KB
api_test.go 29KB
backend_grpc.pb.go 16KB
chat.go 13KB
main.go 13KB
gallery.go 9KB
models.go 9KB
request.go 8KB
json_schema.go 8KB
config.go 8KB
loader.go 8KB
api.go 8KB
initializers.go 7KB
llama.go 7KB
client.go 6KB
llama.go 6KB
completion.go 5KB
gallery.go 5KB
models_test.go 5KB
server.go 4KB
backend_monitor.go 4KB
options.go 4KB
image.go 4KB
llm.go 4KB
openai.go 4KB
options.go 4KB
json_schema_test.go 3KB
process.go 3KB
edit.go 2KB
base.go 2KB
rwkv.go 2KB
e2e_test.go 2KB
embeddings.go 2KB
embeddings.go 2KB
transcript.go 2KB
metrics.go 2KB
prediction.go 2KB
options.go 2KB
functions_test.go 2KB
tts.go 2KB
list.go 2KB
image.go 2KB
transcription.go 2KB
config_test.go 2KB
gpt4all.go 2KB
request.go 2KB
langchain.go 1KB
inference.go 1KB
uri.go 1KB
functions.go 1KB
langchain.go 1KB
uri_test.go 1KB
piper.go 1KB
共 356 条
- 1
- 2
- 3
- 4
资源评论
UnknownToKnown
- 粉丝: 1w+
- 资源: 575
上传资源 快速赚钱
- 我的内容管理 展开
- 我的资源 快来上传第一个资源
- 我的收益 登录查看自己的收益
- 我的积分 登录查看自己的积分
- 我的C币 登录后查看C币余额
- 我的收藏
- 我的下载
- 下载帮助
最新资源
- 基于Matlab人脸肤色定理的教师人数统计+源代码+全部数据+文档说明+详细注释+使用说明+截图(高分课程设计)
- 基于Matlab霍夫曼变换的表盘读数识别+源代码+全部数据+文档说明+详细注释+使用说明+截图(高分课程设计)
- 基于Matlab火灾烟雾检测源码带GUI界面+源代码+全部数据+文档说明+详细注释+使用说明+截图(高分课程设计)
- 基于Matlab的恶劣天气交通标志识别系统+源代码+全部数据+文档说明+详细注释+使用说明+截图(高分课程设计)
- 基于MATLAB的霍夫曼变换的表盘示数识别+源代码+全部数据+文档说明+详细注释+使用说明+截图(高分课程设计)
- 基于Matlab的车道线识别系统 +源代码+全部数据+文档说明+详细注释+使用说明+截图(高分课程设计)
- 基于MATLAB的教室人数统计系统带Gui界面+源代码+全部数据+文档说明+详细注释+使用说明+截图(高分课程设计)
- 基于MATLAB的教室人数统计系统带Gui界面+源代码+全部数据+文档说明+详细注释+使用说明+截图(高分课程设计)
- 基于MATLAB 的霍夫曼变换答题卡识别源码+全部数据+文档说明+详细注释+使用说明+截图(高分课程设计)
- 基于Matlab+bp神经网络的神经网络汉字识别系统+源代码+全部数据+文档说明+详细注释+使用说明+截图(高分课程设计)
资源上传下载、课程学习等过程中有任何疑问或建议,欢迎提出宝贵意见哦~我们会及时处理!
点击此处反馈
安全验证
文档复制为VIP权益,开通VIP直接复制
信息提交成功