<p>
This library makes working with kafka in python easy. It simplifies the producing of records. The producer class persists
fields so that the fields of a record can be retrieved in various places from within your code base.
</p>
<p>
The library that expands on the work of Confluent's kafka-python library to make an intuitive producer that simplifies coding. This producer acts as a Super Class that you can inherit all of your specific producers in your code. The implementation takes five lines of code
</p>
<ul>
<li>Set the KAFKA_REGISTRY_LISTENER and KAFKA_BROKER_LISTENER (2 lines of code)</li>
<li>from kp_fraydit.producers.producer import Producer</li>
<li>prod = Producer('my-topic')</li>
<li>prod.addValueArgs(myField1='test')</li>
</ul>
<p>
That is all that is needed to produce a record.
</p>
<p>
It utilizes Confluent's amazing Exact-Once Semantics(EOS) architecture. That assurance takes time, however. To speed up the library, all producer instances pool their records and then the records are parallel processed. This enhances the speed of the library while maintaining the EOS assurance. The sacrifice of this pooling loses the guarantee of order preservation. The library allows for individual producer instances to maintain a separate pool that ensures order.
</p>
<p>
The producer handles JSON and Avro schema automatically. Nested schema (Avro only) is handled. That means you can have records within records and the producer class knows how to handle that.
</p>
<p>
You can discover what fields are available, which fields are required, optional fields, specify optional fields that you want to include on each write, all from within the attributes of the producer.
</p>
https://fraydit.com
没有合适的资源?快使用搜索试试~ 我知道了~
温馨提示
共31个文件
py:22个
txt:3个
pkg-info:2个
资源分类:Python库 所属语言:Python 资源全名:kp_fraydit-0.1.12.tar.gz 资源来源:官方 安装方法:https://lanzao.blog.csdn.net/article/details/101784059
资源推荐
资源详情
资源评论
收起资源包目录
kp_fraydit-0.1.12.tar.gz (31个子文件)
kp_fraydit-0.1.12
PKG-INFO 2KB
pyproject.toml 255B
LICENSE 1KB
src
kp_fraydit.egg-info
PKG-INFO 2KB
SOURCES.txt 996B
top_level.txt 11B
dependency_links.txt 1B
kp_fraydit
metaclasses.py 340B
custom_types.py 701B
producers
producer.py 27KB
__init__.py 0B
log_producer.py 657B
logs
__init__.py 0B
connections
misc.py 229B
connection_observer.py 620B
__init__.py 0B
connection.py 17KB
DEPRECATED-connection_settings.py 3KB
root.py 65B
connectors
connector.py 1KB
__init__.py 0B
custom_errors.py 2KB
schemas
__init__.py 0B
__init__.py 0B
schema_client.py 14KB
datetime_functions.py 557B
admin.py 1KB
financial
__init__.py 0B
price_connector.py 1KB
setup.cfg 623B
README.md 2KB
共 31 条
- 1
资源评论
挣扎的蓝藻
- 粉丝: 13w+
- 资源: 15万+
上传资源 快速赚钱
- 我的内容管理 展开
- 我的资源 快来上传第一个资源
- 我的收益 登录查看自己的收益
- 我的积分 登录查看自己的积分
- 我的C币 登录后查看C币余额
- 我的收藏
- 我的下载
- 下载帮助
安全验证
文档复制为VIP权益,开通VIP直接复制
信息提交成功