apache-beam-integration-test

Apache Beam集成测试示例 安装步骤 创建虚拟环境 pip install --upgrade pip pip install --upgrade virtualenv pip install --upgrade setuptools virtualenv ENV . ENV/bin/activate pip install apache-beam[gcp, test] 设置环境变量 BUCKET= INPUT_SUB= OUTPUT_TOPIC= PROJECT= REGION=europe-west1 运行管道 使用DirectRunner运行管道 python pipeline.py \ --input_subscription "projects/$PROJECT/subscriptions/$INPUT_SUB" \ --output_topic "pro