基于FATE进行开发的联邦学习产品.zip

# FATE Test A collection of useful tools to running FATE's test. ## Testsuite Testsuite is used for running a collection of jobs in sequence. Data used for jobs could be uploaded before jobs are submitted and, optionally, be cleaned after jobs finish. This tool is useful for FATE's release test. ### command options ```bash fate_test suite --help ``` 1. include: ```bash fate_test suite -i <path1 contains *testsuite.json> ``` will run testsuites in *path1* like /AutoFL/examples/pipeline/hetro_sbt/ 2. exclude: ```bash fate_test suite -i <path1 contains *testsuite.json> -e <path2 to exclude> -e <path3 to exclude> ... ``` will run testsuites in *path1* but not in *path2* and *path3* 3. glob: ```bash fate_test suite -i <path1 contains *testsuite.json> -g "hetero*" ``` will run testsuites in sub directory start with *hetero* of *path1* 4. replace: ```bash fate_test suite -i <path1 contains *testsuite.json> -r '{"maxIter": 5}' ``` will find all key-value pair with key "maxIter" in <span class="title-ref">data conf</span> or <span class="title-ref">conf</span> or <span class="title-ref">dsl</span> and replace the value with 5 5. timeout: ```bash fate_test suite -i <path1 contains *testsuite.json> -m 3600 ``` will run testsuites in *path1* and timeout when job does not finish within 3600s; if tasks need more time, use a larger threshold 6. task-cores ```bash fate_test suite -i <path1 contains *testsuite.json> -p 4 ``` will run testsuites in *path1* with EGGROLL "task-cores" set to 4; only effective for DSL conf 7. update-job-parameters ```bash fate_test suite -i <path1 contains *testsuite.json> -uj {} ``` will run testsuites in *path1* with respective job parameters set to provided values 8. update-component-parameters ```bash fate_test suite -i <path1 contains *testsuite.json> -uc {} ``` will run testsuites in *path1* with respective component parameters set to provided values 9. skip-dsl-jobs: ```bash fate_test suite -i <path1 contains *testsuite.json> --skip-dsl-jobs ``` will run testsuites in *path1* but skip all *tasks* in testsuites. It's would be useful when only pipeline tasks needed. 10. skip-pipeline-jobs: ```bash fate_test suite -i <path1 contains *testsuite.json> --skip-pipeline-jobs ``` will run testsuites in *path1* but skip all *pipeline tasks* in testsuites. It's would be useful when only dsl tasks needed. 11. skip-data: ```bash fate_test suite -i <path1 contains *testsuite.json> --skip-data ``` will run testsuites in *path1* without uploading data specified in *testsuite.json*. 12. data only: ```bash fate_test suite -i <path1 contains *testsuite.json> --data-only ``` will only upload data specified in *testsuite.json* without running jobs 13. disable-clean-data: ```bash fate_test suite -i <path1 contains *testsuite.json> --disable-clean-data ``` will run testsuites in *path1* without removing data from storage after tasks finish 14. enable-clean-data: ```bash fate_test suite -i <path1 contains *testsuite.json> --enable-clean-data ``` will remove data from storage after finishing running testsuites 15. yes: ```bash fate_test suite -i <path1 contains *testsuite.json> --yes ``` will run testsuites in *path1* directly, skipping double check ### testsuite configuration Configuration of jobs should be specified in a testsuite whose file name ends with "\*testsuite.json". For testsuite examples, please refer [dsl examples](../../examples/dsl/v2) and [pipeline examples](../../examples/dsl/pipeline). A testsuite includes the following elements: - data: list of local data to be uploaded before running FATE jobs - file: path to original data file to be uploaded, should be relative to testsuite or FATE installation path - head: whether file includes header - partition: number of partition for data storage - table\_name: table name in storage - namespace: table namespace in storage - role: which role to upload the data, as specified in fate\_test.config; naming format is: "{role\_type}\_{role\_index}", index starts at 0 ```json "data": [ { "file": "examples/data/motor_hetero_host.csv", "head": 1, "partition": 8, "table_name": "motor_hetero_host", "namespace": "experiment", "role": "host_0" } ] ``` - tasks: includes arbitrary number of jobs with paths to corresponding dsl and conf files - job: name of job to be run, must be unique within each group list - conf: path to conf filw, should be relative to testsuite - dsl: path to dsl file, should be relative to testsuite ```json "tasks": { "cv": { "conf": "hetero_lr_cv_conf.json", "dsl": "hetero_lr_cv_dsl.json" }, "early-stop": { "conf": "hetero_lr_early_stop_conf.json", "dsl": "hetero_lr_early_stop_dsl.json" } } ``` - pipeline\_tasks: includes arbitrary number of pipeline jobs with paths to corresponding python script - job: name of job to be run, must be unique within each group list - script: path to pipeline script, should be relative to testsuite ```json "pipeline_tasks": { "cv": { "script": "pipeline-hetero-lr-cv.py" }, "normal": { "script": "pipeline-hetero-lr-early-stop.py" } } ``` - model\_deps(deps): model to be used for prediction task ```json "tasks": { "cv": { "conf": "hetero_lr_cv_conf.json", "dsl": "hetero_lr_cv_dsl.json" }, "normal": { "conf": "hetero_lr_normal_conf.json", "dsl": "hetero_lr_normal_dsl.json" }, "predict": { "conf": "hetero-lr-normal-predict-conf.json", "dsl": "hetero-lr-normal-predict-dsl.json", "deps": "normal" } } ``` - data\_deps: component output data from previous task to be used as designated input for current task(only used for dsl tasks) ```json "tasks": { "column-expand": { "conf": "./test_column_expand_job_conf.json", "dsl": "./test_column_expand_job_dsl.json" }, "column-expand-train": { "conf": "./test_column_expand_train_job_conf.json", "dsl": "./test_column_expand_train_job_dsl.json", "data_deps": { "column-expand": { "guest_0": { "reader_0": "column_expand_0" } } } } ``` } - cache\_deps: component output cache from previous task to be used as designated cache loader input for current task(only used for intersect dsl tasks) ```json "tasks": { "intersect-cache": { "conf": "./test_intersect_cache_job_conf.json", "dsl": "./test_intersect_cache_job_dsl.json" }, "intersect-cache-loader": { "conf": "./test_intersect_cache_loader_job_conf.json", "dsl": "./test_intersect_cache_loader_job_dsl.json