This [dbt](https://github.com/fishtown-analytics/dbt) package contains macros that can be (re)used across dbt projects.
## Installation Instructions
Check [dbt Hub](https://hub.getdbt.com/fishtown-analytics/dbt_utils/latest/) for the latest installation instructions, or [read the docs](https://docs.getdbt.com/docs/package-management) for more information on installing packages.
----
## Contents
**[Schema tests](#schema-tests)**
- [equal_rowcount](#equal_rowcount-source)
- [equality](#equality-source)
- [expression_is_true](#expression_is_true-source)
- [recency](#recency-source)
- [at_least_one](#at_least_one-source)
- [not_constant](#not_constant)
- [cardinality_equality](#cardinality_equality-source)
- [unique_where](#unique_where-source)
- [not_null_where](#not_null_where-source)
- [relationships_where](#relationships_where-source)
- [mutually_exclusive_ranges](#mutually_exclusive_ranges-source)
- [unique_combination_of_columns](#unique_combination_of_columns-source)
**[Macros](#macros)**
- [Introspective macros](#introspective-macros):
- [get_column_values](#get_column_values-source)
- [get_relations_by_pattern](#get_relations_by_pattern-source)
- [get_relations_by_prefix](#get_relations_by_prefix-source)
- [get_query_results_as_dict](#get_query_results_as_dict-source)
- [SQL generators](sql-generators)
- [date_spine](#date-spine_source)
- [haversine_distance](haversine_distance-source)]
- [group_by](#group_by-source)
- [star](#star-source)
- [union_relations](#union_relations-source)
- [generate_series](#generate_series-source)
- [surrogate_key](#surrogate_key-source)
- [safe_add](#safe_add-source)
- [pivot](#pivot-source)
- [unpivot](#unpivot-source)
- [Web macros](#web-macros)
- [get_url_parameter](#get_url_parameter-source)
- [get_url_host](#get_url_host-source)
- [get_url_path](#get_url_path-source)
- [Cross-database macros](#cross-database-macros):
- [current_timestamp](#current_timestamp-source)
- [dateadd](#date_add-source)
- [datediff](#datadiff-source)
- [split_part](#split_part-source)
- [last_day](#last_day-source)
- [width_bucket](#width_bucket-source)
- [Logger](#logger)
- [pretty_time](#pretty_time-source)
- [pretty_log_format](#pretty_log_format-source)
- [log_info](#log_info-source)
[Materializations](#materializations):
- [insert_by_period](#insert_by_period-source)
---
### Schema Tests
#### equal_rowcount ([source](macros/schema_tests/equal_rowcount.sql))
This schema test asserts the that two relations have the same number of rows.
**Usage:**
```yaml
version: 2
models:
- name: model_name
tests:
- dbt_utils.equal_rowcount:
compare_model: ref('other_table_name')
```
#### fewer_rows_than ([source](macros/schema_tests/fewer_rows_than.sql))
This schema test asserts that this model has fewer rows than the referenced model.
Usage:
```yaml
version: 2
models:
- name: model_name
tests:
- dbt_utils.fewer_rows_than:
compare_model: ref('other_table_name')
```
#### equality ([source](macros/schema_tests/equality.sql))
This schema test asserts the equality of two relations. Optionally specify a subset of columns to compare.
**Usage:**
```yaml
version: 2
models:
- name: model_name
tests:
- dbt_utils.equality:
compare_model: ref('other_table_name')
compare_columns:
- first_column
- second_column
```
#### expression_is_true ([source](macros/schema_tests/expression_is_true.sql))
This schema test asserts that a valid sql expression is true for all records. This is useful when checking integrity across columns, for example, that a total is equal to the sum of its parts, or that at least one column is true.
**Usage:**
```yaml
version: 2
models:
- name: model_name
tests:
- dbt_utils.expression_is_true:
expression: "col_a + col_b = total"
```
The macro accepts an optional argument `condition` that allows for asserting
the `expression` on a subset of all records.
**Usage:**
```yaml
version: 2
models:
- name: model_name
tests:
- dbt_utils.expression_is_true:
expression: "col_a + col_b = total"
condition: "created_at > '2018-12-31'"
```
This macro can also be used at the column level. When this is done, the `expression` is evaluated against the column.
```yaml
version: 2
models:
- name: model_name
columns:
- name: col_a
tests:
- dbt_utils.expression_is_true:
expression: '>= 1'
- name: col_b
tests:
- dbt_utils.expression_is_true:
expression: '= 1'
condition: col_a = 1
```
#### recency ([source](macros/schema_tests/recency.sql))
This schema test asserts that there is data in the referenced model at least as recent as the defined interval prior to the current timestamp.
**Usage:**
```yaml
version: 2
models:
- name: model_name
tests:
- dbt_utils.recency:
datepart: day
field: created_at
interval: 1
```
#### at_least_one ([source](macros/schema_tests/at_least_one.sql))
This schema test asserts if column has at least one value.
**Usage:**
```yaml
version: 2
models:
- name: model_name
columns:
- name: col_name
tests:
- dbt_utils.at_least_one
```
#### not_constant ([source](macros/schema_tests/not_constant.sql))
This schema test asserts if column does not have same value in all rows.
**Usage:**
```yaml
version: 2
models:
- name: model_name
columns:
- name: column_name
tests:
- dbt_utils.not_constant
```
#### cardinality_equality ([source](macros/schema_tests/cardinality_equality.sql))
This schema test asserts if values in a given column have exactly the same cardinality as values from a different column in a different model.
**Usage:**
```yaml
version: 2
models:
- name: model_name
columns:
- name: from_column
tests:
- dbt_utils.cardinality_equality:
field: other_column_name
to: ref('other_model_name')
```
#### unique_where ([source](macros/schema_tests/unique_where.sql))
This test validates that there are no duplicate values present in a field for a subset of rows by specifying a `where` clause.
**Usage:**
```yaml
version: 2
models:
- name: my_model
columns:
- name: id
tests:
- dbt_utils.unique_where:
where: "_deleted = false"
```
#### not_null_where ([source](macros/schema_tests/not_null_where.sql))
This test validates that there are no null values present in a column for a subset of rows by specifying a `where` clause.
**Usage:**
```yaml
version: 2
models:
- name: my_model
columns:
- name: id
tests:
- dbt_utils.not_null_where:
where: "_deleted = false"
```
#### not_accepted_values ([source](macros/schema_tests/not_accepted_values.sql))
This test validates that there are no rows that match the given values.
Usage:
```yaml
version: 2
models:
- name: my_model
columns:
- name: city
tests:
- dbt_utils.not_accepted_values:
values: ['Barcelona', 'New York']
```
#### relationships_where ([source](macros/schema_tests/relationships_where.sql))
This test validates the referential integrity between two relations (same as the core relationships schema test) with an added predicate to filter out some rows from the test. This is useful to exclude records such as test entities, rows created in the last X minutes/hours to account for temporary gaps due to ETL limitations, etc.
**Usage:**
```yaml
version: 2
models:
- name: model_name
columns:
- name: id
tests:
- dbt_utils.relationships_where:
to: ref('other_model_name')
field: client_id
from_condition: id <> '4ca448b8-24bf-4b8
回测团队实力模型_Python_PLpgSQL_下载.zip （324个子文件） 
CODEOWNERS 16B bootstrap.min.css 133KB font-awesome.min.css 30KB customstyles.css 22KB syntax.css 4KB printstyles.css 3KB theme-blue.css 3KB theme-green.css 2KB modern-business.css 1KB boxshadowproperties.css 475B data_people.csv 8KB data_datediff.csv 572B data_url_path.csv 484B data_width_bucket.csv 399B data_surrogate_key.csv 353B data_unpivot_bool_expected.csv 300B data_unpivot_original_api_expected.csv 298B data_url_host.csv 270B data_unpivot_expected.csv 246B data_dateadd.csv 238B data_test_mutually_exclusive_ranges_with_gaps_zero_length.csv 179B data_unique_combination_of_columns.csv 162B data_hash.csv 156B data_unpivot.csv 152B data_urls.csv 152B data_unpivot_bool.csv 149B data_insert_by_period.csv 131B data_test_mutually_exclusive_ranges_with_gaps.csv 122B data_last_day.csv 119B data_date_spine.csv 107B data_union_expected.csv 102B data_right.csv 94B data_replace.csv 93B data_position.csv 92B data_test_sequential_timestamps.csv 81B data_split_part.csv 76B data_haversine_km.csv 73B data_haversine_mi.csv 73B data_length.csv 71B data_date_trunc.csv 66B data_union_events_expected.csv 59B data_safe_add.csv 59B data_union_table_2.csv 54B data_union_table_1.csv 52B data_test_not_accepted_values.csv 48B data_nullcheck_table.csv 46B data_concat.csv 43B data_get_query_results_as_dict.csv 42B data_star.csv 42B data_test_not_null_where.csv 42B data_test_unique_where.csv 41B data_generate_series.csv 38B data_cardinality_equality_b.csv 36B data_test_mutually_exclusive_ranges_no_gaps.csv 36B data_safe_cast.csv 31B data_pivot.csv 30B data_events_20180103.csv 29B data_events_20180102.csv 29B data_events_20180101.csv 29B data_get_column_values.csv 28B data_star_expected.csv 28B data_test_expression_is_true.csv 28B data_test_sequential_values.csv 28B data_pivot_expected.csv 26B data_cardinality_equality_a.csv 15B data_test_fewer_rows_than_table_2.csv 14B data_test_equal_rowcount.csv 12B data_test_not_constant.csv 12B data_test_fewer_rows_than_table_1.csv 12B data_test_relationships_where_table_1.csv 9B data_test_relationships_where_table_2.csv 9B data_test_at_least_one.csv 8B data_test_accepted_range.csv 8B data_cast_bool_to_text 29B fontawesome-webfont.eot 162KB fontawesome-webfont.eot 55KB glyphicons-halflings-regular.eot 20KB Gemfile 252B Gemfile 252B .gitattributes 84B .gitignore 2KB .gitignore 33B .gitignore 28B .gitignore 10B .gitkeep 0B .gitkeep 0B .gitkeep 0B .gitkeep 0B .gitkeep 0B .gitkeep 0B .gitkeep 0B
team-strength.html 46KB backtest.html 22KB cli.html 18KB understat.html 17KB db.html 15KB app.html 15KB index.html 12KB cli.html 10KB db.html 10KB共 324 条
- 1
- 2
- 3
- 4
资源评论
快撑死的鱼
- 粉丝: 1w+
- 资源: 9150
