# Milvus Metrics Dashboard
Milvus outputs a list of detailed time-series metrics during runtime. You can use [Prometheus](https://prometheus.io/) and [Grafana](https://grafana.com/) to visualize the metrics. This topic introduces the monitoring metrics displayed in the Grafana Milvus Dashboard.
We recommend reading [Milvus monitoring framework overview](monitor_overview.md) to understand Prometheus metrics first.
> The time unit in this topic is millisecond.
>
> And "99th percentile" in this topic refers to the fact that 99 percent of the time statistics are controlled within certain value.
<details><summary>Proxy</summary>
| Panel | Panel description | PromQL (Prometheus query language) | The Milvus metrics used | Milvus metrics description |
|---|---|---|---|---|
| Search Vector Count Rate | The average number of vectors queried per second by each proxy within the past two minutes. | ``` sum(increase(milvus_proxy_search_vectors_count{app_kubernetes_io_instance=~"$instance", app_kubernetes_io_name="$app_name", namespace="$namespace"}[2m])/120) by (pod, node_id) ``` | `milvus_proxy_search_vectors_count` | The accumulated number of vectors queried. |
| Insert Vector Count Rate | The average number of vectors inserted per second by each proxy within the past two minutes. | ``` sum(increase(milvus_proxy_insert_vectors_count{app_kubernetes_io_instance=~"$instance", app_kubernetes_io_name="$app_name", namespace="$namespace"}[2m])/120) by (pod, node_id) ``` | `milvus_proxy_insert_vectors_count` | The accumulated number of vectors inserted. |
| Search Latency | The average latency and the 99th percentile of the latency of receiving search and query requests by each proxy within the past two minutes. | p99: <br/> ``` histogram_quantile(0.99, sum by (le, query_type, pod, node_id) (rate(milvus_proxy_sq_latency_bucket{app_kubernetes_io_instance=~"$instance", app_kubernetes_io_name="$app_name", namespace="$namespace"}[2m]))) ``` <br/> avg: <br/> ``` sum(increase(milvus_proxy_sq_latency_sum{app_kubernetes_io_instance=~"$instance", app_kubernetes_io_name="$app_name", namespace="$namespace"}[2m])) by (pod, node_id, query_type) / sum(increase(milvus_proxy_sq_latency_count{app_kubernetes_io_instance=~"$instance", app_kubernetes_io_name="$app_name", namespace="$namespace"}[2m])) by (pod, node_id, query_type) ``` | `milvus_proxy_sq_latency` | The latency of search and query requests. |
| Wait Search Result Latency | The average latency and the 99th percentile of the latency between sending search and query requests and receiving results by proxy within the past two minutes. | p99: <br/> ``` histogram_quantile(0.99, sum by (le, query_type, pod, node_id) (rate(milvus_proxy_sq_wait_result_latency_bucket{app_kubernetes_io_instance=~"$instance", app_kubernetes_io_name="$app_name", namespace="$namespace"}[2m]))) ``` <br/> avg: <br/> ``` sum(increase(milvus_proxy_sq_wait_result_latency_sum{app_kubernetes_io_instance=~"$instance", app_kubernetes_io_name="$app_name", namespace="$namespace"}[2m])) by (pod, node_id, query_type) / sum(increase(milvus_proxy_sq_wait_result_latency_count{app_kubernetes_io_instance=~"$instance", app_kubernetes_io_name="$app_name", namespace="$namespace"}[2m])) by (pod, node_id, query_type) ``` | `milvus_proxy_sq_wait_result_latency` | The latency between sending search and query requests and receiving results. |
| Reduce Search Result Latency | The average latency and the 99th percentile of the latency of aggregating search and query results by proxy within the past two minutes. | p99: <br/> ``` histogram_quantile(0.99, sum by (le, query_type, pod, node_id) (rate(milvus_proxy_sq_reduce_result_latency_bucket{app_kubernetes_io_instance=~"$instance", app_kubernetes_io_name="$app_name", namespace="$namespace"}[2m]))) ``` <br/> avg: <br/> ``` sum(increase(milvus_proxy_sq_reduce_result_latency_sum{app_kubernetes_io_instance=~"$instance", app_kubernetes_io_name="$app_name", namespace="$namespace"}[2m])) by (pod, node_id, query_type) / sum(increase(milvus_proxy_sq_reduce_result_latency_count{app_kubernetes_io_instance=~"$instance", app_kubernetes_io_name="$app_name", namespace="$namespace"}[2m])) by (pod, node_id, query_type) ``` | `milvus_proxy_sq_reduce_result_latency` | The latency of aggregating search and query results returned by each query node. |
| Decode Search Result Latency | The average latency and the 99th percentile of the latency of decoding search and query results by proxy within the past two minutes. | p99: <br/> ``` histogram_quantile(0.99, sum by (le, query_type, pod, node_id) (rate(milvus_proxy_sq_decode_result_latency_bucket{app_kubernetes_io_instance=~"$instance", app_kubernetes_io_name="$app_name", namespace="$namespace"}[2m]))) ``` <br/> avg: <br/> ``` sum(increase(milvus_proxy_sq_decode_result_latency_sum{app_kubernetes_io_instance=~"$instance", app_kubernetes_io_name="$app_name", namespace="$namespace"}[2m])) by (pod, node_id, query_type) / sum(increase(milvus_proxy_sq_decode_resultlatency_count{app_kubernetes_io_instance=~"$instance", app_kubernetes_io_name="$app_name", namespace="$namespace"}[2m])) by (pod, node_id, query_type) ``` | `milvus_proxy_sq_decode_result_latency` | The latency of decoding each search and query result. |
| Msg Stream Object Num | The average, maximum, and minimum number of the msgstream objects created by each proxy on its corresponding physical topic within the past two minutes. | ``` avg(milvus_proxy_msgstream_obj_num{app_kubernetes_io_instance=~"$instance", app_kubernetes_io_name="$app_name", namespace="$namespace"}) by (pod, node_id) max(milvus_proxy_msgstream_obj_num{app_kubernetes_io_instance=~"$instance", app_kubernetes_io_name="$app_name", namespace="$namespace"}) by (pod, node_id) min(milvus_proxy_msgstream_obj_num{app_kubernetes_io_instance=~"$instance", app_kubernetes_io_name="$app_name", namespace="$namespace"}) by (pod, node_id) ``` | `milvus_proxy_msgstream_obj_num` | The number of msgstream objects created on each physical topic. |
| Mutation Req Latency | The average latency and the 99th percentile of the overall latency of receiving insertion or deletion requests by each proxy within the past two minutes. | p99: <br/> ``` histogram_quantile(0.99, sum by (le, msg_type, pod, node_id) (rate(milvus_proxy_mutation_latency_bucket{app_kubernetes_io_instance=~"$instance", app_kubernetes_io_name="$app_name", namespace="$namespace"}[2m]))) ``` <br/> avg: <br/> ``` sum(increase(milvus_proxy_mutation_latency_sum{app_kubernetes_io_instance=~"$instance", app_kubernetes_io_name="$app_name", namespace="$namespace"}[2m])) by (pod, node_id, msg_type) / sum(increase(milvus_proxy_mutation_latency_count{app_kubernetes_io_instance=~"$instance", app_kubernetes_io_name="$app_name", namespace="$namespace"}[2m])) by (pod, node_id, msg_type) ``` | `milvus_proxy_mutation_latency` | The latency of insertion or deletion requests. |
| Mutation Send Latency | The average latency and the 99th percentile of the latency of sending insertion or deletion requests by each proxy within the past two minutes. | p99: <br/> ``` histogram_quantile(0.99, sum by (le, msg_type, pod, node_id) (rate(milvus_proxy_mutation_send_latency_bucket{app_kubernetes_io_instance=~"$instance", app_kubernetes_io_name="$app_name", namespace="$namespace"}[2m]))) ``` <br/> avg: <br/> ``` sum(increase(milvus_proxy_mutation_send_latency_sum{app_kubernetes_io_instance=~"$instance", app_kubernetes_io_name="$app_name", namespace="$namespace"}[2m])) by (pod, node_id, msg_type) / sum(increase(milvus_proxy_mutation_send_latency_count{app_kubernetes_io_instance=~"$instance", app_kubernetes_io_name="$app_name", namespace="$namespace"}[2m])) by (pod, node_id, msg_type) ``` | `milvus_proxy_mutation_send_latency` | The latency of sending insertion or deletion requests. |
| Cache Hit Rate | The average cache hit rate of operations incl
开源向量数据库milvus v2.2.16.zip （2000个子文件） 
test_c_api.cpp 139KB test_expr.cpp 109KB ExecExprVisitor.cpp 71KB SegmentSealedImpl.cpp 32KB test_sealed.cpp 32KB test_query.cpp 28KB test_string_expr.cpp 24KB test_indexing.cpp 23KB PlanProto.cpp 23KB Utils.cpp 22KB MinioChunkManager.cpp 20KB SegmentGrowingImpl.cpp 19KB test_plan_proto.cpp 19KB test_retrieve.cpp 19KB Util.cpp 18KB ValidationUtil.cpp 18KB Parser.cpp 18KB index_c.cpp 16KB test_parquet_c.cpp 16KB test_data_codec.cpp 15KB Reduce.cpp 14KB parquet_c.cpp 14KB VectorDiskIndex.cpp 13KB Event.cpp 12KB test_integer_overflow.cpp 12KB DiskFileManagerImpl.cpp 12KB segment_c.cpp 12KB load_index_c.cpp 12KB ParserDeprecated.cpp 11KB StringIndexMarisa.cpp 11KB BinaryQuery.cpp 11KB ShowExprVisitor.cpp 11KB test_string_index.cpp 10KB VectorMemIndex.cpp 10KB test_minio_chunk_manager.cpp 10KB test_index_c_api.cpp 10KB Utils.cpp 8KB SegmentInterface.cpp 8KB test_disk_file_manager_test.cpp 8KB AliyunSTSClient.cpp 7KB test_local_chunk_manager.cpp 7KB LocalChunkManager.cpp 7KB AliyunCredentialsProvider.cpp 7KB test_scalar_index.cpp 7KB test_bool_index.cpp 6KB test_index_wrapper.cpp 6KB SearchOnGrowing.cpp 6KB plan_c.cpp 6KB FieldData.cpp 6KB test_segcore.cpp 6KB FieldIndexing.cpp 6KB ExecPlanNodeVisitor.cpp 6KB test_utils.cpp 6KB MemFileManagerImpl.cpp 5KB test_reduce.cpp 5KB Plan.cpp 5KB DataCodec.cpp 5KB test_scalar_index_creator.cpp 5KB test_bf.cpp 4KB Log.cpp 4KB test_relational.cpp 4KB bench_search.cpp 4KB IndexData.cpp 4KB Slice.cpp 4KB InsertData.cpp 4KB bench_indexbuilder.cpp 4KB TimestampIndex.cpp 4KB SegcoreConfig.cpp 4KB VectorMemNMIndex.cpp 4KB IndexFactory.cpp 4KB VerifyPlanNodeVisitor.cpp 4KB PayloadWriter.cpp 4KB test_concurrent_vector.cpp 4KB PayloadReader.cpp 4KB Schema.cpp 4KB ConcurrentVector.cpp 4KB SearchOnSealed.cpp 4KB binary_set_c.cpp 3KB reduce_c.cpp 3KB ShowPlanNodeVisitor.cpp 3KB PayloadStream.cpp 3KB Status.cpp 3KB ScalarIndex.cpp 3KB SubSearchResult.cpp 3KB load_field_data_c.cpp 3KB test_span.cpp 3KB storage_c.cpp 3KB ConfigKnowhere.cpp 3KB SearchBruteForce.cpp 3KB test_growing.cpp 3KB SystemProperty.cpp 3KB FieldDataFactory.cpp 2KB VecIndexCreator.cpp 2KB segcore_init_c.cpp 2KB ExtractInfoExprVisitor.cpp 2KB test_timestamp_index.cpp 2KB ScalarIndexCreator.cpp 2KB ExtractInfoPlanNodeVisitor.cpp 2KB EasyAssert.cpp 2KB SearchOnIndex.cpp 2KB共 2000 条
- 1
- 2
- 3
- 4
- 5
- 6
- 20
资源评论
