Performance
Mean latency
Performance
Mean latency
Definition
The mean latency test ensures that the mean latency for the data is within a given range.
To enable this test, the data published/streamed to Openlayer must have a
column with the latency for each row. In the data
config, the name of this column is
specified in the latencyColumnName field.
Taxonomy
- Category: Performance.
- Task types: LLM, tabular classification, tabular regression, text classification.
- Availability: .
Why it matters
- The latency of a model directly impacts the user experience. Setting up tests to monitor the latency ensures that the latency is kept within a given range.
Related
Was this page helpful?