Understanding time partitioning
Most monitors use a time partition field, such ascreated_at or date. This field defines how data is grouped over time and is used to determine which records belong to a given measurement window.
You can then choose how often to measure the data (daily, hourly, or down to minutes) and optionally define a delay to account for late-arriving data.
No time segmentation
If the table has no column that tells when a row arrived, turn onNo time segmentation in the monitor form. The monitor then computes the metric over the whole table on each run, on the schedule you choose. It reads the whole table each time, so it can cost more in your warehouse than a monitor with a time partition field. It has no historical backfill: anomaly detection starts to learn from the first run.
Scheduling options
Each monitor run is defined by three parameters:- Frequency – how often the monitor runs (e.g. daily, hourly).
- Partition time – the timestamp field used to group data.
- Time zone and offset – when in the day the monitor executes.
Common scheduling examples
- Daily at midnight UTC Measures data for the previous calendar day.
- Daily at 2 AM UTC Measures data for the previous calendar day at 2AM (useful for delayed ETL jobs).
- Daily at midnight New York Runs at 5 AM UTC but measures midnight → midnight in the New York time zone.
Handling data delays
Many teams have ETL pipelines that complete several hours after midnight. In these cases, you can configure monitors to delay execution (for example, run at 4 AM but still measure the previous day’s partition). This ensures freshness or volume checks evaluate complete data instead of partially loaded partitions.Advanced configurations
The platform supports advanced scheduling behaviors to cover all data-readiness scenarios:- Ignore last partition – Skip the most recent day/hour if data isn’t yet ready (useful for delayed ingestion).