Skip to main content

Refresh Schedule

Data Share tables are refreshed every 2 hours using an incremental pipeline. Each refresh cycle processes only new and changed records since the last run, keeping your data current without full-table reloads.

Understanding last_updated_at

Every table includes a last_updated_at timestamp column. This value represents when the ETL pipeline last wrote or refreshed the record — it does not correspond to when the underlying data was changed in the Affinity application. Use last_updated_at to identify records that were recently refreshed by the pipeline:
SELECT *
FROM persons
WHERE last_updated_at >= DATEADD('hour', -2, CURRENT_TIMESTAMP())
ORDER BY last_updated_at DESC;
Because refreshes are incremental, a record’s last_updated_at is only updated when the pipeline detects a change. Unchanged records retain their previous last_updated_at value.