We've made significant improvements to our FTP and S3 data connectors to improve sync reliability, visibility, and data protection.
What's Improved
More Predictable Sync Behavior
- Manual syncs now behave consistently and follow your configured file selection settings.
- Clear visibility into whether new data was ingested or if no updated files were found.
Clearer Sync History
- Sync records are now grouped and easier to interpret.
- Each sync shows the date range of the data that was ingested.
- Improved status messaging ("in progress" vs "completed").
Stronger Data Validation
- If required columns (such as account or date fields) are missing from a file, the sync fails safely with a clear error message.
- Prevents unintended data overwrites or deletions.
Improved Handling of Non-Numeric Values
- Metric columns containing values like empty strings or "NA" will no longer cause ingestion failures.
- These values are now safely treated as null.
More Reliable Data Flow
- Non–account-matched FTP/S3 data now loads correctly into datasets.
- Sync processing has been migrated to a more robust ingestion system designed for improved scalability and monitoring.
What This Means for You
- More reliable FTP/S3 ingestion
- Better visibility into what was processed
- Safer data updates