Enhanced Ingestion Controls - Connector & Dataset Level
You now have more visibility and control over how your data syncs, at both the connector and dataset level. Whether you're managing sync schedules, adjusting how far back data is pulled, or fine-tuning chunking behavior, these controls give you the flexibility to configure data ingestion the way your accounts need it.
Here's what's new:
-
Connector-level configuration — From the main connector page, you now have the ability to set the chunking size ("Max Days per Request (Chunk Size)") if needed. Guardrails are in place to prevent chunk sizes that could cause issues (minimum 5 days — contact support if you need something outside that range).
-
Dataset-level overrides — Need something different for a specific dataset? You can now override the refresh lookback window and chunking size independently. The same guardrails that apply at the connector level apply here as well.
-
More flexibility in scheduling your dataset — You now have three distinct scheduling options for your dataset. You can run your dataset on the connector's existing schedule, or select "Add Schedule (Optional)" to configure an additional time. When adding a schedule, you'll have the choice to run it in addition to your connector schedule or to override it entirely — giving you full control over when your data syncs.
-
Targeted manual backfills — In addition to the existing manual sync functionality, you can now kick off a backfill for a specific date range targeting one or multiple accounts, giving you more surgical control when you need to re-pull data. This option can be found by clicking "Manual Sync" from the hamburger menu of your dataset on the connector page.
-
Improved setup workflow for custom mapping providers (Google Sheets, SQL, Email, Snowflake Share) — We've reordered the setup flow so that Date & Account Matching now comes before the Configure Columns step. This small change makes setup more intuitive and helps reduce configuration errors.