Announcing warehouse table filters

Today we are releasing table filters for warehouse syncs.

When syncing to your data warehouse, there are situations where you might only want a subset of rows from your source system. For example:

- A small set of event types from a multi-billion-row event stream.

- The last two years of history from a 12-year-old Salesforce instance.

- Tickets with certain attributes created within the last three years from a ten-year-old Zendesk instance.

Now, when syncing to your data warehouse using our Bulk Syncs feature, you'll be able to specify any number of filter conditions on any number of source objects and any number of source fields, all in the same sync. This works for all sources: whether CDC SQL database streams, SaaS apps, spreadsheets, or cloud storage like S3.

Filters can be applied to the common data types:

- Strings (equals, does not equal, matches-one-of, does-not-match, does not equal, ends with, starts with, etc).

- Numbers (greater than, less than, equals, etc).

- Dates (before, after, etc).

- Booleans (is true, is false, etc).

Once set, Polytomic will only sync data to your warehouse that matches your filter conditions, thus cutting unnecessary storage and transfer time.

Documentation on how to to set table filters is located here: https://docs.polytomic.com/docs/bulk-sync-table-filters. As always, email us at support@polytomic.com with any questions!