Pattern-based file selection for SFTP/FTP and Amazon S3 ingestion

SFTP/FTP and Amazon S3 ingestion now support pattern-based file selection. When a vendor delivers files with changing names (dates, timestamps, report IDs) or drops several file types into the same folder, you can now target exactly the files you want instead of relying on an exact file name.

Two new download methods are available in your FTP/SFTP and S3 ingestion settings: "Latest updated file matching pattern" and "All updated files matching pattern." The file field is now labeled "File Name / Pattern" — enter a regular expression (e.g. /^report_\d8.csv$/i) and NinjaCat matches it against the file name. For the "latest" method, NinjaCat ingests the most recently updated file that matches. Matching uses regular expressions rather than shorthand wildcards, so a pattern like report_.csv should be written as a regex such as /^report_..csv$/. Available now — no setup required.