Page History
HTML |
---|
<style> .release-box { height: 30px; width: 100px; padding-top: 8px; text-align: center; border-radius: 5px; font-weight: bold; background-color: #d4af37; border-color: #FCE28A; } .release-box:hover { cursor: hand; cursor: pointer; opacity: .9; } </style> <meta name="robots" content="noindex"> <div class="release-box"> <a href="https://docs.perspectium.com/display/gold" style="text-decoration: none; color: #FFFFFF; display: block;"> Gold </a> </div> |
To enhance your DataSync integration for Snowflake, you can configure the Snowflake meshlet to the directives listed below:
Warning |
---|
If you will be setting up the DataSync Agent to also connect to the same database, you will want to configure the Agent to use the same column cases. By default, the Snowflake DataSync meshlet uses lowercase for the column names. |
Directive | Default Value | Description | |||||
---|---|---|---|---|---|---|---|
maxFileSize | 15000 | Total of individual records (per table) for each file. After x records have been received by the meshlet, a file will be created with x records and an immediate push of all records in that file to Snowflake will occur.
| |||||
buildHeader | false | Each CSV file will include headers of column names in the first row.
| |||||
customFileName | $table-$randomid | Names file with format of table - random id. File names MUST be unique.
| |||||
fileDirectory | /files | Directory where the locally created files get made. (In respects to where application is running)
| |||||
postInterval | 2 | Minutes to check dead periods. Check every x minutes to compare if the in memory collection is the same as the last x minutes. If so, write records to file and push to Snowflake
| |||||
deleteFiles | true | Indicates whether you want to keep or delete locally created CSV files. Will not have a noticeable performance hit.
| |||||
fileCleanerInterval | 4 | How many hours for a job to clean up local files. (Like ServiceNow DataCleaner Scheduled Job)
| |||||
fileMaxAge | 1 | Any csv file in the filesDirectory older than fileMaxAge in hours, will be automatically deleted.
|
Similar topics
Content by Label | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|
|