Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.


HTML
<style>
.release-box {
	height: 30px; 
	width: 100px; 
	padding-top: 8px;
	text-align: center; 
	border-radius: 5px; 
	font-weight: bold; 
	background-color: #d4af37;  
	border-color: #FCE28A;
}

.release-box:hover {
  	cursor: hand;
    cursor: pointer;
    opacity: .9; 
}
</style>
<meta name="robots" content="noindex">

<div class="release-box">
<a href="https://docs.perspectium.com/display/gold" style="text-decoration: none; color: #FFFFFF; display: block;">
Gold
</a>
</div>



To enhance your DataSync integration for Snowflake, you can configure the Snowflake meshlet to the directives listed below:


DirectiveDefault ValueDescription

maxFileSize

15000

Total of individual records (per table) for each file. After x records have been received by the meshlet, a file will be created with x records and an immediate push of all records in that file to Snowflake will occur.

Code Block
languageyml
perspectium:
	filesubscriber: 
		maxFileSize: 15000


buildHeader

false

Each CSV file will include headers of column names in the first row.

Code Block
languageyml
perspectium:
	filesubscriber: 
		buildHeader: false


customFileName

$table-$randomid

Names file with format of table - random id. File names MUST be unique.

Code Block
languageyml
perspectium:
	filesubscriber: 
		customFileName: $table-$randomid


fileDirectory

/files

Directory where the locally created files get made. (In respects to where application is running)

Code Block
languageyml
perspectium:
	filesubscriber: 
		fileDirectory: /files


postInterval

2

Minutes to check dead periods. Check every x minutes to compare if the in memory collection is the same as the last x minutes. If so, write records to file and push to Snowflake

Code Block
languageyml
perspectium:
	snowflake: 
		postInterval: 2


deleteFiles

true

Boolean to indicate whether you want to keep or delete locally created CSV files. Will not have a noticeable performance hit.

Code Block
languageyml
perspectium:
	filesubscriber: 
		deleteFiles: true


fileCleanerInterval

4

How many hours for a job to clean up local files. (Like ServiceNow DataCleaner Scheduled Job)

Code Block
languageyml
perspectium:
	filesubscriber: 
		fileCleanerInterval: 4


fileMaxAge

1

Any csv file in the filesDirectory older than fileMaxAge in hours, will be automatically deleted.

Code Block
languageyml
perspectium:
	filesubscriber: 
		fileMaxAge: 1





Similar topics


Content by Label
showLabelsfalse
max5
showSpacefalse
sortmodified
cqllabel = "datasync-for-snowflake" and space = currentSpace()

Contact Perspectium Support


US: 1 888 620 8880

UK: 44 208 068 5953

support@perspectium.com