Meshlet Configurations for Snowflake

Total of individual records (per table) for each file. After x records have been received by the meshlet, a file will be created with x records and an immediate push of all records in that file to Snowflake will occur.

perspectium:
	filesubscriber: 
		maxFileSize: 15000

Each CSV file will include headers of column names in the first row.

perspectium:
	filesubscriber: 
		buildHeader: false

Names file with format of table - random id. File names MUST be unique.

perspectium:
	filesubscriber: 
		customFileName: $table-$randomid

Directory where the locally created files get made. (In respects to where application is running)

perspectium:
	filesubscriber: 
		fileDirectory: /files

Minutes to check dead periods. Check every x minutes to compare if the in memory collection is the same as the last x minutes. If so, write records to file and push to Snowflake

perspectium:
	snowflake: 
		postInterval: 2

Boolean to indicate whether you want to keep or delete locally created CSV files. Will not have a noticeable performance hit.

perspectium:
	filesubscriber: 
		deleteFiles: true

How many hours for a job to clean up local files. (Like ServiceNow DataCleaner Scheduled Job)

perspectium:
	filesubscriber: 
		fileCleanerInterval: 4

Any csv file in the filesDirectory older than fileMaxAge in hours, will be automatically deleted.

perspectium:
	filesubscriber: 
		fileMaxAge: 1