Required Configuration. This configuration specifies the max size of records for each parquet file. 10000 will be used if input is over 10000 to prevent possible performance and memory issues. A suggested value is 5000.

 NOTE: Negative values are not supported and will result in 1 record for each parquet file. 

perspectium:
	filesubscriber: 
		maxFileSize: 5000

Dynamic naming convention that will be replaced when creating files using the following keywords. File names MUST be unique.

perspectium:
	filesubscriber: 
		customFileName: $table-$randomid

Directory where the locally created files get made. (In respects to where application is running)

perspectium:
	filesubscriber: 
		fileDirectory: /files

Minutes to check dead periods. Check every x minutes to compare if the in memory collection is the same as the last x minutes. If so, write records to file and push to parquet

perspectium:
	parquet: 
		postInterval: 2

Date format used to create the file name. A valid SimpleDateFormat required.

perspectium:
	parquet: 
		postInterval: 2

ID of timezone to be used in $zonedatetime.

perspectium:
	parquet: 
		timeZone: GMT

Prefix used for file naming.

perspectium:
	parquet: 
		file_prefix: psp

Suffix used for file naming.

perspectium:
	parquet: 
		file_suffix: bt

Connection URL for your Azure. To access the URL, go to Azure Portal > Storage Account > Access Keys > Show Keys > Connection String.

perspectium:  
	azure:    
    	connectionString: DefaultEndpointsProtocol=.....EndpointSuffix=core.windows.net

Name of your Azure Blob Storage container, including subdirectories if desired, to specify where the records will be uploaded e.g. container/folder1/folder2.  

For example, the following will save records into the pspcontainer blob storage container:

perspectium:  
	azure:    
		destinationContainer: pspcontainer

If the following is configured:

perspectium:  
	azure:    
		destinationContainer: pspcontainer/tables/$table

If an incident record is being processed and uploaded to the Azure Blob Storage container, then the record will be saved in the pspcontainer container and in the /tables/incident directory in that container, creating the directoriy incident automatically.

NOTE: Adding the $table token indicates this token will be replaced by the table name of the record.