Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Version 

HTML
<style> 
.version {
	height: 25px;
    width: 200px;
    border-radius: 5px;
    border: 1px solid #ddd;
}
</style>
<select class="version" id="version" onchange="showContent()">
	<option value="6.1.0">6.1.0</option>
    <option value="6.0.0" selected>6.0.0</option>
</select>
<script> 
function showContent() {
	var dropdown = document.getElementById("version"); 
	var tabs = document.getElementsByClassName("rwui_tab_content");
	for (var i = 0; i < tabs.length; i++) {
		if (tabs[i].getAttribute("data-name") == dropdown.value) {
			tabs[i].style.display = "";
		}
		else {
			tabs[i].style.display = "none";
		}
	}
}
</script>



UI Tab
title6.1.0

Release Date: TBD

New Features

Added File DataSync option for DataSync Type in the Agent installer to support manual configuration for file subscribing. 

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-12695



Enhancements

Set a dynamic file name using <file_prefix>$table_$d{yyyyMMdd}_$i</file_prefix> upon setting up DataSync Agent to share to AWS S3. 

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-12694


Validate Configuration will now validate the encryption keys set for the DataSync Agent. 

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-17267


Use the update_column_only tag in the IO Datetime Plugin for DataSync Agent to update the psp_per_update_dt column only when records are updated

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-15472

Set your MySQL database with utf8mb4 character set and collation to accept multibyte characters in the agent.xml with <database_table_character_set> and <database_table_collation>. 



Bug Fixes

AgentConfigValidator Error in logging for DataSync Agent will no longer appear.

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-13006

Bug Fixes

18220


CSV file is no longer missing a

AgentConfigValidator Error in logging for DataSync Agent will no longer appear.

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-18220

CSV file is no longer missing a header for CSV File Subscriber. 

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-18366


Sharing all records to one file with the agent will no longer need the <separate_files> tag. 

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-18387


Agent will now retry messages if statements timeout.

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-19460





UI Tab
title6.0.0

Release Date: March 11, 2021

New Features

Use <custom_primary_key/>  to create an auto-incrementing column and set the column as the primary key. 

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-8399



Show If
special@authenticated

Optimize throughput and ensure message ordering with Key Set Processing for DataSync Agent.

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyCE-168

Use <batch_flush_interval> for the number of seconds that will trigger a batch SQL statement execution with batch processing.

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-9720


Use <skip_performance_tag> to stop the Agent from reporting performance metrics (statsx) to the Integration Mesh. 

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-10621


Enable truncating table in the database by the DataSync Agent using Truncate Before Share.

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-9448


<use_instance_credentials/>is now available to use instead of access keys in AWS S3 Subscriber Agent to use IAM roles when uploading to the S3 buckets.

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-14515


Customize your temporal database table's archive date and time stamp in the psp_valid_to column with <archive_datetime/>

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-13182


Specify the character set for database encoding and truncate the data based on this character set by using <database_truncate_encoding>

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-9446



14958

Enhancements

Added PostgresSQL as a DataSync Type option in the Agent installer.

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-12079


The DataSync Agent Installer will now use HTTPS as a protocol by default in <message_connection>

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-10785


Snowflake DataSync Agent will automatically have parameter values to default to uppercase characters after installation. 

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-10932


Choosing Manual Configurations in the DataSync Agent Installer will prompt you to contact Perspectium Support for a guided step. 

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-10966


If the agent.xml file is invalid (i.e. bad file format, missing field characters, etc),  an error message will now display on the log with a description of the error.

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-9588


Match text field lengths in your DataSync Agent with <match_field_lengths/>.

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-11753


 Check the fields values if the updated time is the same from the previous share in your DataSync Agent with <skip_duplicates check_all_fields=”true”/.

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-11615


Using <column_sort>alpha</column_sort> in your DataSync Agent will now sort new fields. 

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-11688


When a table already exists upon an integration, the new reference fields will now have length of 32.

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-11738


<enable_error_log/> will now keep track of the number of invalid records and save the error count in the generated audit file. 

Show If
special@authenticated


Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-12003


<close_file_interval> is added to set the amount of time the Agent will wait for tmp files to be modified. 

Show If
special@authenticated


Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-11861


Enhanced error recovery when using temporal and the table does not exist in the database.

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-12058


AWS S3 Subscriber Agent now supports sending receipts back to ServiceNow. 

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-14709


The <region> directive in the AWS S3 Subscriber Agent is now optional and no longer required. 

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-14709


AWS S3 Subscriber Agent logging extended for different levels. 

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-14709


Using <update_on_bulk/> will now skip duplicates in the DataSync Agent based on the message actionthe message action.

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-13562


The agent will now log a warning message that a queue will be created when messages are shared if the agent gets a 404 (queue not found) status.

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-135629580


DataSync Agent now supports Java 14The agent will now log a warning message that a queue will be created when messages are shared if the agent gets a 404 (queue not found) status.

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-95809593


DataSync Agent now supports Java 1415.

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-9593

DataSync Agent now supports Java 15.

11071


The DataSync Agent Installer will now allow you to enter FedRAMP URLs for your ServiceNow instance information. 

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-1107112295


The DataSync Agent Installer will now allow you to enter FedRAMP URLs for your ServiceNow instance information. action of processing delete messages will not alter the database tables.

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-12295

The action of processing delete messages will not alter the database tables

13317


Agent re-queues delete records up to 3 times when no record in database to delete.

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-1331713164


Agents installed using the installer will create a conf/agent.xml with instances valued to 1 instead of 4 to minimize data lossAgent re-queues delete records up to 3 times when no record in database to delete.

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-13164

Agents installed using the installer will create a conf/agent.xml with instances valued to 1 instead of 4 to minimize data loss.

14958


Sharing records from a database to the Integration Mesh will now be consumed without errors. 

Show If
special@authenticated
Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-
16147


Set your MySQL database with utf8mb4 character set and collation to accept multibyte characters in the agent.xml with <database_table_character_set> and <database_table_collation>Sharing records from a database to the Integration Mesh will now be consumed without errors

Show If
special@authenticated
Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-1614713006




Bug Fixes

Error when inserting/updated a record into a SAP HANA table that has 2 billion+ rows because of metadata query.

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-9192


The attribute, use_basic_consume, in the agent.xml will reflect on the protocol given upon the configuration in DataSync Agent installer.

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-11395


Emojis will no longer be removed in incoming messages to the DataSync Agent when at lease one custom schema feature is used (tablename, column_name, _dv suffix). 

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-11990


After deleting a field from a ServiceNow table, the old value of that field will no longer be inserted into the database. 

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-12018


After adding a string field with default value in a ServiceNow table, executing a bulk share will no longer generate a timestamp error. 

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-12244


Table stats data will now show the correct timezone offset. 

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-15439


Using skip_duplicate with check_all_fields will now compare values properly.

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-13534



Removed Features

Removed the following DataSync Type options in the DataSync Agent Installer that are no longer being used: Rabbit MQ and Other.  

Show If
special@authenticated

Jira
serverJIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIde15725ca-3b2b-32f6-914c-89477a90901d
keyDEV-10787






HTML
<script>
	var tabs = document.getElementsByClassName("rwui_tab_content");
	for (var i = 0; i < tabs.length; i++) {
		if (tabs[i].getAttribute("data-name") == "6.0.0") {
			tabs[i].style.display = "";
		}
		else {
			tabs[i].style.display = "none";
		}
	}
</script>