Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

The Perspectium DataSync Agent requires that you have the following user permission, system, network, and Java version specifications shown below.

Anchor
TOP
TOP

Panel
titleWhat's on this page?

Table of Contents
maxLevel2
absoluteUrltrue



System

System Requirements
Memory8GB minimum
Processor Cores4 minimum
Hard Disk Space

100GB minimum

(info) NOTE: The DataSync Agent will only run if 100GB of space is available on the partition that the Agent is installed on

Network InterfaceGigE

If deploying in an AWS environment, we recommend using a m5.xlarge EC2 general purpose instance with general purpose SSD (gp2) EBS volume type. Perspectium has tested using the m5.xlarge instance type though any system meeting the system requirements should be able to run the application.

For other cloud platforms, it is recommended to use the equivalent services to the aforementioned AWS services:


AWSMicrosoft Azure
Virtual Machine

m5.xlarge

EC2 general purpose instance

Standard_D4_v3 (Dv3 and Dsv3-series)

or Standard_D4_v4 (Dv4 and Dsv4-series)

general purpose VMs

Storagegeneral purpose SSD (gp2)Standard SSD Managed Disks



↑ Go to top of page




Supported Operating Systems

The following operating systems are supported by the Agent:

OSVersion
Windows Professional/Home 7+

Server 2012+
Linux*Red Hat 6+

Ubuntu 14.04+

CentOS 6+

*Linux requires superuser access (sudo) to install the Agent and run it as a service.

The versions of Linux specified above have been tested to work with the Agent.  Other versions with equivalent Linux kernel and meeting the other requirements above (System, Java, etc.) may also be able to run the Agent. Please contact Perspectium Suppport for more information.



↑ Go to top of page




Network

The DataSync Agent requires outbound access to the Perspectium Integration Mesh and its MBS cloud service as well as your ServiceNow instance. Your firewall settings will need to allow this outbound traffic in order for the Agent to connect to our cloud service and your ServiceNow instance to properly read data.

This can be through any one of the following three ports: AMQP, AMQPS, or HTTPS. You will specify which protocol you will be using through the URL of the <message_connection>.

Network Requirements
AMQPS Outbound PortTCP/5671 outbound to your Perspectium MBS (amqps://example.perspectium.net)
AMQP Outbound PortTCP/5672 outbound to your Perspectium MBS (amqp://example.perspectium.net)
HTTPS Outbound PortTCP/443 outbound to your Perspectium MBS (https://example.perspectium.net)
HTTPS Outbound PortTCP/443 outbound to your ServiceNow instance



↑ Go to top of page




Java

Java is required to be installed to run the DataSync Agent. Both 32 and 64 bit versions of Java are supported. The Java version must be Java 8 or higher. As of the Fluorine release, Java versions 9 and 10 are supported. It's strongly recommended that you use a server type JVM instead of a client or desktop version. Both Java and OpenJDK are supported. For OpenJDK, Perspectium has tested and confirmed compatibility with version jdk-11.0.10+9 of the JRE.

UI Text Box
typewarning

Starting with the Iodine 7.0.0 release, agent will run with at minimum Java 11.


DataSync Agent versionJava 7 & earlierJava 8Java 9Java 10Java 11Java 12Java 13Java 14Java 15Java 16Java 17Java 18
Argon & earlier(error)(tick)(error)(error)(tick)(error)(error)(error)(error)(error)(error)(error)
Bismuth(error)(tick)(error)(error)(tick)(error)(error)(error)(error)(error)(error)(error)
Carbon(error)(tick)(error)(error)(tick)(error)(error)(error)(error)(error)(error)(error)
Dubnium(error)(tick)(error)(tick)(tick)(error)(error)(error)(error)(error)(error)(error)
Europium(error)(tick)(tick)(tick)(tick)(error)(error)(error)(error)(error)(error)(error)
Fluorine(error)(tick)(tick)(tick)(tick)(error)(error)(error)(error)(error)(error)(error)
Fluorine Plus(error)(tick)(tick)(tick)(tick)(error)(error)(error)(error)(error)(error)(error)
Gold(error)(tick)(tick)(tick)(tick)(tick)(tick)(error)(error)(error)(error)(error)
Helium(error)(tick)(tick)(tick)(tick)(tick)(tick)

(tick) **

(tick) **

(error)(error)(error)
Iodine(error)(error)(error)(error)(tick)(tick)(tick)(tick) **(tick) **(tick) **(tick) **(tick)^

(info) NOTE: These versions of Java have been tested to work with the DataSync Agent. Newer versions may also be able to run the Agent but have not been tested or verified. We typically provide support for the latest version of Java with a major release after the Java version's general release date and when we have completed testing to ensure compatibility.

UI Text Box
typenote

**For the following Java versions... 

  • Java 14 and 15 will require importing wrapper jar files to run the Agent in Linux machines.
  • Java 16 and 17 will require including yajsw 13.00 in the lib directory to run the Agent.

^Only supported with Iodine 7.0.6 and newer. For Iodine 7.0.6 and newer, you do not have to replace any files as all libraries have been updated to work up to Java 18.

Contact Perspectium Support for more information.



↑ Go to top of page




ServiceNow

The DataSync Agent requires a ServiceNow user in order to access the ServiceNow table schemas you share.  This user you specify must be a local user in the ServiceNow instance (i.e. it cannot be a SSO user) that is given at minimum the perspectium role and has permissions to invoke a processor. In the event that the processor cannot be accessed when the DataSync Agent runs, a call to the PSPSchema rest API will be made instead to get the ServiceNow table schema. 

You do not need to upgrade the Agent at the same time as you upgrade the ServiceNow application as the core functionality of syncing data will work. New features however may require both to be upgraded to function properly. Perspectium tests n-2 compatibility with each release e.g. the previous two major releases of the Agent prior to this release has been tested with the latest version of the ServiceNow application. 



↑ Go to top of page




Supported Databases

DatabaseVersion
Oracle11g, 12c Release 1: 12.1 - 12.2
SQL Server (MSSQL)2010 - 20192022
MySQL5.6 - 8.X.X
SAP HanaSPS 12
Amazon Redshift4.0-4.1
Amazon Aurora (MySQL compatible)N/A
IBM DB211
HP Vertica8.0 - 9.21
PostgreSQL9.6+
Snowflake2.0 - 3.9x.x
Microsoft Azure SQL12.X

^For Oracle, the Agent requires six open cursors per ServiceNow table to be replicated as it uses prepared statements to ensure the most efficient processing possible. For each operation per table (insert, update, delete, query metadata) we use a prepared statement which is reused whenever the next similar operation needs to be executed against the same table. Each of these prepared statements uses a cursor.  If we didn't use an open cursor, every transaction would be very inefficient because the Agent would need to re-establish the client/server connection and query the structure each time. 

If deploying an AWS RDS instsnce, we recommend using the m5.xlarge general purpose instance with a bandwidth of 4000 IOPS and 500GB of storage space. To really measure your bandwidth requirements, contact support@perspectium.com as we will work with you to understand how many records you plan to share a day during the initial seeding phase and the daily volume expected after the initial seeding to really know what the bandwidth needed is.



↑ Go to top of page




Database User Permissions

For integrating with a database, the following are the required permissions the DataSync Agent must have.

(info) NOTE: It is recommended that the Agent be the only one writing data to this database to avoid conflicts with the Agent accessing tables it did not create and/or do not match the schema definitions as the source (such as ServiceNow).

PermissionDescription
Create a new database 

After installation has been performed and the DataSync Agent is started, the Agent establishes a connection to the database server using the credentials configured. 

This task must be completed successfully before the Agent will proceed with subsequent processing. Once the connection has been established, the Agent will attempt to create the configured database.

This step requires that the configured user has the proper permissions to create a new database. If this is not the case then an error will occur. As an alternative, the required database can be created by something or someone other than the Agent. When this approach is taken you add the configuration directive <skip_database_creation/> to the configuration and the Agent will not attempt to create the database since this tell the Agent that the database already exists.

Create tables within defined databases

Once replicated data is available, the Agent will determine if the table associated with the replicated data exists, and if not, the Agent will create it. This means that the configured user must have the permissions required to create tables within the defined database.

Query database and associated tables and update data in existing tablesWhen you share out data to be consumed by the DataSync Agent, you'll typically specify whether the data is being shared in bulk or dynamically. When the data is shared in bulk and based on how the Agent has been configured, it will typically perform a query in order to determine if the row already exists in the database. The Agent must therefore have permission to query the database and the associated tables. If the Agent determines that the row already exist then it performs an update, otherwise it will insert the row. The Agent must have permission to perform both these actions.
Insert data into tables

Once the required table has been created the Agent will perform an insert in order to populate the table with the replicated row. This means that the Agent must have the permissions to perform an insert into the table.

Alter table

The Agent wants to ensure that all data is replicated. It's possible that the structure of the source table has changed.

For example, an additional column has been added to the table or the size of a column has been increased. The Agent performs the analysis required to make this determination and by default will alter the table in order to align it with the source table. Currently, Perspectium supports adding a column and increasing the size of a text or character type column to the maximum. Additionally, if the database supports it, a text or character type column can be modified to a larger type of text or character column.

(info) NOTE: Perspectium does not support altering from one type to another such as a text or character type being modified to an integer or an integer to a float.

The Agent also will not delete a column in a database table if the column is deleted in ServiceNow.

It is possible to constrain the Agent from altering tables by including the <skip_alter/> directive within the SQL Subscribers <task> definition.

Delete table rowIn order to support the deletion of rows from a table, the database user must also have permission to delete a table row



↑ Go to top of page