Performance
These tests were ran by Perspectium bulk sharing 100,000 incidents from ServiceNow to a Snowflake database.
NOTE: Batch processing is intended only when a queue has one table type in it. If the queue has different tables, this can lead to data discrepancies and batch insert is not recommended to be used.
Insert Only
| Number of tasks | Batch insert size | Max. message/second |
|---|---|---|
| 1 | --- | 1/s |
| 1 | 200 | 120/s |
| 5 | 20 | 70/s |
| 5 | 50 | 150/s |
| 10 | --- | 5/s |
| 10 | 10 | 60/s |
| 10 | 50 | 210/s |
Upsert
| Number of tasks | Batch insert size | Max. message/second |
|---|---|---|
| 1 | --- | 0.8/s |
| 1 | 200 | 3/s |
| 1 | 500 | 3/s |
| 5 | --- | 3/s |
| 5 | 20 | 10/s |
| 5 | 100 | 15/s |
| 10 | 100 | 15/s |
