The new release of SymmetricDS Pro 3.14 will help you:

  • Capture data from and load data to Snowflake and SingleStore

  • Replicate data from MySQL using log mining

  • Send change data to S3 for integrations with AWS

  • Setup replication using an improved UI

Snowflake Change Data Capture

Integration with Snowflake database was expanded to include change data capture, including all features in the streaming data pipeline, such as filtering, sub-setting, and transformations. Snowflake is a fully managed SaaS database for building data warehouses, data marts, and data lakes that automatically scale in the cloud. Dependent relational data can be grouped together and transformed into JSON documents that are consumed by Snowflake.

SingleStore Change Data Capture

Replicate changes from SingeStore or load data from disparate data sources into it. SingleStore is a relational database that can store relational, JSON, graph, and time series data with a distributed architecture that supports either OLTP or data warehousing. This dialect has bi-directional support that includes change data capture, sub-setting, transformations, and initial loads.

MySQL Log-based Replication

Flexible database replication lets you choose between log-based or trigger-based change data capture for MySQL databases. Log-based data replication is now an option when minimal overhead and high throughput is required. The node wizard sets up log replication and guides you through database permissions needed for log mining. The same powerful configurations are available for either option, including selecting tables, columns, data subsets, conflict management, and data transformation.

Amazon S3 Integration

Capture changes from multiple data sources and load them into scalable storage buckets on Amazon’s Simple Storage Service (S3). Amazon S3 makes data available through integration with other Amazon Web Services (AWS), such as Relational Database Services (RDS), Lamda, and Cloud Watch. Load data from S3 into an RDS database, drive business logic in serverless Lambda functions, or monitor for data events in Cloud Watch.

Usability Enhancements

The web console was enhanced to improve the user’s flow of connecting to databases, enabling change capture, and sending initial loads. For large deployments with hundreds or thousands of locations, new endpoints can be scheduled to register automatically. Initial loads can now be monitored at the endpoint with the same level of detail that was previously only available at the source. Notification messages for data replication events can be customized with a screen that edits a notification template. Screens now support renaming the ID of an item being edited or using a “Save As Copy” button to copy it as a new item. New user settings include display mode, preferred date and time format, and timezone.

 

 

 

Eric Long
Author: Eric Long

Eric is a software developer and technology enthusiast with a background in developing custom applications for Information Technology. As a long-time Linux user, he strongly believes in open source. He focuses on product solutions and spreading the word for JumpMind.