Elasticsearch and SymmetricDS

Data and how it is stored has been rapidly changing over the past couple of years. Specifically, people have seen the importance of scalability and reliability, as well as the necessity to be able to search and access that data at a moment’s notice. With new database options, be it SQL or NoSQL, there are seemingly endless possibilities; however, some options appear better equipped for this rapidly changing world compared to others. While companies are loyal to the traditional databases that have helped them maintain their data over the years, new databases are beginning to offer things that are simply too good to turn down. Elasticsearch is one of those databases and has put together a product that matches remarkable speed with precision and scalability.

SymmetricDS now has the capability to load data and changes into Elasticsearch. Whether your Elasticsearch database is in the cloud or running locally, you can capture changes in your relational database, and sync them in near real-time. This opens the door to sync Elasticsearch with relational databases, giving you the flexibility and speed of a non-relational database paired with the reliability and organization of its relational counterpart. The bulk loading option is also available, providing an even faster loading option.

Setup

Elasticsearch is set up to be a load-only database, so the setup is relatively simple!

Within the Node Setup Wizard, select Elasticsearch (Load Only) as your database. Enter the URL for your database, and then the User ID and Password associated with your database. If you do not have any security turned on in your Elasticsearch database, then just leave those blank.

Next, just choose whether or not you want bulk loading enabled. For the quickest initial load times, it is recommended to enable bulk loading. Once this is done, you will just continue following the wizard, and the connection to your Elasticsearch database should be completed. Then, using the Load Data Wizard you can send an initial load of data from your source relational database into Elasticsearch. 

By adding Elasticsearch to SymmetricDS, it gives the ability to have change data capture between relational and non-relational databases, making for endless possibilities. Elasticsearch prides itself on being extremely fast at indexing the information you have stored there. SymmetricDS will now be able to take any relational database information you have and load it in, allowing you to take full advantage of Elasticsearch’s rapid in-depth query analysis, while giving it more utility to work together with your pre-existing relational databases. Due to this extremely fast indexing of information, your data will be replicated in the blink of an eye to your Elasticsearch index. Keeping your data in sync between a non-relational and relational database has never been easier.