Data Replication with Qlik Replicate
Hello everyone,
In this blog, I would like to tell you about our Data Replication project. One of our customer is using SAP ECC system. This ECC system, beside to SAP S4/HANA which is SAP’s newest product release, has so many limitations. For the improvement of the analytics reporting, they decided to use the last 5 years of data. While doing that, we aimed that using Qlik Replicate and Qlik SAP Connector (for SAP Data Standart Extractor) for the replication of data from ECC system into the Snowflake Data Lake.
You may wonder and ask to yourself that “what is data replication?” and “what is Qlik Replicate?”.
Replication is the process of copying and synchronizing data from a source database or system to a target database or system.
As a general, copying data within hosts, such as one or two on-premises servers or a cloud, is known as data replication. Real-time data integrity for all users, no matter where they access the data, is the goal for data replication.
Qlik Replicate is a data replication tool that allows you to replicate data from various sources to target destinations. It enables organizations to accelerate data real-time replication, ingestion and streaming via change data capture, across a wide range of databases, data warehouses and data lake platforms. (Source:https://www.trustradius.com/products/qlik-replicate/reviews?qs=pros-and-cons#overview)
Now I would like to focus on how we replicate the data on Qlik Replicate tool step by step.
1. Data Replication on Qlik Replicate Steps
1.1. Firstly, we used t-code which was RSA5 to activate the extractors. In RSA5, you can click on SAP — R/3 and select the “Expand All” button which is blue plus sign for a easier search.
1.2. After expanding it, you can easily find your data source extractor. Material Management extractors are looking as you can see in the below.
In this case, I chose the “2LIS_02_ITM” which includes purchasing data on the item level.
1.3. After finding the datasource, I right-clicked it and in the menu, I chose “Activate the DataSource”.
1.4. Now, we had to activate the extractor from the transaction code “/n/QTQVC/EXTREP”. This helped us to replicate the data from SAP ECC system to Qlik Replicate. In the configuration menu, go to the selected “Activate Extractors” part.
1.5. In the new opening screen, first, you need the define your Target Logical System. Than, you need the specify your datasource. After that, click on the Activate button.
1.6. If the activation of the DataSource is successful, a green flag will appear in the bottom of the screen indicating that the activation was completed without any issues.
In this part, I will tell how to create a new task on the Qlik Replicate. We created tasks for each module of the SAP ECC System.
2. Creating a New Task on Qlik Replicate
2.1. In the pop-up menu, you need to choose New Task as the shown below.
2.2. After clicking New Task, you have to choose the options like I did in the screenshot. Than, click OK.
2.3. Now, we need to drag and drop the Endpoint Connections. We specified our source as a SAP ECC Sandbox and as a target, it is Snowflake.
2.4. We can choose the tables of our datasources by selecting the right-side bar which is called Table Selection.
2.5. In the Select Tables menu, from your Source Tables you can choose spesific tables that you want. First, you need to write your table name. In this case, I selected 02LIS_02_ITM table. Than, you need to select it and with the right-side arrow, you can move it to the Selected Tables.
As a conclusion, I wanted to tell you about basics of Qlik Replicate’s data replication process from SAP to Qlik itself. That’s all for now, thank you for reading my blog.
