Data Migration

Data-Migration

Data Migration

Organizations have many siloed legacy operational databases and applications. These operational databases often maintain duplicate/redundant datasets e.g., Customer/Patient/Beneficiary/Member/Claimant/Asset etc.) causing data integrity and data quality challenges. Data sharing is difficult and complex because of data interoperability and accessibility challenges. Data lives in many in many different formats – SQL, Mainframe, Files on distributed infrastructure including on-premises and on cloud platforms. Only a handful of people in the team has knowledge about the data.

xAQUA® Solution

Create a 360 degrees integrated view of clean and curated data from the siloed operational data sources that can serve various downstream use cases.

  • Use the curated and integrated data from silos and load to a target database that can be used by the modernized application.
  • Establish analytics platform on the clean/curated/integrated data so I can create actionable data story with insight that I can trust – quickly and efficiently.
  • Data Sharing
    • Share data with partner systems with enforced compliance.
    • Export the integrated and curated datasets to
      • modernized application
      • another data warehouse/database
    • Eliminate the risks associated with the huge dependencies on few data SMEs vis Democratization of data knowledge.
    • Establish a collaboration platform for all data roles.

xAQUA UDP Delivers all Capabilities Required for Successful Data Migration use style:

Connect to virtually any data sources (Databases, Files, Blob Storage) and any data formats including SQL, XLSX, CSV, Arrow, Parquet, Avro and Hdf5 etc. on-premises and on the cloud platforms and import schema for the source data automatically just with few clicks. xAQUA UDP saves the database schema in a metadata knowledgebase that can be searched, accessed, visualized, and explored via our highly interactive user interface.

Source Data Model

number-02

Understanding the quality and the state of the source data is very important before migrating the data to a target database. xAQUA UDP provides out of the box solution with blazing fast query engine, and data profiler to query, discover and profile data by the entire team.

Source Data Discovery & Profiling

number-03

xAQUA UDP allows you to connect to a target data source and automatically import target schema model to the metadata knowledgebase or you can create a target data model manually.

Target Data Model

xAQUA UDP delivers out of the box solution to visually define the data extraction rules/criteria for the dataset to be extracted from the source data systems without writing any code.

Extract (E) Data from Source Systems

number-05
You can extract and join datasets to form a composite dataset virtually from any data sources (Databases, Files, Blob Storage) and any data formats including SQL, xlsx, csv, arrow, parquet, Avro and Hdf5 etc. xAQUA UDP allows you to define join rules (left, right, inner, and outer join) using highly interactive user interface without writing any code.

Integrate/Join Data from Various Source Systems

number-06
xAQUA UDP provides highly interactive user interface with rich data transformation functions including Filter, Group By, Pivot, Rename, Calculation, Replacement, Deduplication, Encryption, and Masking etc. without writing any code. You can view the profile of the output data in every step of the data transformation.

Transform Data

number-07
xAQUA UDP delivers out of the box capability to identify and eliminate duplicate Master Entities by identifying unique and potential duplicate master entities in batch and real-time mode using probabilistic entity resolution mechanism.

Master Entity Resolution

number-08
With xAQUA UDP, you can maintain your Reference Datasets for the target database and define data translation rules to translate the source values to target values via web interface without writing any code. These data translation rules are applied automatically by the data migration process.

Translate Data

number-09
xAQUA UDP allows you to explore the Target and Source data models and define the source to target data mappings (1:1, n:1) and mapping rules visually using a highly interactive user interface without writing any code.

Source to Target Data Mapping

number-10
xAQUA UDP automatically detects the referential integrity constraints and enforces the integrity constraints while loading the data to the target database.

Automated Enforcement of Referential Integrity

number-11
You can define the Data Quality rules for the target data visually without writing any code that are automatically executed and enforced before the data is loaded to the target database. The records that for which the data quality rules are failed are logged and are not included in the load process.

Data Quality Validation of Target Data

number-12
You can load the integrated, cleansed, curated and transformed datasets to virtually any target data source (Databases, Files, Blob Storage) and in any data formats including SQL, xlsx, csv, arrow, parquet, Avro and Hdf5 etc. without writing any code.

Load to Target Database