Extract, Transform and Load (ETL) refers to a process of moving and shaping bulk data between systems. Often the target systems are data warehouses.
- Data extraction – extracts data from homogeneous or heterogeneous data sources
- Data transformation – transforms the data for storing it in the proper format or structure for the purposes of querying and analysis
- Data loading – loads it into the final target (database, more specifically, operational data store, data mart, or data warehouse)
Since the data extraction takes time due the large size of data needing to be processed, it is common to execute the three phases in parallel.
At Interprit we use the ETL tools from Microsoft to move bulk data around that does not require near real-time integration. The main tools we use and have expertise in is SQL Server Integration Services (SSIS).