ETL Toolkit

Our client, an American data science company, needed outstaffing support with big data management solution development. So, our main goal was to create a data warehouse automation application, that provides ETL automation for the agile data warehouse.

Project details

Platform
Desktop & Web
Services
Business Analytics, UX/UI design,
Desktop & Web development, QA
Partnership
2014 – 2015
Hours spent
50k+

The situation

Our main task was to develop a BI ETL solution for more quick and easy executing and managing ETL processes. Thus, the ETL toolkit enables users to control large volumes of data in the semi- or fully- automatic mode. Moreover, this toolkit can design a loading report in progress, stating entries loaded and not loaded. This tool also allows users to manage large volumes of data and support different data formats. To sum up, the solution should extract, transform and load data, as well as filter, unify, group, sort, and select it by condition.

The solution

In this project, we implemented such features:
  • Flexible transformation using visual tools with minimal usage of SQL
  • Support for a vast number of data formats such as XML, EDIFACT, DBF, TXT, Excel, and others
  • Allows the end-user to access industrial DBMSs such as Oracle, Microsoft SQL Server, IBM DB2

Technology stack

Key results

We developed both web and desktop applications that simplify data management and allow to perform a deep data analysis.