Data Integration


Data Integration, also known as ETL (Extract, Transform, Load), means combining data from different, often heterogeneous, sources in a way that provides a unified view on this data. It is typically used for integration of different applications and is therefore essential in an enterprise environment. Another term that is ofted used in conjunction with data integration is Data Warehouse, a report-friendly data store.

As a database specialist, I've been involved in data integration tasks throughout my entire career. I'm a certified Informatica PowerCenter developer (PowerCenter is one of the most powerful ETL solutions on the market). I have also developed a lightweight ETL application in Python myself.

Below are some projects I've developed.

DMD Jockey

Web application for centralised management of static and market data.

  • Client: ING Financial Markets
  • Timeline: July – September 2016
  • Technologies: Java 8, Oracle 11g, Hibernate ORM, Spring, Maven, Apache Tomcat, Twitter Bootstrap, AngularJS, Angular UI Bootstrap, Jasmine, Protractor

iSZN

Document and payment management system for social institutions.

  • Client: Numerous regional social institutions
  • Timeline: 2000 – 2008
  • Technologies: Delphi, Oracle, Java, JSP, Win32 API

More info

Rattle

Lightweight and modular ETL application that uses data flow definitions in JSON format.

  • Client: Public Domain
  • Timeline: June 2015 – now
  • Technologies: Python 3, Oracle

More info Source code