XLETL
XLETL - solution for data warehouses which automates data integration of Excel spread sheets into SQL server using extract, transform, and load (ETL) process. This was my BSc (Honours) final year project. Below is the short description of the project and all documents associated with my final year project. Most of the documents have been converted to PDF, so you will need to download Adobe Acrobat Reader.
Extracting data from data sources, transforming and loading data into a data warehouse system is one of the most costs intensive tasks in the day-to-day activities of many IT companies. Data integration tools, available on the market, can be used to connect different sources and target systems to create ETL solutions but these tools are not always suitable. Many businesses' process of data exchange involves spread sheets. Internally generated or customer-provided data must be loaded into data warehouse. The purpose of this project is to design and develop the solution for data warehouse that will automate data integration of Excel spread sheets into SQL server using extract, transform, and load (ETL) process. The proposed solution is based on the idea of creating the ETL task workflow configuration for a specific data integration case, generating spread sheet template which will be used by a customer, and loading data, received from the customer into a data warehouse follow the strictly defined task configuration. This project embraces the design and development practice of variety of application types and architecture styles focusing on the utilisation of Microsoft technologies. The Unified Process Model has been used throughout the entire project life cycle. The implemented system can be useful for the small and medium enterprises that operate customer-centric businesses using a data warehouse and face data integration process on a daily basis.
Code repository can be found here.
Extracting data from data sources, transforming and loading data into a data warehouse system is one of the most costs intensive tasks in the day-to-day activities of many IT companies. Data integration tools, available on the market, can be used to connect different sources and target systems to create ETL solutions but these tools are not always suitable. Many businesses' process of data exchange involves spread sheets. Internally generated or customer-provided data must be loaded into data warehouse. The purpose of this project is to design and develop the solution for data warehouse that will automate data integration of Excel spread sheets into SQL server using extract, transform, and load (ETL) process. The proposed solution is based on the idea of creating the ETL task workflow configuration for a specific data integration case, generating spread sheet template which will be used by a customer, and loading data, received from the customer into a data warehouse follow the strictly defined task configuration. This project embraces the design and development practice of variety of application types and architecture styles focusing on the utilisation of Microsoft technologies. The Unified Process Model has been used throughout the entire project life cycle. The implemented system can be useful for the small and medium enterprises that operate customer-centric businesses using a data warehouse and face data integration process on a daily basis.
-
Add database
-
Add task
-
Add timer
-
Add Transformation
-
Add user
-
Task management
-
Web login
-
Web tasks
Comments
Post a Comment