Research Output

Towards a framework for dealing with data quality in data warehouses.

  The popularity of data warehouses (DWs) in recent years confirms the importance of data quality in today’s business success. It is estimated that as high as 75% of the effort spent on building a data warehouse can be attributed to back-end issues, such as readying the data and transporting it into the data warehouse. In order to improve the efficiency of building up a data warehouse, other than issues about design and implementation, data cleaning is a crucial task. Regarding this task, there are at least two questions needed to be answered: How can we manage to reduce the time used for data cleaning? How can we manage to improve the degree of automation when performing data cleaning? This paper attempts to answer these two questions by presenting a novel framework, which provides an approach to managing data cleaning in data warehouses by focusing on the use of data quality factors, and decoupling the cleaning process into several sub-processes. Initial test run of the processes in the framework demonstrates that the approach presented is efficient and scalable for cleaning data in data warehouses.

  • Type:

    Book Chapter

  • Date:

    30 November 2005

  • Publication Status:

    Published

  • Publisher

    ATINER

  • Library of Congress:

    QA75 Electronic computers. Computer science

  • Dewey Decimal Classification:

    004 Data processing & computer science

Citation

Peng, T. (2005). Towards a framework for dealing with data quality in data warehouses. In Petratos, P. (Ed.). Current Computing Developments in E-Commerce, Security, HCI, DB, Collaborative and Cooperative Systems, 241-256. ATINER. ISBN 960-6672-07-7

Authors

Keywords

Data warehouses; quality; cleaning; framework; scalable;

Available Documents