IDEAS home Printed from https://ideas.repec.org/a/igg/jdwm00/v9y2013i2p21-38.html
   My bibliography  Save this article

On-Demand ELT Architecture for Right-Time BI: Extending the Vision

Author

Listed:
  • Florian Waas

    (EMC Corporation, Hopkinton, MA, USA)

  • Robert Wrembel

    (Faculty of Computing, Poznan University of Technology, Poznan, Poland)

  • Tobias Freudenreich

    (Department of Computer Science, Technische Universität Darmstadt, Darmstadt, Germany)

  • Maik Thiele

    (Database Technology Group, Technische Universität Dresden, Dresden, Germany)

  • Christian Koncilia

    (Institute for Information-Systems, University of Klagenfurt, Klagenfurt, Austria)

  • Pedro Furtado

    (Department of Informatics Engineering, University of Coimbra, Coimbra, Portugal)

Abstract

In a typical BI infrastructure, data, extracted from operational data sources, is transformed, cleansed, and loaded into a data warehouse by a periodic ETL process, typically executed on a nightly basis, i.e., a full day’s worth of data is processed and loaded during off-hours. However, it is desirable to have fresher data for business insights at near real-time. To this end, the authors propose to leverage a data warehouse’s capability to directly import raw, unprocessed records and defer the transformation and data cleaning until needed by pending reports. At that time, the database’s own processing mechanisms can be deployed to process the data on-demand. Event-processing capabilities are seamlessly woven into our proposed architecture. Besides outlining an overall architecture, the authors also developed a roadmap for implementing a complete prototype using conventional database technology in the form of hierarchical materialized views.

Suggested Citation

  • Florian Waas & Robert Wrembel & Tobias Freudenreich & Maik Thiele & Christian Koncilia & Pedro Furtado, 2013. "On-Demand ELT Architecture for Right-Time BI: Extending the Vision," International Journal of Data Warehousing and Mining (IJDWM), IGI Global, vol. 9(2), pages 21-38, April.
    • Handle: RePEc:igg:jdwm00:v:9:y:2013:i:2:p:21-38
    as

    Download full text from publisher

    File URL: http://services.igi-global.com/resolvedoi/resolve.aspx?doi=10.4018/jdwm.2013040102
    Download Restriction: no
    ---><---

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:igg:jdwm00:v:9:y:2013:i:2:p:21-38. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Journal Editor (email available below). General contact details of provider: https://www.igi-global.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.