A Secondary Storage Scheme for Multidimensional Data Preserving Proximity

Shimada, Teppei; Tsuji, Tatsuo; Higuchi, Ken
August 2009
Journal of Digital Information Management;Aug2009, Vol. 7 Issue 4, p227
Academic Journal
Multidimensional arrays storing multidimensional data in MOLAP are usually very sparse. They also suffer from the problem that the time consumed in sequential access to array elements heavily depends on the dimension along which elements are accessed. This dimension dependency would be caused by arranging multidimensional data in linear order on secondary storage and the logical proximity among the multidimensional data would be lost in physical storage. This situation can be alleviated by dividing the whole array into the set of subarrays called "chunks". However, further dimension dependency would be caused, unless the compressed chunks are arranged judiciously in the page buffer. The difference among the dimension cardinalities could also cause dimension dependency; slice operation along a dimension of large cardinality tends to consume much time. We will alleviate these two kinds of dimension dependency by introducing the notion of an "extended chunk". Extended chunks can contribute to preserve the logical proximity by adapting flexibly to the usual situation where data densities are very low and are not uniformly distributed. Based on extended chunks, we will propose secondary storage schemes for multidimensional datasets using a space-filling curve such as Z-curve. The evaluation result shows that the proposed storage schemes exhibit better performance while alleviating the dimension dependency.


Related Articles

  • Informatica PowerCenter.  // DM Review;Jan2006, Vol. 16 Issue 1, p60 

    The article evaluates the Informatica PowerCenter data warehousing solution from Informatica Corp. and offers information on its functionality, strengths and weaknesses.

  • Sunopsis Data Conductor.  // DM Review;Jan2006, Vol. 16 Issue 1, p62 

    The article evaluates the Sunopsis Data Conductor extract, transform and load product from Sunopsis and offers information on its functionality, strengths and weaknesses.

  • OVERVIEW OF ORACLE OLAP AND USING SQL FOR MANIPULATE MULTIDIMENSIONAL DATA. Vătuiu, Teodora; Popeangă, Vasile // Annals of the University of Petrosani Economics;2007, Vol. 7, p355 

    There are many PL/SQL packages that you can use directly in SQL*Plus or indirectly in Analytic Workspace Manager and OLAP Worksheet. Using SQL you can manipulate multidimensional data and extract that data into a relational table. In this article I discussed about some methods that you can use...

  • DW Design in the Real World, Part 5: Slowly Changing Dimensions. McKnight, William // DM Review;Jun2007, Vol. 17 Issue 6, p40 

    The article focuses on the effect of efficient data warehousing on slowly changing dimensions (SCD). The author discusses an alternative to standard styles and the use of a semaphore table in SCD. The semaphore table must be consisted of a process identification, an active state flag, a start...

  • The Proposal of Data Warehouse Validation. Tanuska, Pavol; Kebisek, Michal; Moravcik, Oliver; Vazan, Pavel // Computer Technology & Application;2011, Vol. 2 Issue 7, p650 

    The analysis of relevant standards and guidelines proved the lack of information on actions and activities concerning data warehouse testing. The absence of the complex data warehouse testing methodology seems to be crucial particularly in the phase of the data warehouse implementation. The aim...

  • DataFlux dfPower Studio.  // DM Review;Jan2006, Vol. 16 Issue 1, p59 

    The article evaluates the dfPower Studio data warehousing solution from Dataflux Corp. and offers information on its functionality, strengths and weaknesses.

  • Managing in 3-D: Data, Diversity and Dollars.  // Government Procurement;Aug2007, Vol. 15 Issue 4, p30 

    The article focuses on the challenges faced by Denver's Office of Economic Development in retrieving research papers which are stored in a warehouse and a database with unorganized information in Colorado. This problem is likely to be compounded by a battle between two very strong and opposing...

  • Hydro-meteorological data analysis using OLAP techniques. Darío Duque-Méndez, Néstor; Orozco-Alzate, Mauricio; Julián Vélez, Jorge // Dyna;Jun2014, Vol. 81 Issue 185, p160 

    The wealth of data recorded by meteorological networks provides a great opportunity for analyzing and discovering knowledge. However, efficient data storage and its effective handling are prerequisites for meteorological and hydro-climatological research and require strategies for capturing,...

  • Establishing a Standard for CDS to LIMS Interfacing. DeWitte, Mike; Bolton, Steve // Scientific Computing & Instrumentation;Jan2003, Vol. 20 Issue 2, pC-23 

    Focuses on the factors to consider in establishing a standard for chromatographic data system and laboratory information management system in the U.S. Maintenance of multiple interfacing solutions; Reduction of the validation requirements; Management of a variety of data formats.


Read the Article


Sorry, but this item is not currently available from your library.

Try another library?
Sign out of this library

Other Topics