Accession number: 20143618131637

Authors: Zhang, Hailong1 ; Wang, Na1 ; Chen, Wu2 ; Nie, Jun1

Author affiliations:

Xinjiang Astronomical Observatory, Chinese Academy of Sciences, No. 150, Science 1-Street, Urumqi 830011, China

University of Western Australia, Stirling Highway, WA 6009, Australia

Source title: ICIC Express Letters

Abbreviated source title: ICIC Express Lett.

Volume: 8

Issue: 10

Issue date: October 2014

Publication year: 2014

Pages: 2805-2811

Language: English

ISSN: 1881803X

Document type: Journal article (JA)

Abstract:

The data volume in astronomical digital sky surveys has reached hundreds of PB per year. How to efficiently manage the massive astronomical data in explosive growth, how to achieve the integration on multi-wavelength observation data, and how to rapidly release the huge amounts of data generated by the larger telescopes are urgent problems needing to be addressed. The main purpose of this paper is to put forward an astronomical data warehouse architecture design to manage and publish massive astronomical data. In the proposed architecture data servers deal with the raw data obtained from telescopes based on a predefined integration strategy, and save the standardized metadata structure and information. We build a multi-level data storage model, to extract the different levels of data sets from the raw data. This multi-level data asset is formed by constructing an object-based database and data warehouse management system, where all data are centralized in a reliable storage. Catalogues with huge number of objects have not yet had an efficient cross matching algorithm to achieve data integration from different band observations. With the implementation of this data warehouse architecture, we were able to adopt a parallel computing model to evaluate the matching method of massive astronomical catalogue data. By improving the speed of matching, this method could potentially pave a way for the development of large-scale astronomical data of future larger telescopes and gain experience. © 2014 ICIC International.

Number of references: 16

Main heading: Information management

Controlled terms: Astronomy  -  Data integration  -  Data warehouses  -  Digital storage  -  Metadata  -  Parallel architectures  -  Telescopes

Uncontrolled terms:

Astronomical catalogues  -  Catalogue  -  Data warehouse architecture  -  Data warehouse management systems  -  Massive data  -  Matching  -  Parallel computing models  -  Proposed architectures

Classification code:

657 Space Physics -  657.2 Extraterrestrial Physics and Stellar Phenomena -  722.1 Data Storage, Equipment and Techniques -  723 Computer Software, Data Handling and Applications -  903.2 Information Dissemination

Database: Compendex