Architecture of scalability file system for meteorological observation data storing

I. A. Botygin, V. N. Popov, V. A. Tartakovsky, Vladislav Stanislavovich Sherstnev

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Citations (Scopus)

Abstract

The approach allows to organize distributed storage of large amounts of diverse data in order to further their parallel processing in high performance cluster systems for problems of climatic processes analysis and forecasting. For different classes of data was used the practice of using meta descriptions-like formalism associated with certain categories of resources. Development of a metadata component was made based on an analysis of data of surface meteorological observations, atmosphere vertical sounding, atmosphere wind sounding, weather radar observing, observations from satellites and others. A common set of metadata components was formed for their general description. The structure and content of the main components of a generalized meta descriptions are presented in detail on the example of reporting meteorological observations from land and sea stations.

Original languageEnglish
Title of host publicationProceedings of SPIE - The International Society for Optical Engineering
PublisherSPIE
Volume9680
ISBN (Print)9781628419085
DOIs
Publication statusPublished - 2015
Event21st International Symposium on Atmospheric and Ocean Optics: Atmospheric Physics - Tomsk, Russian Federation
Duration: 22 Jun 201526 Jun 2015

Other

Other21st International Symposium on Atmospheric and Ocean Optics: Atmospheric Physics
CountryRussian Federation
CityTomsk
Period22.6.1526.6.15

Fingerprint

File System
Metadata
files
Scalability
metadata
sounding
Meteorological radar
Atmosphere
meteorological radar
atmospheres
Satellites
Parallel Processing
Weather
forecasting
Radar
Forecasting
resources
High Performance
Processing
stations

Keywords

  • Big data
  • distributed file system
  • hydrometeorological observation data.
  • metadescription
  • operational code data

ASJC Scopus subject areas

  • Applied Mathematics
  • Computer Science Applications
  • Electrical and Electronic Engineering
  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics

Cite this

Botygin, I. A., Popov, V. N., Tartakovsky, V. A., & Sherstnev, V. S. (2015). Architecture of scalability file system for meteorological observation data storing. In Proceedings of SPIE - The International Society for Optical Engineering (Vol. 9680). [96800J] SPIE. https://doi.org/10.1117/12.2205749

Architecture of scalability file system for meteorological observation data storing. / Botygin, I. A.; Popov, V. N.; Tartakovsky, V. A.; Sherstnev, Vladislav Stanislavovich.

Proceedings of SPIE - The International Society for Optical Engineering. Vol. 9680 SPIE, 2015. 96800J.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Botygin, IA, Popov, VN, Tartakovsky, VA & Sherstnev, VS 2015, Architecture of scalability file system for meteorological observation data storing. in Proceedings of SPIE - The International Society for Optical Engineering. vol. 9680, 96800J, SPIE, 21st International Symposium on Atmospheric and Ocean Optics: Atmospheric Physics, Tomsk, Russian Federation, 22.6.15. https://doi.org/10.1117/12.2205749
Botygin IA, Popov VN, Tartakovsky VA, Sherstnev VS. Architecture of scalability file system for meteorological observation data storing. In Proceedings of SPIE - The International Society for Optical Engineering. Vol. 9680. SPIE. 2015. 96800J https://doi.org/10.1117/12.2205749
Botygin, I. A. ; Popov, V. N. ; Tartakovsky, V. A. ; Sherstnev, Vladislav Stanislavovich. / Architecture of scalability file system for meteorological observation data storing. Proceedings of SPIE - The International Society for Optical Engineering. Vol. 9680 SPIE, 2015.
@inproceedings{16ff54455935409f804e2d5c647b3575,
title = "Architecture of scalability file system for meteorological observation data storing",
abstract = "The approach allows to organize distributed storage of large amounts of diverse data in order to further their parallel processing in high performance cluster systems for problems of climatic processes analysis and forecasting. For different classes of data was used the practice of using meta descriptions-like formalism associated with certain categories of resources. Development of a metadata component was made based on an analysis of data of surface meteorological observations, atmosphere vertical sounding, atmosphere wind sounding, weather radar observing, observations from satellites and others. A common set of metadata components was formed for their general description. The structure and content of the main components of a generalized meta descriptions are presented in detail on the example of reporting meteorological observations from land and sea stations.",
keywords = "Big data, distributed file system, hydrometeorological observation data., metadescription, operational code data",
author = "Botygin, {I. A.} and Popov, {V. N.} and Tartakovsky, {V. A.} and Sherstnev, {Vladislav Stanislavovich}",
year = "2015",
doi = "10.1117/12.2205749",
language = "English",
isbn = "9781628419085",
volume = "9680",
booktitle = "Proceedings of SPIE - The International Society for Optical Engineering",
publisher = "SPIE",

}

TY - GEN

T1 - Architecture of scalability file system for meteorological observation data storing

AU - Botygin, I. A.

AU - Popov, V. N.

AU - Tartakovsky, V. A.

AU - Sherstnev, Vladislav Stanislavovich

PY - 2015

Y1 - 2015

N2 - The approach allows to organize distributed storage of large amounts of diverse data in order to further their parallel processing in high performance cluster systems for problems of climatic processes analysis and forecasting. For different classes of data was used the practice of using meta descriptions-like formalism associated with certain categories of resources. Development of a metadata component was made based on an analysis of data of surface meteorological observations, atmosphere vertical sounding, atmosphere wind sounding, weather radar observing, observations from satellites and others. A common set of metadata components was formed for their general description. The structure and content of the main components of a generalized meta descriptions are presented in detail on the example of reporting meteorological observations from land and sea stations.

AB - The approach allows to organize distributed storage of large amounts of diverse data in order to further their parallel processing in high performance cluster systems for problems of climatic processes analysis and forecasting. For different classes of data was used the practice of using meta descriptions-like formalism associated with certain categories of resources. Development of a metadata component was made based on an analysis of data of surface meteorological observations, atmosphere vertical sounding, atmosphere wind sounding, weather radar observing, observations from satellites and others. A common set of metadata components was formed for their general description. The structure and content of the main components of a generalized meta descriptions are presented in detail on the example of reporting meteorological observations from land and sea stations.

KW - Big data

KW - distributed file system

KW - hydrometeorological observation data.

KW - metadescription

KW - operational code data

UR - http://www.scopus.com/inward/record.url?scp=84963632399&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84963632399&partnerID=8YFLogxK

U2 - 10.1117/12.2205749

DO - 10.1117/12.2205749

M3 - Conference contribution

SN - 9781628419085

VL - 9680

BT - Proceedings of SPIE - The International Society for Optical Engineering

PB - SPIE

ER -