Distributed information system for processing and storage of meteorological data

Research output: Chapter in Book/Report/Conference proceedingConference contribution

14 Citations (Scopus)

Abstract

The following article features the results of developing distributed network storage of ground meteorological observation data. The data is represented with the national variant of international rapid transmission code of environment data from meteorological stations across the Russian Federation. They are available for researchers in both visual and common export formats. The design of the distributed network storage of meteorological data includes the following modules: dispatcher module (monitors calculation nodes, distributes data to nodes, processes client requests), client module (allows external researchers to access the meteorological data), terminal module (used to import new meteorological data), data processing and storage module (a node for distributed meteorological data storage, consists of two sub-modules for data processing and data storage respectively). The article displays the results of practical testing of the developed software. To simulate the cluster of informational and calculation servers in the pilot project, multithreading was used. Multithreading is supported by nearly every operational system for parallel data processing. The development tools chosen for the network storage allowed to design storage module interaction with the optimal efficiency, to ensure proper performance, stability and reliability of processing and managing large amounts of data. The obtained results allow using the designs for efficient management of meteorological surface observation data, for rapid data gathering, for systematization and storage of hydro-meteorological data in different alphanumeric codes and other related categories.

Original languageEnglish
Title of host publicationKey Engineering Materials
PublisherTrans Tech Publications Ltd
Pages867-871
Number of pages5
Volume685
ISBN (Print)9783038357087
DOIs
Publication statusPublished - 2016
Event4th International Conference for Young Scientists High Technology: Research and Applications, HTRA 2015 - Tomsk, Russian Federation
Duration: 21 Apr 201524 Apr 2015

Publication series

NameKey Engineering Materials
Volume685
ISSN (Print)10139826

Other

Other4th International Conference for Young Scientists High Technology: Research and Applications, HTRA 2015
CountryRussian Federation
CityTomsk
Period21.4.1524.4.15

Fingerprint

Information systems
Processing
Data storage equipment
Servers
Testing

Keywords

  • Code for rapid transmission of surface meteorological observation data
  • Cross-platform development
  • Database management systems
  • Distributed systems
  • Information technology
  • Network data storage
  • Network storage architecture
  • Relational database
  • Surface meteorological observations

ASJC Scopus subject areas

  • Materials Science(all)
  • Mechanics of Materials
  • Mechanical Engineering

Cite this

Sherstnev, V. S., Sherstneva, A. I., Botygin, I. A., & Kustov, D. A. (2016). Distributed information system for processing and storage of meteorological data. In Key Engineering Materials (Vol. 685, pp. 867-871). (Key Engineering Materials; Vol. 685). Trans Tech Publications Ltd. https://doi.org/10.4028/www.scientific.net/KEM.685.867

Distributed information system for processing and storage of meteorological data. / Sherstnev, Vladislav Stanislavovich; Sherstneva, Anna Igorevna; Botygin, Igor A.; Kustov, Denis A.

Key Engineering Materials. Vol. 685 Trans Tech Publications Ltd, 2016. p. 867-871 (Key Engineering Materials; Vol. 685).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Sherstnev, VS, Sherstneva, AI, Botygin, IA & Kustov, DA 2016, Distributed information system for processing and storage of meteorological data. in Key Engineering Materials. vol. 685, Key Engineering Materials, vol. 685, Trans Tech Publications Ltd, pp. 867-871, 4th International Conference for Young Scientists High Technology: Research and Applications, HTRA 2015, Tomsk, Russian Federation, 21.4.15. https://doi.org/10.4028/www.scientific.net/KEM.685.867
Sherstnev VS, Sherstneva AI, Botygin IA, Kustov DA. Distributed information system for processing and storage of meteorological data. In Key Engineering Materials. Vol. 685. Trans Tech Publications Ltd. 2016. p. 867-871. (Key Engineering Materials). https://doi.org/10.4028/www.scientific.net/KEM.685.867
Sherstnev, Vladislav Stanislavovich ; Sherstneva, Anna Igorevna ; Botygin, Igor A. ; Kustov, Denis A. / Distributed information system for processing and storage of meteorological data. Key Engineering Materials. Vol. 685 Trans Tech Publications Ltd, 2016. pp. 867-871 (Key Engineering Materials).
@inproceedings{1964eb7bf64d40ac880c8f1547967b31,
title = "Distributed information system for processing and storage of meteorological data",
abstract = "The following article features the results of developing distributed network storage of ground meteorological observation data. The data is represented with the national variant of international rapid transmission code of environment data from meteorological stations across the Russian Federation. They are available for researchers in both visual and common export formats. The design of the distributed network storage of meteorological data includes the following modules: dispatcher module (monitors calculation nodes, distributes data to nodes, processes client requests), client module (allows external researchers to access the meteorological data), terminal module (used to import new meteorological data), data processing and storage module (a node for distributed meteorological data storage, consists of two sub-modules for data processing and data storage respectively). The article displays the results of practical testing of the developed software. To simulate the cluster of informational and calculation servers in the pilot project, multithreading was used. Multithreading is supported by nearly every operational system for parallel data processing. The development tools chosen for the network storage allowed to design storage module interaction with the optimal efficiency, to ensure proper performance, stability and reliability of processing and managing large amounts of data. The obtained results allow using the designs for efficient management of meteorological surface observation data, for rapid data gathering, for systematization and storage of hydro-meteorological data in different alphanumeric codes and other related categories.",
keywords = "Code for rapid transmission of surface meteorological observation data, Cross-platform development, Database management systems, Distributed systems, Information technology, Network data storage, Network storage architecture, Relational database, Surface meteorological observations",
author = "Sherstnev, {Vladislav Stanislavovich} and Sherstneva, {Anna Igorevna} and Botygin, {Igor A.} and Kustov, {Denis A.}",
year = "2016",
doi = "10.4028/www.scientific.net/KEM.685.867",
language = "English",
isbn = "9783038357087",
volume = "685",
series = "Key Engineering Materials",
publisher = "Trans Tech Publications Ltd",
pages = "867--871",
booktitle = "Key Engineering Materials",

}

TY - GEN

T1 - Distributed information system for processing and storage of meteorological data

AU - Sherstnev, Vladislav Stanislavovich

AU - Sherstneva, Anna Igorevna

AU - Botygin, Igor A.

AU - Kustov, Denis A.

PY - 2016

Y1 - 2016

N2 - The following article features the results of developing distributed network storage of ground meteorological observation data. The data is represented with the national variant of international rapid transmission code of environment data from meteorological stations across the Russian Federation. They are available for researchers in both visual and common export formats. The design of the distributed network storage of meteorological data includes the following modules: dispatcher module (monitors calculation nodes, distributes data to nodes, processes client requests), client module (allows external researchers to access the meteorological data), terminal module (used to import new meteorological data), data processing and storage module (a node for distributed meteorological data storage, consists of two sub-modules for data processing and data storage respectively). The article displays the results of practical testing of the developed software. To simulate the cluster of informational and calculation servers in the pilot project, multithreading was used. Multithreading is supported by nearly every operational system for parallel data processing. The development tools chosen for the network storage allowed to design storage module interaction with the optimal efficiency, to ensure proper performance, stability and reliability of processing and managing large amounts of data. The obtained results allow using the designs for efficient management of meteorological surface observation data, for rapid data gathering, for systematization and storage of hydro-meteorological data in different alphanumeric codes and other related categories.

AB - The following article features the results of developing distributed network storage of ground meteorological observation data. The data is represented with the national variant of international rapid transmission code of environment data from meteorological stations across the Russian Federation. They are available for researchers in both visual and common export formats. The design of the distributed network storage of meteorological data includes the following modules: dispatcher module (monitors calculation nodes, distributes data to nodes, processes client requests), client module (allows external researchers to access the meteorological data), terminal module (used to import new meteorological data), data processing and storage module (a node for distributed meteorological data storage, consists of two sub-modules for data processing and data storage respectively). The article displays the results of practical testing of the developed software. To simulate the cluster of informational and calculation servers in the pilot project, multithreading was used. Multithreading is supported by nearly every operational system for parallel data processing. The development tools chosen for the network storage allowed to design storage module interaction with the optimal efficiency, to ensure proper performance, stability and reliability of processing and managing large amounts of data. The obtained results allow using the designs for efficient management of meteorological surface observation data, for rapid data gathering, for systematization and storage of hydro-meteorological data in different alphanumeric codes and other related categories.

KW - Code for rapid transmission of surface meteorological observation data

KW - Cross-platform development

KW - Database management systems

KW - Distributed systems

KW - Information technology

KW - Network data storage

KW - Network storage architecture

KW - Relational database

KW - Surface meteorological observations

UR - http://www.scopus.com/inward/record.url?scp=84958225831&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84958225831&partnerID=8YFLogxK

U2 - 10.4028/www.scientific.net/KEM.685.867

DO - 10.4028/www.scientific.net/KEM.685.867

M3 - Conference contribution

SN - 9783038357087

VL - 685

T3 - Key Engineering Materials

SP - 867

EP - 871

BT - Key Engineering Materials

PB - Trans Tech Publications Ltd

ER -