TY - GEN
T1 - Distributed information system for processing and storage of meteorological data
AU - Sherstnev, Vladislav Stanislavovich
AU - Sherstneva, Anna Igorevna
AU - Botygin, Igor A.
AU - Kustov, Denis A.
PY - 2016
Y1 - 2016
N2 - The following article features the results of developing distributed network storage of ground meteorological observation data. The data is represented with the national variant of international rapid transmission code of environment data from meteorological stations across the Russian Federation. They are available for researchers in both visual and common export formats. The design of the distributed network storage of meteorological data includes the following modules: dispatcher module (monitors calculation nodes, distributes data to nodes, processes client requests), client module (allows external researchers to access the meteorological data), terminal module (used to import new meteorological data), data processing and storage module (a node for distributed meteorological data storage, consists of two sub-modules for data processing and data storage respectively). The article displays the results of practical testing of the developed software. To simulate the cluster of informational and calculation servers in the pilot project, multithreading was used. Multithreading is supported by nearly every operational system for parallel data processing. The development tools chosen for the network storage allowed to design storage module interaction with the optimal efficiency, to ensure proper performance, stability and reliability of processing and managing large amounts of data. The obtained results allow using the designs for efficient management of meteorological surface observation data, for rapid data gathering, for systematization and storage of hydro-meteorological data in different alphanumeric codes and other related categories.
AB - The following article features the results of developing distributed network storage of ground meteorological observation data. The data is represented with the national variant of international rapid transmission code of environment data from meteorological stations across the Russian Federation. They are available for researchers in both visual and common export formats. The design of the distributed network storage of meteorological data includes the following modules: dispatcher module (monitors calculation nodes, distributes data to nodes, processes client requests), client module (allows external researchers to access the meteorological data), terminal module (used to import new meteorological data), data processing and storage module (a node for distributed meteorological data storage, consists of two sub-modules for data processing and data storage respectively). The article displays the results of practical testing of the developed software. To simulate the cluster of informational and calculation servers in the pilot project, multithreading was used. Multithreading is supported by nearly every operational system for parallel data processing. The development tools chosen for the network storage allowed to design storage module interaction with the optimal efficiency, to ensure proper performance, stability and reliability of processing and managing large amounts of data. The obtained results allow using the designs for efficient management of meteorological surface observation data, for rapid data gathering, for systematization and storage of hydro-meteorological data in different alphanumeric codes and other related categories.
KW - Code for rapid transmission of surface meteorological observation data
KW - Cross-platform development
KW - Database management systems
KW - Distributed systems
KW - Information technology
KW - Network data storage
KW - Network storage architecture
KW - Relational database
KW - Surface meteorological observations
UR - http://www.scopus.com/inward/record.url?scp=84958225831&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84958225831&partnerID=8YFLogxK
U2 - 10.4028/www.scientific.net/KEM.685.867
DO - 10.4028/www.scientific.net/KEM.685.867
M3 - Conference contribution
AN - SCOPUS:84958225831
SN - 9783038357087
VL - 685
T3 - Key Engineering Materials
SP - 867
EP - 871
BT - Key Engineering Materials
PB - Trans Tech Publications Ltd
T2 - 4th International Conference for Young Scientists High Technology: Research and Applications, HTRA 2015
Y2 - 21 April 2015 through 24 April 2015
ER -