Abstract
The following article features the results of developing distributed network storage of ground meteorological observation data. The data is represented with the national variant of international rapid transmission code of environment data from meteorological stations across the Russian Federation. They are available for researchers in both visual and common export formats. The design of the distributed network storage of meteorological data includes the following modules: dispatcher module (monitors calculation nodes, distributes data to nodes, processes client requests), client module (allows external researchers to access the meteorological data), terminal module (used to import new meteorological data), data processing and storage module (a node for distributed meteorological data storage, consists of two sub-modules for data processing and data storage respectively). The article displays the results of practical testing of the developed software. To simulate the cluster of informational and calculation servers in the pilot project, multithreading was used. Multithreading is supported by nearly every operational system for parallel data processing. The development tools chosen for the network storage allowed to design storage module interaction with the optimal efficiency, to ensure proper performance, stability and reliability of processing and managing large amounts of data. The obtained results allow using the designs for efficient management of meteorological surface observation data, for rapid data gathering, for systematization and storage of hydro-meteorological data in different alphanumeric codes and other related categories.
| Original language | English |
|---|---|
| Title of host publication | Key Engineering Materials |
| Publisher | Trans Tech Publications Ltd |
| Pages | 867-871 |
| Number of pages | 5 |
| Volume | 685 |
| ISBN (Print) | 9783038357087 |
| DOIs | |
| Publication status | Published - 2016 |
| Event | 4th International Conference for Young Scientists High Technology: Research and Applications, HTRA 2015 - Tomsk, Russian Federation Duration: 21 Apr 2015 → 24 Apr 2015 |
Publication series
| Name | Key Engineering Materials |
|---|---|
| Volume | 685 |
| ISSN (Print) | 10139826 |
Other
| Other | 4th International Conference for Young Scientists High Technology: Research and Applications, HTRA 2015 |
|---|---|
| Country | Russian Federation |
| City | Tomsk |
| Period | 21.4.15 → 24.4.15 |
Fingerprint
Keywords
- Code for rapid transmission of surface meteorological observation data
- Cross-platform development
- Database management systems
- Distributed systems
- Information technology
- Network data storage
- Network storage architecture
- Relational database
- Surface meteorological observations
ASJC Scopus subject areas
- Materials Science(all)
- Mechanics of Materials
- Mechanical Engineering
Cite this
Distributed information system for processing and storage of meteorological data. / Sherstnev, Vladislav Stanislavovich; Sherstneva, Anna Igorevna; Botygin, Igor A.; Kustov, Denis A.
Key Engineering Materials. Vol. 685 Trans Tech Publications Ltd, 2016. p. 867-871 (Key Engineering Materials; Vol. 685).Research output: Chapter in Book/Report/Conference proceeding › Conference contribution
}
TY - GEN
T1 - Distributed information system for processing and storage of meteorological data
AU - Sherstnev, Vladislav Stanislavovich
AU - Sherstneva, Anna Igorevna
AU - Botygin, Igor A.
AU - Kustov, Denis A.
PY - 2016
Y1 - 2016
N2 - The following article features the results of developing distributed network storage of ground meteorological observation data. The data is represented with the national variant of international rapid transmission code of environment data from meteorological stations across the Russian Federation. They are available for researchers in both visual and common export formats. The design of the distributed network storage of meteorological data includes the following modules: dispatcher module (monitors calculation nodes, distributes data to nodes, processes client requests), client module (allows external researchers to access the meteorological data), terminal module (used to import new meteorological data), data processing and storage module (a node for distributed meteorological data storage, consists of two sub-modules for data processing and data storage respectively). The article displays the results of practical testing of the developed software. To simulate the cluster of informational and calculation servers in the pilot project, multithreading was used. Multithreading is supported by nearly every operational system for parallel data processing. The development tools chosen for the network storage allowed to design storage module interaction with the optimal efficiency, to ensure proper performance, stability and reliability of processing and managing large amounts of data. The obtained results allow using the designs for efficient management of meteorological surface observation data, for rapid data gathering, for systematization and storage of hydro-meteorological data in different alphanumeric codes and other related categories.
AB - The following article features the results of developing distributed network storage of ground meteorological observation data. The data is represented with the national variant of international rapid transmission code of environment data from meteorological stations across the Russian Federation. They are available for researchers in both visual and common export formats. The design of the distributed network storage of meteorological data includes the following modules: dispatcher module (monitors calculation nodes, distributes data to nodes, processes client requests), client module (allows external researchers to access the meteorological data), terminal module (used to import new meteorological data), data processing and storage module (a node for distributed meteorological data storage, consists of two sub-modules for data processing and data storage respectively). The article displays the results of practical testing of the developed software. To simulate the cluster of informational and calculation servers in the pilot project, multithreading was used. Multithreading is supported by nearly every operational system for parallel data processing. The development tools chosen for the network storage allowed to design storage module interaction with the optimal efficiency, to ensure proper performance, stability and reliability of processing and managing large amounts of data. The obtained results allow using the designs for efficient management of meteorological surface observation data, for rapid data gathering, for systematization and storage of hydro-meteorological data in different alphanumeric codes and other related categories.
KW - Code for rapid transmission of surface meteorological observation data
KW - Cross-platform development
KW - Database management systems
KW - Distributed systems
KW - Information technology
KW - Network data storage
KW - Network storage architecture
KW - Relational database
KW - Surface meteorological observations
UR - http://www.scopus.com/inward/record.url?scp=84958225831&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84958225831&partnerID=8YFLogxK
U2 - 10.4028/www.scientific.net/KEM.685.867
DO - 10.4028/www.scientific.net/KEM.685.867
M3 - Conference contribution
SN - 9783038357087
VL - 685
T3 - Key Engineering Materials
SP - 867
EP - 871
BT - Key Engineering Materials
PB - Trans Tech Publications Ltd
ER -