2017 № 4 (37)

Razakova M.G. IDENTIFICATION AND MAPPING OF OIL CONTAMINATION OF SOILS USING REMOTE SENSING DATA
Tarhanova O.Y. APPLICATION OF WIRELESS SENSOR NETWORKS IN PRECISION AGRICULTURE
Perepelkin V.A., Sofronov I.V., Tkacheva A.A. AUTOMATED CONSTRUCTION OF PARALLEL NUMERICAL PROGRAMS WITH SPECIFIED NON-FUNCTIONAL PROPERTIES BASED ON COMPUTATIONAL MODELS
Feoktistov A.G., Sidorov I.F., Gorsky S.A. AUTOMATION OF DEVELOPMENT AND APPLICATION OF DISTRIBUTED APPLIED SOFTWARE PACKAGES

National Center of Space Research and Technology,050010, Almaty, Kazakhstan

IDENTIFICATION AND MAPPING OF OIL CONTAMINATION OF SOILS USING REMOTE SENSING DATA

UDC 528.852.1

Remote sensing can potentially provide important information for identifying contaminated sites, but there is a clear lack of specific approved approaches. In this study, Landsat 8, were used to monitor the spatial and temporal changes of the polluted surfaces at the Ozen oil field. Presently, the affected areas consist of disintegrated tarmacs, black soil and thin vegetation. The use of multisensor datasets provided the opportunity to observe the polluted areas in different wavelengths. The images were numerical enhanced to optimize the visual outlook and improve the information content to determine the surface contaminants. There are suggested the histogram method of tone correction became the basis of automation of objects gradation. In this paper, using Landsat 8 data from May 29, 2016 to the Ozen deposit region, the possibility of obtaining quantitative characteristics of oil contamination by automated decoding methods was considered.

The reflectivity of soils polluted with petroleum products was estimated. Was considered about fifteen contaminated sites of the oilfield zone (pipelines, oil wells, reservoirs, etc.). It was shown that, depending on the level of soil pollution with oil and oil products, the nature of the spectral reflection curve changes in comparison with the background soils, which is mapped by a decrease in reflectivity as the degree of pollution increases

The characteristics of the vegetation cover, the behavior of the soil cover, and the spectral indices in the places of oil spills were studied. In places of oil spills there is a release of toxic substances that, when ingested into the soil, can cause changes in its physico-chemical properties, lead to a decrease in the functional activity of microbiota of soil biocenoses. This effect alters the vegetation cover, which may serve as a sign for the detection of oil pollution using remote sensing data.

On the basis of the studied spectral brightness coefficients, the satellites data were indexed in order to compare the results obtained and to identify oil contamination on the Ozen deposit investigated region.

In connection with the natural features of the study area, i.e. the scarcity of vegetation cover, in conditions of predominance of wormwood-solonchak desert with areas of shrubby vegetation on brown soils: the surface is partially covered with solonchaks, takyr-like solonetzes and sands with extremely rare vegetation; it is necessary to conduct a series of studies to identify areas of actual contamination with oil products. What essentially complicates the task.

The soil in the area of spots is characterized by low values of the vegetative and soil indices. It can also be noted that more than 50 % of the Ozen deposit under study has low NDVI index values from -0.076-0.1. Despite the fact that the acquisition date of image was in the active vegetation season.

The analysis shows that the soil in the spot area is characterized by low values of the vegetative and soil indices. It can also be noted that the contrast of background and contaminated soils is more pronounced. Oil products are dark in tone and when they get onto a ground, they reduce the reflection.

Based on these parameters, a four-channel image was synthesized from the panchromatic channel, SWIR (short-wave infrared channel) and NDVI, SAVI maps. Oil pollution has a greater contrast in the 5-7 channels of Landsat 8 satellite data. In this composite version, with using unsupervised classification (7 classes), the areas of the industrial zone, oil pollution and infrastructure objects are clearly distinguished. Previously, the negative values of the NDVI index were filtered out, to exclude water objects. The indexed images and the short-wave Landsat 8 data channel were normalized relative to each other and synthesized into a three-channel image (RGB -- color model). In general, the calculation of soil and vegetation indices is only addition information to our study, the essence of which is to that parameters strengthen the feature and isolate space for the detection of oil contamination. The algorithm for increasing the gradient between oil contaminated sites and the background is consist in the sequential addition and combination of indexed channels and data in the short-wave infrared zone of the Landsat 8 data spectrum.

The conclusion. As a result of the work, a map of oil spills was created on the area of the Ozen field, which showed that a significant part of the territory is polluted with oil. An algorithm has been developed that makes it possible to apply automatic classification of oil contamination on the earth's surface. Satellite images were enhanced by methods of geoinformation technologies to optimize the information content of remote sensing data to recognition of oil contaminated soil.

Key words: oil contamination of soil, remote sensing.
References
1. Aliev S. A., Gadzhiev D. A. Vliyanie zagryazneniya neftyanym organicheskim veschestvom na aktivnost biologicheskikh processov pochv [Influence of Oil Organic Pollution on the Activity of Biological Soil Processes], Izv. AzSSR. Ser. biol. Nauk. 1977. N 2. P. 46-49 (in Russian).

2. Ammosova Ya. M., Golev M. Yu. Vliyanie neftyanogo zagryazneniya na spectralnuyu otrazhatelnuyu sposobnost dernovo-podzolistykh pochv [Influence of oil pollution on the spectral reflectivity of sod-podzolic soils] // Vestn. Moscow State University. Ser. 17. Pochvovedenie [agrology]. 1998. N 3. S. 31-34 (in Russian).

3. Roy, Waleed and Asem, Samira. Application of GIS for Mapping Oil-Contaminated Soil in Kuwait // AMCIS 2007 Proceedings. Paper 484. [Electron. Res.].: http://aisel.aisnet.org/amcis2007/484

4. Espinosa-Hernandez A., Galvan-Pineda J., Monsivais-Huertero A., Jimenez-Escalona J. C., Ramos-Rodriguez J. M. Delineation of hydrocarbon contaminated soils using optical and radar images in a coastal region // Geoscience and Remote Sensing Symposium (IGARSS), 2013 IEEE International, Melbourne, VIC, Australia. 21-26 July 2013. P. 676-679.

Bibliographic reference: Razakova M.G. Identification and mapping of oil contamination of soils using remote sensing data //journal “Problems of informatics”. 2017, № 4. P. 4-15.

article

Tarhanova O. Y.

Novosibirsk State University, 630090, Novosibirsk, Russia

APPLICATION OF WIRELESS SENSOR NETWORKS IN PRECISION AGRICULTURE

UDC 004.72

The paper gives an overview of the agricultural application of wireless sensor networks. It is one of the promising tools that allows to increase productivity per unit of resources expended andto ensure the reduction of unit cost of production.Nowadays, prices for seeds, fertilizers, equipment, plant protection products and other means of production in agriculture are rising. This leads to the need to improve the efficiency of their use.

The paper notes that wireless sensor networks (WSN) are currently developing intensively as an important segment of wireless networks and as the global Internet in general. This circumstance makes it possible to position technologies of WSN and the networks themselves as one of the system-forming components of the concept of internet-things and other technologies of digitalization of the agrarian sector, the constructive implementation of which in turn is a prerequisite for asecond green revolution -- transition to precision agriculture. The agricultural domain is studied with respect to the application of WSNs in improving the traditional methods of farming. The ubiquitous nature of work and self-organizing small-sized nodes make it possible to use WSN as a potential tool for achieving the goal of automation in agriculture.More attention is paid to one of the most importantagricultural areas -- precision agriculture.Precisionagriculturecan be considered as an integrated high-tech crop management system that takes into account the variability of the plant habitat in the field.This system provides advanced means of recording and collecting data for monitoring the technological process and evaluating performance, automation and intellectualization of decision-making.On the example of precision agriculture together with the WSN, the paper provides a list of other more commonly used basic tools (global positioning and geographic information systems, spatial information collection and satellite monitoring, remote sensing, data analysis, etc.).

It is emphasizedthat the miniaturization of electronic systems and development of wireless technologies contribute to the active implementation of the WSN. Modern technology can reduce the cost of miniature sensors with low power consumption and the possibility of extracting energy from the environment, while maintaining the required functionality. The WSNis characterized as a multi-node system where each node is an inexpensive device equipped with one or more sensors, a processor, a memory, a power supply and a transceiver. These nodes are able to perform preprogrammed algorithms, exchange data with other nodes and interact with the master node. The architecture of the sensor network depends on many factors, such as fault tolerance, working environment, scalability, production costs, hardware limitations, transmission facilities and power consumption. The paper deals with options for ground and underground wireless sensor networks, their opportunities for the development of various types of agriculture. In addition, there are discussed the sensor architectures and various sensors used in the applications. There are sensors that are used to record and control parameters such as temperature, humidity, soil moisture, soil acidity, barometric pressure and illumination, and other characteristics. The analysis of various variants of the classification of WSN architectures that are possible for agricultural application is given: a) relative to the movement of network devices and nodes (stationary, mobile and hybrid architectures); b) by the type of used sensory nodes and associated devices (homogeneous and heterogeneous architectures); c) by the type of hierarchy (single-level and multi-level architecture).

The paper gives a brief overview of wireless technologies and standards that can be applied in agriculture (ZigBee -- with network and application protocols based on IEEE 802.15.4 standards for wireless networks using low-power devices, WiMAX -- a wireless standard related to Interoperational implementations of the IEEE 802.16 family of standards and others).

The paper also analyzes the main characteristics of the WSN, which enabled them to become a potential instrument of automation in the field of agriculture: the intellectual ability to make decisions; configuration of dynamic topology; fault tolerance; contextual awareness; scalability; tolerance to communication failures in harsh environmental conditions, heterogeneity of nodes, autonomous operation.

The final section of paper examines the existing examples of the application of wireless sensor networks in the world for various agricultural needs.

Key words: wireless sensor network, precision agriculture, sensor nodes, architecture, monitoring, agricultural applications.

References

1. Chen, N., Zhang, X., Wang, C. Integrated open geospatial web service enabled cyber-physical information infrastructure for precision agriculture monitoring // Comput. Electron. Agric. 2015. N 111, P. 78-91.

2. Misra, S., Krishna, P.V., Saritha, V., Agarwal, H., Shu, L., Obaidat, M.S. Efficient medium access control for cyber-physical systems with heterogeneous networks // IEEE Syst. J. 2015. N 9 (1), P. 22-30.

3. Gonzalez-de-Soto, M., Emmi, L., Benavides, C., Garcia, I., Gonzalez-de-Santos, P. Reducing air pollution with hybrid-powered robotic tractors for precision agriculture //Biosystems Engineering, 2016. V. 143, P. 79-94.

4. Maurya, S., Jain, V. 2016. Fuzzy based energy efficient sensor network protocol for precision agriculture // Computers and Electronics in Agriculture. 2016. V. 130, P. 20-37.

5. Ngo, V., Woungang, I., Anpalagan, A., 2014. A schedule-based medium access control protocol for mobile wireless sensor networks // Wirel. Commun. Mobile Comput. 2016. N 14 (6). P. 629-643.

6. Foughali, K., Fathalah, K., Ali, F. Monitoring system using web of things in precision agriculture // Procedia Computer Science. 2017. V. 110. P. 402-409.

7. Misra, S., Kar, P., Roy, A., Obaidat, M.S., 2014. Existence of dumb nodes in stationary wireless sensor network // J. Syst. Softw. 2014. N 91.P. 135-146.

8. Qu, Y., Zhu, Y., Han, W., Wang, J., Ma, M. Crop leaf area index observations with a wireless sensor network and its potential for validating remote sensing products // IEEE J. Sel. Top. Appl. Earth Observ. Rem. Sens. 2014. N 7 (2). P. 431-444.

9. Shakhov, V. Experiment Design for Parameter Estimation in Sensing Models // Springer LNCS. 2013. V. 8072. P. 151-158.

10. Riquelme, J.A.L., Soto, F., Suardíaz, J., Sánchez, P., Iborra, A., Vera, J.A. Wireless sensor networks for precision horticulture in southern Spain // Comput. Electron. Agric. 2009. N 68 (1). P. 25-35.

11. Garcia-Sanchez, A.J., Garcia-Sanchez, F., Garcia-Haro, J. Wireless sensor network deployment for integrating video-surveillance and data-monitoring in precision agriculture over distributed crops // Comput. Electron. Agric. 2011. N 75 (2). P. 288-303.

12. Camilli, A., Cugnasca, C.E., Saraiva, A.M., Hirakawa, A.R., Corrêa, P.L. From wireless sensors to field mapping: anatomy of an application for precision agriculture // Comput. Electron. Agric. 2007. N 58 (1). P. 25-36.

13. Behzadan, A., Anpalagan, A., Woungang, I., Ma, B., Chao, H.C. An energy efficient utility-based distributed data routing scheme for heterogeneous sensor networks // Wirel. Commun. Mobile Comput. 2014. [Electron. Res.].: http://dx.doi.org/10.1002/wcm.2474.

14. Dhurandher, S.K., Sharma, D.K., Woungang, I., Saini, A. Efficient routing based on past information to predict the future location for message passing in infrastructure-less opportunistic networks. J. Supercomput. 2014. [Electron. Res.].: http://dx.doi.org/10.1007/s11227-014-1243-5.

15. Postel, S.L. Entering an era of water scarcity: the challenges ahead //Ecol. Appl. 1999. N 10. P. 941-948.

16. Bouwer, H. Integrated water management: emerging issues and challenges // Agric. Water Manage. 2000. N 45 (3). P. 217-228.

17. Saleth, R., Dinar, A. Institutional changes in global water sector: trends, patterns, and implications // Water Policy. 2000. N 2 (3). P. 175-199.

18. Jury, W.A., Vaux Jr., H.J. The emerging global water crisis: managing scarcity and conflict between water users // Adv. Agron. 2007. N 95. P. 1-76.

19. Falloon, P., Betts, R. Climate impacts on european agriculture and water management in the context of adaptation and mitigation -- the importance of an integrated approach // Sci. Total Environ. 2010. N 408 (23). P. 5667-5687.

20. Mueller, N.D., Gerber, J.S., Johnston, M., Ray, D.K., Ramankutty, N., Foley, J.A. Closing yield gaps through nutrient and water management // Nature. 2012. N 490. P. 254-257.

21. J'son&PartnersConsulting, 2017. Communication technologies for the Internet of things in agriculture and the role of telecom operators. [El. Res.].: https://clck.ru/CBqQd.

22. Suprem, A., Mahalik, N., Kim, K. A review on application of technology systems, standard sand interfaces for agriculture and food sector // Comput. Stand. Interfaces. 2013. N 35 (4). P. 355-364.

23. Wang, N., Zhang, N., Wang, M. Wireless sensors in agriculture and food industry -- recent development and future perspective // Comput. Electron. Agric. 2006. N 50 (1). P. 1-14.

24. Hart, J.K., Martinez, K. Environmental sensor networks: a revolution in the earth system science // Earth Sci. Rev. 2006. N 78 (3-4). P. 177-191.

25. Burrell, J., Brooke, T., Beckwith, R. Vineyard computing: sensor networks in agricultural production // IEEE Pervasive Comput. 2004. N 3 (1). P. 38-45.

26. Diallo, O., Rodrigues, J.J.P.C., Sene, M., Mauri, J.L. Distributed database management techniques for wireless sensor networks // IEEE Trans. Parallel Distrib. Syst. 2015. N 26 (2). P. 604-620.

27. Srbinovska, M., Gavrovski, C., Dimcev, V., Krkoleva, A., Borozan, V. Environmental parameters monitoring in precision agriculture using wireless sensor networks // J. Clean. Prod. 2015. N 88. P. 297-307.

28. Zhao, L., He, L., Jin, X., Yu, W. Design of wireless sensor network middleware for agricultural applications // Proc. IFIP Adv. Inform. Commun. Technol. 2013. N 393. P. 270-279.

29. Karim, L., Anpalagan, A., Nasser, N., Almhana, J. Sensor-based M2M agriculture monitoring systems for developing countries: state and challenges // Netw. Protoc. Algor. 2013. N 5 (3). P. 68-86.

30. Zhang, H., Shu, L., Rodrigues, J.J., Chieh Chao, H. Solving network isolation problem in duty-cycled wireless sensor networks // Proceeding of the International Conference on Mobile Systems, Applications, and Services (MobiSys). 2013. P. 543-544.

31. Krishna, P.V., Saritha, V., Vedha, G., Bhiwal, A., Chawla, A.S., 2012. Quality-of-service-enabled ant colony-based multipath routing for mobile ad hoc networks // IET Commun. 2012. N 6 (1). P. 76-83.

32. Shakhov, V., Migov, D., Rodionov, A. Operation strategy for energy harvesting wireless sensor networks // Proceedings of the ACM 9th Int. Conf. on Ubiquitous Information Management and Communication, New York, USA. 2015.

33. Shakhov V.V., Yurgenson A.N., Sokolova O.D. Modeling the impact of the Black Hole attack on wireless networks // Software products and systems. 2017. N 1. P. 34-39.

34. Mirabella, O., Brischetto, M. A hybrid wired/wireless networking infrastructure for greenhouse management // IEEE Trans. Instrum. Meas. 2011. N 60 (2). P. 398-407.

35. Gennaro,S., Matese, A., Gioli, B., Toscano, P., Zaldei, A., Palliotti, A., Genesio, L. Multisensor approach to assess vineyard thermal dynamics combining high-resolution unmanned aerial vehicle (UAV) remote sensing and wireless sensor network (WSN) proximal sensing // ScientiaHorticulturae. 2017. V. 221. P. 83-87.

36. Brewster, C., Roussaki, I., Kalatzis, N., Doolin, K., Ellis, K. IoT in Agriculture: Designing a Europe-Wide Large-Scale Pilot. 2017.

37. IEEE Communications Magazine. V. 55. N 9. P. 26-33.

38. Mat, I., Kassim, M., Harun, A., Yusoff, I., 2016. IoT in Precision Agriculture applications using Wireless Moisture Sensor Network // Proceedings of IEEEConference on Open Systems. 2016. P. 24-29.

39. Shakhov V. V., Strelnikov V. E., Nguyen V. D. To the question of the effectiveness of wireless sensor networks // Problems of Informatics. 2014. N 2 (23). P. 28-38.

40. Migov D. A. Reliability indicator for wireless self-organizing networks // Bulletin of SibGUTI. 2014. N 3 (27). P. 3-12.

41. Ojha, T., Bera, S., Misra, S., Raghuwanshi, N.S. Dynamic duty scheduling for green sensor-cloud applications // Proceedings of IEEE CloudCom, Singapore. 2014.

42. Misra, S., Krishna, P.V., Kalaiselvan, K., Saritha, V., Obaidat, M.S. Learning automata-based QoS framework for cloud IaaS // IEEE Trans. Netw. Serv. Manage. 2014. N 11 (1). P. 15-24.

43. Cho, Y., Cho, K., Shin, C., Park, J., Lee, E.S. An agricultural expert cloud for a smart farm // Proceedings of Future Information Technology, Application, and Service. Lecture Notes in Electrical Engineering. Springer. V. 164. P. 657-662.

44. Atzori, L., Iera, A., Morabito, G. The internet of things: a survey // Comput. Netw. 2010. N 54 (15). P. 2787-2805.

45. Gubbi, J., Buyya, R., Marusic, S., Palaniswami, M. Internet of Things (IoT): a vision, architectural elements, and future directions // Future Gener. Comput. Syst. 2013. N 29 (7). P. 1645-1660.

46. Moghaddam, M., Entekhabi, D., Goykhman, Y., Li, K., Liu, M., Mahajan, A., Nayyar, A., Shuman, D., Teneketzis, D. A wireless soil moisture smart sensor web using physics-based optimal control: concept and initial demonstrations // IEEE J. Sel. Top. Appl. Earth Observ. Rem. Sens. 2010. N 3 (4). P. 522-535.

47. Bastiaanssen, W.G.M., Molden, D.J., Makin, I.W. Remote sensing for irrigated agriculture: examples from research and possible applications // Agric. Water Manage. 2000. N 46 (2). P. 137-155.

48. Morais, R., Fernandes, M.A., Matos, S.G., Serôdio, C., Ferreira, P.J.S.G., Reis, M.J.C.S. A ZigBee multi-powered wireless acquisition device for remote sensing applications in precision viticulture // Comput. Electron. Agric. 2008. N 62 (2). P.94-106.

49. Ye, J., Chen, B., Liu, Q., Fang, Y. A precision agriculture management system based on Internet of Things and WebGIS // Proceedings of International Conference on Geoinformatics. 2013. P. 1-5.

50. Akyildiz, I.F., Su, W., Sankarasubramaniam, Y., Cayirci, E. A survey on sensor networks // IEEE Commun. Mag. 2002. N 40 (8). P. 102-114.

51. Shakhov, V. On Efficiency Improvement of Energy Harvesting Wireless Sensor Networks // Processing of IEEE 39th International Conference on Telecommunications and Signal, Vienna, Austria, 2016. P. 56-59.

52. Akyildiz, I.F., Kasimoglu, I.H. Wireless sensor and actor networks: research challenges // Ad Hoc Netw. 2004. N 2 (4). P. 351-367.

53. Yick, J., Mukherjee, B., Ghosal, D. Wireless sensor network survey // Comput. Netw. 2008. N 52 (12). P. 2292-2330.

54. Ruiz-Garcia, L., Lunadei, L., Barreiro, P., Robla, I. A review of wireless sensor technologies and applications in agriculture and food industry: state of the art and current trends // Sensors. 2009. N 9 (6). P. 4728-4750.

55. Cambra, C., Díaz, J.R., Lloret, J. Deployment and performance study of an Ad Hoc network protocol for intelligent video sensing in precision agriculture // Proceedings of Ad-Hoc Networks and Wireless. lNCS. 2015. V. 8629. Springer, Berlin Heidelberg. P. 165-175.

56. Barcelo-Ordinas, J.M., Chanet, J.P., Hou, K. M., García-Vidal, J. A survey of wireless sensor technologies applied to precision agriculture // Stafford, J. (Ed.), Precision Agriculture'13. Wageningen Academic Publishers. 2013. P. 801-808.

57. Baseca, C.C., Díaz, J.R., Lloret, J. Communication Ad Hoc protocol for intelligent video sensing using AR drones // IEEE Mobile Ad-hoc and Sensor Networks (MSN). 2013. P. 449-453.

58. Díaz, S.E., Pérez, J.C., Mateos, A.C., Marinescu, M.C., Guerra, B.B. A novel methodology for the monitoring of the agricultural production process based on wireless sensor networks // Comput. Electron. Agric. 2011. N 76 (2). P. 252-265.

59. López, J.A., Garcia-Sanchez, A.J., Soto, F., Iborra, A., Garcia-Sanchez, F., Garcia-Haro, J. Design and validation of a wireless sensor network architecture for precision horticulture applications // Precision Agric. 2011. N 12 (2). P. 280-295.

60. Park, D.H., Kang, B.J., Cho, K.R., Shin, C.S., Cho, S.E., Park, J.W., Yang, W.M. A study on greenhouse automatic control system based on wireless sensor network // Wirel. Pers. Commun. 2011. N 56 (1). P. 117-130.

61. Matese, A., Gennaro, S.F.D., Zaldei, A., Genesio, L., Vaccari, F.P. A wireless sensor network for precision viticulture: the NAV system // Comput. Electron. Agric.2009. N 69 (1). P. 51-58.

62. Lichtenberg, E., Majsztrik, J., Saavoss, M. rower demand for sensor controlled irrigation / Water Resour. Res. 2015. N 51. [Electron. Res].: http://dx.doi.org/10.1002/2014WR015807.

63. Reche, A., Sendra, S., Díaz, J.R., Lloret, J. A smart M2M deployment to control the agriculture irrigation // Proceedings of Ad-hoc Networks and Wireless, LNCS. 2015. N 8629. P. 139-151.

64. Greenwood, D.J., Zhang, K., Hilton, H.W., Thompson, A.J. Opportunities for improving irrigation efficiency with quantitative models, soil water sensors and wireless technology // J. Agric. Sci. 2010. N 148. P. 1-16.

65. Gutiérrez, J., Villa-Medina, J.F., Nieto-Garibay, A., Ángel Porta-Gándara, M. Automated irrigation system using a wireless sensor network and GPRS module // IEEE Trans. Instrum. Meas. 2014. N 63 (1). P. 166-176.

66. Hwang, J., Shin, C., Yoe, H. A wireless sensor network-based ubiquitous paprika growth management system // Sensors. 2010. N 10. P. 11566-11589.

67. Corke, P., Wark, T., Jurdak, R., Hu, W., Valencia, P., Moore, D. Environmental wireless sensor networks // Proc. IEEE. 2010.N 98 (11). P. 1903-1917.

68. Voulodimos, A.S., Patrikakis, C.Z., Sideridis, A.B., Ntafis, V.A., Xylouri, E.M. A complete farm management system based on animal identification using RFID technology // Comput. Electron. Agric. 2010. N 70 (2). P. 380-388.

69. Malaver, A., Motta, N., Corke, P., Gonzalez, F. Development and integration of a solar powered unmanned aerial vehicle and a wireless sensor network to monitor greenhouse gases // Sensors. 2015. N 15 (2). P. 4072-4096.

70. Yang, H., Qin, Y., Feng, G., Ci, H. Online monitoring of geological CO2 storage and leakage based on wireless sensor networks // IEEE Sens. J. 2013. N 13 (2). P. 556-562.

71. Mao, X., Miao, X., He, Y., Li, X.Y., Liu, Y. CitySee: Urban CO${}_2$ monitoring with sensors // Proceedings of IEEE INFOCOM, Orlando, FL, USA. 2012. P. 1611-1619.

72. Dong, X., Vuran, M. C., Irmak, S. Autonomous precision agriculture through integration of wireless underground sensor networks with center pivot irrigation systems // Ad Hoc Netw. 2013. N 11 (7). P. 1975-1987.

73. Shanwad, U.K., Patil, V.C., Gowda, H.H. Proceeding precision farming: dreams and realities for Indian agriculture // Proceedings of Map India Conference. 2004.

74. Mondal, P., Basu, M. Adoption of precision agriculture technologies in India and in some developing countries: scope, present status and strategies // Prog. Nat. Sci. 2009. N 19 (6). P. 659-666.

75. Mondal, P., Tewari, V.K., Rao, P.N. Scope of precision agriculture in India // Proceedings of International Conference on Emerging Technologies in Agricultural and Food Engineering, Kharagpur, WB, India, 2004. P. 103.

76. Gutiérrez, J., Villa-Medina, J.F., Nieto-Garibay, A., Ángel Porta-Gándara, M. Automated irrigation system using a wireless sensor network and GPRS module // IEEE Trans. Instrum. Meas. 2014. N 63 (1). P. 166-176.

77. Akyildiz, I.F., Stuntebeck, E.P. Wireless underground sensor networks: research challenges // Ad Hoc Netw. 2006. N. 4 (6). P. 669-686.

78. Vuran, M.C., Akyildiz, I.F. Cross-layer packet size optimization for wireless terrestrial, underwater, and underground sensor networks // Proceedings of IEEE INFOCOM, Phoenix, AZ, USA, 2008. P. 780-788.

79. Silva, A.R., Vuran, M.C. Communication with aboveground devices in wireless underground sensor networks: an empirical study // Proceedings of IEEE International Conference on Communications, Cape Town, South Africa, 2010. P. 1-6.

80. Yu, X., Wu, P., Han, W., Zhang, Z. A survey on wireless sensor network infrastructure for agriculture // Comput. Stand. Interfaces. 2013. N 35 (1). P. 59-64.

81. Akyildiz, I.F., Kasimoglu, I.H. Wireless sensor and actor networks: research challenges // Ad Hoc Netw. 2004. N 2 (4). P. 351-367.

82. Kulkarni, R.V., Förster, A., Venayagamoorthy, G.K. Computational intelligence in wireless sensor networks: a survey // Commun. Surv. Tutorials. 2011. N 13 (1). P. 68-96.

83. Shakhov, V. Performance Evaluation of MAC Protocols in Energy Harvesting Wireless Sensor Networks // Springer LNCS. 2016. V. 9787. P. 344-352.

84. Wu, D., Cai, Y., Zhou, L., Wang, J. A cooperative communication scheme based on coalition formation game in clustered wireless sensor networks // IEEE Trans. Wirel. Commun.2012. N 11 (3). P. 1190-1200.

85. Shakhov, V. A Graph-based Method for Performance Analysis of Energy Harvesting Wireless Sensor Networks Reliability // Springer Lecture Notes in Electrical Engineering, 2016. V. 391. P. 127-132.

86. Shakhov V.V., Migov D.A., Sokolova O.D. Wireless sensory networks equipped with means for obtaining energy from the environment // Problems of Informatics. 2014. N 4. P. 69-79.

87. Chu, X., Sethu, H. Cooperative topology control with adaptation for improved lifetime in wireless ad-hoc networks // Proceedings of IEEE INFOCOM, Orlando, FL, USA, 2012. P. 262-270.

88. Li, M., Li, Z., Vasilakos, A.V. A survey on topology control in wireless sensor networks: taxonomy, comparative study, and open issues // Proc. IEEE. 2013. N 101 (12). P. 2538-2557.

89. Shakhov, V. On a New Type of Attack in Wireless Sensor Networks: Depletion of Battery // Proceedings of IEEE 11th International Forum on Strategic Technology, Novosibirsk, Russia, 2016. P. 491-494.

90. Vijay, G., Bdira, E.B.A., Ibnkahla, M. Cognition in wireless sensor networks: a perspective // IEEE Sens. J. 2011. N 11 (3). P. 582-592.

91. Shakhov V.V., Yurgenson A.N., Sokolova O.D. Effective method for generating random geometric graphs for modeling wireless networks // Applied Discrete Mathematics. 2016. N 4 (34). P. 99-109.

92. Misra, S., Jain, A. Policy controlled self-configuration in unattended wireless sensor networks // J. Netw. Comput. Appl. 2011. N 34 (5). P. 1530-1544.

93. Nicopolitidis, P., Papadimitriou, G.I., Pomportsis, A.S., Sarigiannidis, P.G., Obaidat, M.S. Adaptive wireless networks using learning automata. IEEE Wirel. Commun. 2011. N 18 (2). P. 75-81.

94. Shakhov, V. Protecting Wireless Sensor Networks from Energy Exhausting Attacks // Springer LNCS, 2013. V. 7971. P. 184-193.

95. Shakhov, V., Choo, H., Bang, Y. Discord model for detecting unexpected demands in mobile networks // Future Generation Comp. Syst., 2004. V. 20 (2). P. 181-188.

96. Shakhov, V., Choo, H. An Efficient Method for Proportional Differentiated Admission Control Implementation // EURASIP Journal on Wireless Communications and Networking, 2013. V. 2011, Article ID 738386.

97. Shakhov, V., Migov, D. Reliability of Ad Hoc Networks with Imperfect Nodes // Springer LNCS, 2014. V. 8715, Ð. 49-58.

98. Adamala, S., Raghuwanshi, N.S., Mishra, A. Development of surface irrigation systems design and evaluation software (SIDES) // Comput. Electron. Agric. 2014. N 100. P. 100-109.

99. Westarp, S.V., Chieng, S., Schreier, H. A comparison between low-cost drip irrigation, conventional drip irrigation, and hand watering in Nepal // Agric. Water Manage. 2004. N 64. P. 143-160.

100. Kim, Y.D., Yang, Y.M., Kang, W.S., Kim, D.K. On the design of beacon based wireless sensor network for agricultural emergency monitoring systems // Comput. Stand. Interfaces. 2014. N 36 (2). P. 288-299.

101. Bhave, A.G., Mishra, A., Raghuwanshi, N. S. A combined bottom-up and topdown approach for assessment of climate change adaptation options // J. Hydrol. 2013. [Electron. Res.].: http://dx.doi.org/10.1016/j.jhydrol.2013.08.039.

102. Bhargava, K., Kashyap, A., Gonsalves, T. A. Wireless sensor network based advisory system for apple scab prevention // Proceedings of National Conference on Communications, Kanpur, India, 2014. P. 1-6.

103. Gonçalves, L.B.L., Costa, F.G., Neves, L.A., Ueyama, J., Zafalon, G.F.D., Montez, C., Pinto, A.S.R. Influence of mobility models in precision spray aided by wireless sensor networks // J. Phys.: Conf. Ser. 2015. N 574 (1).

104. Kwong, K.H., Wu, T.T., Goh, H.G., Sasloglou, K., Stephen, B., Glover, I., Shen, C., Du, W., Michie, C., Andonovic, I. Practical considerations for wireless sensor networks in cattle monitoring applications // Comput. Electron. Agric. 2012. N 81. P. 33-44.

105. Zia, H., Harris, N.R., Merrett, G.V., Rivers, M., Coles, N. The impact of agricultural activities on water quality: a case for collaborative catchment-scale management using integrated wireless sensor networks // Comput. Electron Agric. 2013. N 96. P. 126-138.

106. Malaver, A., Motta, N., Corke, P., Gonzalez, F. Development and integration of a solar powered unmanned aerial vehicle and a wireless sensor network to monitor greenhouse // Sensors. 2015. N 15 (2). P. 4072-4096.

107. Misra, S., Singh, S. Localized policy-based target tracking using wireless sensor networks // ACM Trans. Sens. Netw. 2012. N 8 (3). P. 27.

108. Fukatsu, T., Kiura, T., Hirafuji, M. A web-based sensor network system with distributed data processing approach via web application //Comput. Stand Interfaces. 2011. N 33 (6). P. 565-573.

109. Coates, R.W., Delwiche, M.J., Broad, A., Holler, M. Wireless sensor network with irrigation valve control // Comput. Electron. Agric. 2013. N 96. P. 13-22.

110. Koch, R., Pionteck, T., Albrecht, C., Maehle, E. An adaptive system-on-chip for network applications // Proceedings of International Parallel and Distributed Processing Symposium, Rhodes Island. 2006.

111. Karim, F., Mellan, A., Stramm, B., Nguyen, A., Abdelrahman, T., Aydonat, U. The hyperprocessor: a template system-on-chip architecture for embedded multimedia applications // Proceedings of Workshop on Application Specific Processors, 2003. P. 66-73.

112. ZigBee Specifications, ZigBee Alliance Std. [El. Res.].: http://www.zigbee.org/.

113. Baronti, P., Pillai, P., Chook, V.W., Chessa, S., Gotta, A., Hu, Y. F. Wireless sensor networks: a survey on the state of the art and the 802.15.4 and ZigBee standards //Comput. Commun. 2007. N 30 (7). P. 1655-1695.

114. Guo, W., Healy, W. M., Zhou, M. Impacts of 2.4-GHz ISM band interference on IEEE 802.15.4 wireless sensor network reliability in buildings // IEEE Trans. Instrum. Meas. 2012. N 61. P. 2533-2544.

115. IEEE Standard for Information technology, 2006. Telecommunications and Information Exchange Between Systems -- Local and Metropolitan Area Networks -- Specific Requirements Part 15.4: Wireless Medium Access Control (MAC) and Physical Layer (PHY) Specifications for Low-Rate Wireless Personal Area Networks (WPANs), Institute of Electrical and Electronics Engineers Std.

116. IEEE Standard for Information technology, 2005. Local and metropolitan area networks -- Specific requirements -- Part 11: Wireless LAN Medium Access Control (MAC) and Physical Layer (PHY) Specifications -- Amendment 8: Medium Access Control (MAC) Quality of Service Enhancements, Std.

117. IEEE Standard for Information technology, 2012. Telecommunications and Information Exchange Between Systems Local and Metropolitan Area networks-Specific Requirements Part 11: Wireless LAN Medium Access Control (MAC) and Physical Layer (PHY) Specifications, Institute of Electrical and Electronics Engineers Std.

118. Bluetooth Technology Special Interest Group. [Electron. Res.].: https://www.bluetooth.org/.

119. General Packet Radio Service. [Electron. Res.].: http://www.3gpp.org/.

120. D. J. Goodman and R. A. Myers. 3G cellular standards and patents // Proceedings of International Conference on Wireless Networks, Communications and Mobile Computing, 2005, P. 415-420.

121. Parkvall, S., Dahlman, E., Furuskar, A., Jading, Y., Olsson, M., Wanstedt, S., Zangi, K. `LTE-Advanced -- Evolving LTE towards IMT-Advanced // Proceedings of Vehicular Technology Conference (VTC-Fall), Calgary, BC, 2008, P. 1-5.

122. IEEE Standard for Local and metropolitan area networks Part 16: Air Interface for Broadband Wireless Access Systems Amendment 3: Advanced Air Interface, Std., May 2011.

123. Sperling, O. Water Relations in Date Palm Trees -- A Combined Approach using Water, Plant, and Atmospheric Data Water Relations in Date Palm Trees -- A Combined Approach using Water, Plant, and Atmospheric Data. Ben-GurionUniversity of the Negev, Beersheva, Israel. 2013.

124. Cohen, Y., Glasner, B.B. Date palm genetic resources and utilization // Al- Khayri, M., Jain, J.,Mohan, S., Johnson, V. D. (Eds.). Date Palm Genetic Resources and Utilization. 2015. P. 265-298. doi: http://dx.doi.org/10.1007/978-94-017-9707-8.

125. Sperling, O., Shapira, O., Cohen, S., Tripler, E., Schwartz, A., Lazarovitch, N., Estimating sap flux densities in date palm trees using the heat dissipation method and weighing lysimeters // Tree Physiol. 2012. N 32. P. 1171-1178. [Electron. Res.].: http://dx.doi.org/10.1093/treephys/tps070.

126. Tripler, E., Shani, U., Ben-Gal, A., Mualem, Y. Apparent steady state conditions in high resolution weighing-drainage lysimeters containing date palms grown under different salinities // Agric. Water Manage. 2012. N 107. P. 66-73. [Electron. Res.].: http://dx.doi.org/10.1016/j.agwat.2012.01.010.

127. Yuan Rao, Zhao-hui Jiang, Naftali Lazarovitch. Investigating signal propagation and strength distribution characteristics of wireless sensor networks in date palm orchards // Computers and Electronics in Agriculture. 2016. N 124. P. 107-120.

128. Moghaddam, M., Entekhabi, D., Goykhman, Y., Li, K., Liu, M., Mahajan, A., Nayyar, A., Shuman, D., Teneketzis, D. A wireless soil moisture smart sensor web using physics-based optimal control: concept and initial demonstrations // IEEE J.Sel. Top. Appl. Earth Observ. Rem. Sens. 2010. N 3 (4). P. 522-535.

129. Lovejoy, W. S. A survey of algorithmic methods for partially observed markov decision processes // Ann. Oper. Res. 1991. N 28 (1). P. 47-65.

130. Saha, R., Raghuwanshi, N.S., Upadhyaya, S.K., Wallender, W.W., Slaughter, D. C. Water sensors with cellular system eliminate tail water drainage in alfalfa irrigation // Calif. Agric. 2011. N 65 (4). P. 202-207.

131. Aqua Management, Inc. [El. Res.].: http://aquamanagement.com/vertical-solutions/ami-turfirrigation-controll....

132. TamoghnaOjha, SudipMisra, Narendra Singh Raghuwanshi. Wireless sensor networks for agriculture: The state-of-the-art in practice and future challenges // Computers and Electronics in Agriculture. 2015. N 118. P. 66-84.

Bibliographic reference: Tarhanova O.Y. Application of wireless sensor networks in precision agriculture //journal “Problems of informatics”. 2017, № 4. P. 16-46.

article

Perepelkin V.A.*, Sofronov I.V., Tkacheva A.A.*

Institute of Computational Mathematics and Mathematical Geophysics SB RAS, 630090, Novosibirsk, Russian Federation

*Novosibirsk State University, 630090, Novosibirsk, Russian Federation

AUTOMATED CONSTRUCTION OF PARALLEL NUMERICAL PROGRAMS WITH SPECIFIED NON-FUNCTIONAL PROPERTIES BASED ON COMPUTATIONAL MODELS

UDC 00.004.4'24

Implementation of numerical algorithms as parallel programs for distributed memory multicomputers is a complex task, since the program not only has to contain the algorithm implemented, but also deals with a number of other problems of system parallel programming. Those are: organize parallel computational process, synchronize parallel threads and processes, perform communications, distribute and balance computational workload and more. Implementation of such static and dynamic properties of the program requires concerning peculiarities of both multicomputer and application algorithm, or even peculiarities of the input data. Development, debugging and modification of such a parallel program are extremely complex for scientists, who need to implement their numerical models. Moreover, the program also has to be efficient (in terms of computation time, memory consumption, etc.).

To overcome the complexity program construction automation can be useful. A programmer describes the algorithm in a high-level language, and the parallel program is constructed automatically by a programming system. In this case the complexity of parallel program development is hidden from programmer. This approach also allows constructing different parallel program for different multicomputers or input data, which is potentially, allows more efficient programs, than programs, developed for general case.

In this paper we assume, that an application algorithm is described in a high-level programming language, such as LuNA language. The description is functionally decomposed, i.e. consists of functions. Each function has a pre-defined finite number of modules that implement it. The modules differ in the non-functional properties respect (for example, they may have different execution time or memory consumption). These non-functional properties of the modules are considered known. The problem of parallel program construction is considered as the problem of choice of a module for each function. Since each module has different non-functional properties, the resulting program will also have different non-functional properties. The aim is to construct a program with desired non-functional properties.

The complexity of the problem is conditioned by the fact that the dependency between the assembled program's properties and the properties of the modules can be different for different applications or even input data. Therefore, it is important to have a general way of describing the revealed dependences and including them in some knowledge base in a form that allows their automatic usage. In this case, for various limited subject areas and classes of applied algorithms, it is possible to accumulate knowledge in such base. As a result, automatic construction of an acceptable quality program would be provided.

The main point of the proposed solution is to use the computational models (CMs) described in the theory of synthesis of parallel programs on the basis of computational models for organization of such a knowledge base. Information on how the initial description of the computational process is represented in the form of a set of functions, which modules are available for each function, and how the program is assembled from these modules, is described in the CM.

The practical application of the approach implies that the end user has no information about the CM, its composition and structure. Their role is limited to describing the computational process in a high-level language. The CM is described by the developer of the programming system. The algorithm of creating a set of acceptable modules from the CM and the construction of the program is fixed. The advantage of using the CM for solving the problem is the possibility to put in the CM a number of alternatives for designing the program. This leads to the possibility of automatic program construction in a wide range of non-functional properties required for different execution conditions.

To investigate the effectiveness of the proposed solution an explicit finite difference method for 3D Poisson equation solution was chosen as a test application. This problem was chosen as an example, because it has a typical parallel implementation scheme used for a wide class of numerical algorithms on meshes (spatial decomposition with border exchange). Within the framework of this test the one-dimensional spatial decomposition of the three-dimensional computational domain was used. Two series of experiments were conducted: in shared and distributed computing environment. The results demonstrated the desired ability of automated program construction with different non-functional properties, preferred for different execution conditions.

Key words: automated parallel programs synthesis, computational models, program auto-tuning, fragmented programming technology, fragmented programming system LuNA, code generation.

References

1. Kale L. V., Krishnan S. CHARM++: a portable concurrent object oriented system based on C++ // OOPSLA'93 Proc. of the eighth annual conf. on Object-oriented programming systems, languages and applications. ACM. NewYork. 1993. P. 91-108.

2. OpenMP. Available at: http://www.openmp.org/

3. Valkovskii, V. A., Malyshkin V. E. Sintez parallelnykh program i system na vychislitelnih modelyakh [Synthesis of systems and programs on computation models]. Novosibirsk: Nauka, SB RAS 1988.

4. Malyshkin V. E., Perepelkin V. A. LuNA Fragmented Programming System, Main Functions and Peculiarities of Run-Time Subsystem // In the Proc. of the 11th Intern. Conf. on Parallel Computing Technologies (PaCT 2011), LNCS. V. 6873, Springer, 2011. P. 53-61.

5. Brusentsov L. E. Avtomaticheskaya optimizatsiya pri kompilyatsii [Automatic optimization during compilation] // Open systems, 2011, N 2. P. 53-56.

6. Brusentsov L. E. Raspredelyonnii iterativnyi poisk optsij kompilyatsii [Distributed iterative search of compiler's options] // Distributed, Informational and Computational Resourñes (DICR'2010): conf. proc. Novosibirsk: ICT SB RAS, 2010 (CD-ROM). reg. 0321100051. Available at: http://conf.nsc.ru/dicr2010/ru/reportview/29810. (Accessed 17.10.2017)

7. Purini S., Jain L. Finding Good Optimization Sequences Covering Program Space // ACM Transactions on Architecture and Code Optimization, Vol. 9. N 4. Article 39. 2010.

8. Michael R. Jantz, Prasad A. Kulkarni Performance Potential of Optimization Phase Selection During Dynamic JIT Compilation // VEE'13, March 16-17, 2013, Houston, Texas, USA.

9. The GNU Compiler Collection (GCC). Available at: https://gcc.gnu.org.html (Accessed 19.10.2017).

10. Using the GNU Compiler Collection (GCC): Optimize Options. Available at: https://gcc.gnu.org/onlinedocs/gcc/Optimize-Options.html (Accessed 18.10.2017).

11. Leather H., Bonilla E., O'Boyle M. Automatic Feature Generation for Machine Learning Based Optimizing Compilation // Proc. of the 7th annual IEEE/ACM Intern. Symposium on Code Generation and Optimization, 2009. P. 81-91.

12. Ashouri A. H., Palermo G., Silvano C. Auto-tuning Techniques for Compiler Optimization. // DATE'2016- PhD Forum, IEEE/ACM, Dresden, Germany, 2016.

13. Hashimoto M., Terai M., Maeda T. and Minami K. Extracting Facts from Performance Tuning History of Scientific Applications for Predicting Effective Optimization Patterns. // Proc. of the 12th Working Conf. on Mining Software Repositories, 2015. P. 13-23.

14. Akhmed-Zaki D., Lebedev D., Perepelkin V. Implementation of a three dimensional Three-Phase Fluid Flow (Oil-Water-Gas) Numerical Model in LuNA Fragmented Programming System // Journal of Supercomputing, S.I.: Parallel Computing Technologies. 2016. Springer, 2016. P. 1-7.

15. Malyshkin V. E., Perepelkin V. A., Tkacheva A. A. Control Flow Usage to Improve Performance of Fragmented Programs Execution. PaCT 2015. LNCS, Vol. 9251, Springer, 2015. P. 86-90.

16. Tkacheva, A. A. Effectivnoe ispolnenie fragmentirovannykh programm s pomoshh'yu sredstv pryamogo upravlenia v sisteme LuNA na primere zadachi redutsirovaniya dannykh [Efficient execution of fragmented program with a control flow means under the fragmented parallel programming system LuNA in data reduction task] / A. A. Tkacheva // Problems of Informatics. 2016. N 2 (31). P. 21-29.

17. Tkacheva A. A. The Algorithm of Control Program Generation for Optimization of LuNA Program Execution. PaCT 2017. LNCS, V. 10421. Springer, 2017. P. 365-371.

18. Kireev S. E., Malyshkin V. E. Fragmentation of Numerical Algorithms for Parallel Subroutines Library // J. Supercomputing, 2011. V. 57. N 2. P. 161-171.

19. Mezhvedomstvennyj Supercomp'yuternyj Tsentr Rossijskoj Akademii Nauk [Joint Supercomputer Center of the Russian Academy of Sciences] Available at: http://www.jscc.ru/scomputers.html

Bibliographic reference: Perepelkin V.A., Sofronov I.V., Tkacheva A.A. Automated construction of parallel numerical programs with specified non-functional properties based on computational models //journal “Problems of informatics”. 2017, № 4. P. 47-60.

article

Feoktistov A.G., Sidorov I.F., Gorsky S.A.

Matrosov Institute for System Dynamics and Control Theory of SB RAS 664033, Irkutsk, Russia

AUTOMATION OF DEVELOPMENT AND APPLICATION OF DISTRIBUTED APPLIED SOFTWARE PACKAGES

UDC 004.4+519.6

We address relevant problems of constructing subject-oriented systems of modular programming (applied software packages) for solving large-scale problems in a heterogeneous distributed computing environment that integrates computational resources of a public access computer center where computational clusters are the main components.

Nowadays, the software that implements computational technologies in high-performance computing systems provides a potential foundation for the mass creation of parallel and distributed applications. However, the analysis of their application in practice makes it possible to detect the following important problems: the complexity of training and applying these tools by end-users (specialists in subject areas), which significantly narrows their number; insufficient support for taking into account the subject area specifics of the tasks being solved; difficulty in reconciling the determined criteria for the effectiveness of their solving (time, cost, security and other restrictions) and the required indicators of resource use (load balancing, reliability, energy consumption, etc.); lack of universal approaches to resource integration; the weak interconnecting of the created applications for data and management.In particular, the above-mentioned problems are actualized when solving tasks in a heterogeneous distributed computing environment, the main components of which are computational clusters, including hybrid clusters with heterogeneous nodes.

An actual approach to solving these problems is the development of distributed applied software packages. The development of distributed computing technologies actualizes the creation of new methods and tools that provide an efficiency degree increase of computational process management in such packages. To this end, we represent two toolkits for automating the creation and application of distributed applied software packages with multi-agent management of their computational jobs that is based on the integrated use of knowledge about both subject domains of tasks and the environment in which they are solved.

The package creation includes the following main stages: structural analysis of subject domains of tasks, conceptual model design for these domains, development of applied software libraries, configuring the system software of packages. The conceptual model describes parameters, operations over the parameter field, program modules (applied software) that realize the operations, computational nodes and other objects of subject domains and computational environment, and relationships between the objects. Thus, it includes several components of a comprehensive knowledge about the environment and subject domains. Using the conceptual model, users formulate their tasks in both procedural and non-procedural form, construct task solving plans and form computational jobs. The job describes the necessary requirements to the computational environment for solving the task. Represented toolkits provide both text and graphic mode of the conceptual model development.

A specialized meta-monitoring system collects information about the distributed computing environment and its resources. It processes and unifies this information. The knowledge thus obtained is transferred to the knowledge base. Package components can to use meta-monitoring system API for knowledge elicitation. The meta-monitoring system is also used for testing the environment nodes, collecting data about their current state, detecting node faults, and diagnosing and to partially repairing these faults.

The system software of packages includes high-level tools for the job management in both homogeneous clusters and heterogeneous distributed computing environment.We propose the task formulation and algorithm of multi-agent management of jobs. The management efficiency is achieved through the resource allocation on the basis of a computational work tender. It is base don a model of the Vickrey auction with one-round bidding. Agents applies the algorithm for the static resource allocation based on economic mechanisms for regulation of resources demand and supply.

The developed multi-agent system has a hierarchical structure, which includes two or more functional levels, and operates on the base of self-organization. At each level, agents play a variety of roles, and perform different functions. The roles may be permanent or temporal. Their changes occur at discrete times when agents need to solve new problems. Each level is related with the conceptual model knowledge layers.Agents can represent users and owners of the resources, and interact themselves with aim to meet their interests.Agents are autonomous, and computing management is based on their interaction. They can be organized in virtual communities. In these communities, agents interact using a cooperation or competition. The formation of virtual communities allows agents to adapt the management process to the new challenges.

The developed toolkits are used in the public access computer center Irkutsk supercomputer center of Siberian Branch of the Russian Academy of Science to develop distributed applied software packages for solving scientific and applied tasks from different subject domains. Examples of solving practical tasks illustrate study results. In particular, we design the distributed applied software package to support modeling of warehouse logistics. Using this package, we solved three optimization tasks for adjusting parameters of a warehouse management system. The practical experiments are focused on the refrigerated warehouse. The developed applications demonstrate high efficiency and scalability capabilities to optimize nine criteria to cope with different production demands.

Key words: distributed computing, modular programming, multi-agent management, toolkits.

References

1. Shamakina A. V. Obzor tekhnologij raspredelennykh vychislenij [Survay on Distributed Computing Tecnologies] // Bulletin of the South Ural State University, Series Computational Mathematics and Software Engineering. 2014. V. 3. N 3, P. 51-85 (in Russian).

2. Toporkov V. V., Bobchenkov A. V., Emelyanov D. M., Tselishchev A. S. Metody i evristiki planirovaniya v raspredelennykh vychisleniyakh s neotchuzhdaemymi resursami [Scheduling methods and heuristics in distributed computing with non-dedicated resources]. Scheduling methods and heuristics in distributed computing with non-dedicated resources // Bulletin of the South Ural State University, Series Computational Mathematics and Software Engineering. 2014. V. 3. N 2. P. 43-62 (in Russian).

3. Sokolinsky L. B., Shamakina A. V. Methods of Resource Management in Problem-Oriented Computing Environment // Programming and Computer Software. 2016. V. 42. N 3. P. 17-26.

4. Il'in V. P., Skopin I. N. Computational programming technologies // Programming and Computer Software. 2011. V. 37. N 4. P. 210-222.

5. Foster I., Kesselman C. Globus: A metacomputing infrastructure toolkit // International Journal of High Performance Computing Applications. 1997. V. 11, N 2. P. 115-128.

6. Thain D., Tannenbaum T., Livny M. Distributed Computing in Practice: The Condor Experience // Concurrency and Computation: Practice and Experience. 2005. V. 17. N 2-4. P. 323-356.

7. Anderson D. Boinc: A system for public-resource computing and storage. Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing, IEEE. 2004, P. 4-10.

8. Voevodin V. V. The solution of large problems in distributed computational media // Automation and Remote Control. 2007. V. 68. N 5. P. 773-786.

9. Belhajjame K., Embury S. M., Paton N. W., Stevens R., Goble A. C. Automatic Annotations of Semantic Web Services Based on Workflow Definitions // ACM Transactions on the Web, 2008. V. 2. N 2. P. 1-34.

10. Gil Y., Deelman E., Ellisman M., Fahringer T., Fox G., Gannon D., Gobl C., Livny M., Moreau L., Myers J. Examining the challenges of scientific workflows // Computer. 2007. V. 40. N 12. P. 24-32.

11. Yu J., Buyya R. A taxonomy of workflow management systems for grid computing // Journal of Grid Computing. 2005. V. 3, N 3-4. P. 171-200.

12. Talia D. Workflow Systems for Science: Concepts and Tools // ISRN Software Engineering. 2013. V. 2013. P. 1-15.

13. Oparin G. A. Osnovannaya na znaniyakh tekhnologiya resheniya vychislitel'nykh zadach [Knowledge-based technology for solving computational problems] // Informatsionnye tekhnologii controlya I upravleniya transportnymi sistemami. I. 6, Irkutsk: Irkutsk State Transport University Publ., 2000, P. 3-15 (in Russian).

14. Bychkov I., Oparin G., Tchernykh A., Feoktistov A., Bogdanova V., Gorsky S. Conceptual Model of Problem-Oriented Heterogeneous Distributed Computing Environment with Multi-Agent Management // Procedia Computer Science. 2017. V. 103. P. 162-167.

15. Garey M., Johnson D. Computers and Intractability. W. H. Freeman, San Francisco, 1979.

16. Bychkov I. V., Oparin G. A., Feoktistov A. G., Kanter A. N. Mul'tiagentny algoritm raspredeleniya vychislitel'nykh resursov na osnove ekonomicheskogo mekhanisma regulirovaniya ikh sprosa I predlozheniya [Multiagent algorithm for resources allocation based on the economic mechanism of regulating their supply and demand] // Herald of computer and information technologies. 2014. N 1. P. 39-45 (in Russian).

17. Vickrey W. Counterspeculation, Auctions, and Competitive Sealed Tenders // Journal of Finance. 1961. V. 16, N 1. P. 8-37.

18. Oparin G. A., Feoktistov A. G., Sidorov I. A. Tekhnologiya organizatsii raspredelennykh vychislenij v instrumental'nom komplekse DISCOMP [Technology of the distributed calculations organization in tool complex DISCOMP] // Modern technologies. System analysis. Modeling. 2009. N 2. P. 175-180 (in Russian).

19. Sidorov I. A. Methods and Tools to Increase Fault Tolerance of High-Performance Computing Systems // Proceedings of the 39th International Convention on information and communication technology, electronics and microelectronics. Riejka: MIPRO, 2016. P. 242-246.

20. Bychkov I., Oparin G., Tchernykh A., Feoktistov A., Bogdanova V., Dyadkin Yu., Andrukhova V., Basharina O. Simulation Modeling in Heterogeneous Distributed Computing Environments to Support Decisions Making in Warehouse Logistics // Procedia Engineering. 2017. V. 201. P. 524-533.

21. Gorsky S. A., Novopashin A. P., Oparin G. A., Feoktistov A. G. Upravlenie asinkhronnym vychislitel'nym protsessom v ORLANDO TOOLS [Management of asynchronous computational process in IN ORLANDO TOOLS]// Herald of computer and information technologies. 2011. N 1. P. 44-51 (in Russian).

22. Feoktistov A. G., Gorsky S. A. Realizatsiya metoda mul'tistarta v pakete Gradient [Implementation of the multi-start method in the Gradient package] // Vestnik Novosibirsk State University, Series Information Technologies. 2007, V. 5, I. 2. P.78-82 (in Russian).

23. Cho H., Olivera F., Guikema S. D. A derivation of the number of minima of the Griewank function // Applied Mathematics and Computation. 2008. V. 204. N 2. P. 694-701.

24. Irkutsk Supercomputer Centre of SB RAS. [Electron. res.]: http://hpc.icc.ru.

25. Sidorov I. A., Tyatyushkin A. I., Feoktistov A. G. Raspredelennaya informatsionno-vychislitel'naya sreda modul'nogo programmirovaniya [Distributed information-computing environment of modular programming] // Parallel'nye vychisleniya I zadachi upravleniya: Tr. III Mezhdunar. konf. [Proceedings of the 3d International conference on Parallel Computations and Control Problems]. Moscow: ICSRASPubl., 2006. P. 505-521 (in Russian).

26. Zaikin O. S., Sidorov I. A. Technologiya krupnoblochnogo resparallelivaniya v kripto-analize nekotorykh generatorov dvoichnykh posledovatel'nostej [Technology of large-block parallelization in the crypto-analysis of some generators of binary sequences] // Parallel'nye vychislitel'nye tekhnologii: Tr. Mezhdunar. nauch. konf. [Proceedings of the International Scientific Conference on Parallel Computational Technologies]. Chelyabinsk: SUSU Publ., 2007. V. 1. P. 158-169 (in Russian).

27. Galachyants Y. P., Zakharova Yu. R., Petrova D. P., Morozov A. A., Sidorov I. A., Marchenkov A. M., Logacheva M. D., Markelov M. L., Khabudaev K. V., Likhoshway Ye. V., Grachev M. A. Sequencing of the complete genome of an araphid pennate diatom Synedraacus subsp. radians from Lake Baikal // Doklady Biochemistry And Biophysics. 2015. V. 461. N 1. P. 84-88.

28. Bychkov I. V., Feoktistov A. G., Sidorov I. A., Kostromin R. O., Zorkalzev V. I., Edelev A. V. Intellektnaya tekhnologiya upravleniya vychisleniyami v virtualizirovannoj klusternoj srede [Intelligent technology for computations management in a virtualized clustered environment] // Materialy XV seros. Mul'tikonferentsii po problemam upravleniya. [Proceedings of the 10th All Russian Multi-conference on Control Problems]. Rostov-na-Donu; Tagenrog: Southern Federal University Publ. 2017. V. 3. P. 84-86 (in Russian).

Bibliographic reference: Feoktistov A.G., Sidorov I.F., Gorsky S.A. Automation of development and application of distributed applied software packages //journal “Problems of informatics”. 2017, № 4. P. 61-78.

article

Main menu

2017 № 4 (37)

Contents

Languages

Main menu

You are here

2017 № 4 (37) ﻿

Contents

Languages

2017 № 4 (37)