Overview of Methods of Collection and Processing of Geographic Data
Keywords:
Geoinformatics, geographic data, Big Data, Internet of Things, MapReduceAbstract
On the eve of Industry 4.0, there are global processes of digitalization and intellectualization of many scientific and economic areas. This article examines changes in geography under the influence of advanced information technologies. These technologies are the Internet of Things (for geographic data collection), Cloud Computing (for data storage), Big Data (for data processing), and Cyber Physical Systems (for physical and digital process management required to operate on geographic data). These technologies turn geographies into geoinformatics, which contributes to the further development of this science. The most useful technologies for geographic data collection are the Internet of Things (including things, people, data and processes) and remote sensing of the Earth (for remote geographic data collection). The most useful technologies for processing geographical data are On-Line Analytical Processing (for analytical processing of multidimensional data), Data Mining (for finding patterns in the obtained geographical data), Machine Learning (for deep analysis of geographical data) and MapReduce (for parallel processing of a large amount of data). Using methods, a geographical data processing algorithm develop, which consists of three stages. The first step is to implement the server necessary to form the foundation for data storage and processing. In order for a server to support the operational processing of big data, it must have a distributed file system. The second stage is the design of the database used for the organization and storage of geographical data. The last step is the basic processing and analysis of available geographical data. A paradigm MapReduce uses as an example of data processing.
References
[2] Malche, T., Maheshwary, P. (2015). Harnessing the Internet of Things (IoT): A Review. International Journal of Advanced Research in Computer Science and Software Engineering 5(8) 320-323.
[3] Birje, M., Challagidad, P., Goudar, R., Tapale, M. (2017). Cloud Computing Review: Concepts, Technology, Challenges and security. International Journal of Cloud Computing 6(1) 32-57.
[4] Taylor-Sakyi, K. (2016). Big Data: Understanding Big Data. https://www.researchgate.net/publication/291229189_Big_Data_Understanding_Big_Data
[5] Sanislav, T., Miclea, L. (2012). Cyber-Physical Systems – Concept, Challenges and Research Areas. Control Engineering and Applied Informatics 14(2) 28-33.
[6] Internet of Everything vs Internet of Things: What is the difference? https://www.itransition.com/blog/internet-of-everything-vs-internet-of-things
[7] Waghmare, B., Suryawanshi, M. (2017). A Review – Remote Sensing. International of Engineering Research and Application 7(6) 52-54.
[8] Maliappis, M., Kremmydas, D. (2015). An Online Analytical Processing (OLAP) Database for Agricultural Policy Data: A Greek Case Study. HAICTA 2015.
[9] Mostafa, A. (2016). Review of Data Mining Concept and its Techniques. https://www.researchgate.net/publication/301297991_Review_of_Data_Mining_Concept_and_its_Techniques?channel=doi&linkId=5710ef8a08aeff315b9f6deb&showFulltext=true
[10] Khezr, S., Navimipour, N. (2017). MapReduce and its Applications, Challenges and Architecture: A Comprehensive Review and Directions for Future Research. Journal of Grid Computing 15(3) 1-27.
[11] MapReduce, https://www.bigdataschool.ru/wiki/mapreduce
[12] What are the disadvantages of MapReduce?, https://stackoverflow.com/questions/18585839/what-are-the-disadvantages-of-mapreduce
[13] Polato, I., Re, R., Goldman, A., Kon, F. (2014). A Comprehensive View of Hadoop research – A Systematic Literature Review. Journal of Network and Computer Applications 46 1-25.
[14] Alzubi, J., Nayyar, A., Kumar, A. (2018). Machine Learning from Theory to Algorithms: An Overview. Journal of Physics Conference Series 1142 1-15.
[15] Parwej, F., Akhtar, N., Perwej, Y. (2018). A Close-Up View About Spark in Big Data Jurisdiction. International Journal of Engineering Research and Application 8(1) 26-41.
[16] Unver, M., Erguzen, A. (2016). A Study on Distributed File Systems: An Example of NFS, Ceph, Hadoop. ICENS 2016 1-5.
[17] Gupta, A., Tyagi, S., Panwar, N., Sachdeva, S., Saxena, U. (2017). NoSQL Databases: Critical Analysis and Comparison. 2017 International Conference on Computing and Communication Technologies for Smart Nation 293-299
Downloads
Published
Issue
Section
License
The authors keep the copyrights of the published materials with them, but the authors are aggee to give an exclusive license to the publisher that transfers all publishing and commercial exploitation rights to the publisher. The puslisher then shares the content published in this journal under CC BY-NC-ND license.