Systems Monitoring with Big Data Technologies
Abstract
The following research work is aimed to provide relevant information on the performance of an ERP application from its event log files (logs) owned by a company dedicated to consulting ERP business systems, in order to support the company in finding the causes of low availability of its ERP application. The logs that are captured by computer systems, in general tend to be erased, although these can be transformed into new knowledge. Most of these are reviewed when there is some kind of problem, as is the case with the company selected as a pilot for this work. The main objective of estudied company under study is to guarantee the availability of the ERP software that it sells, currently it has several implementations of the system, to which its clients connect at any time of the day and from anywhere in the country, so availability 24 hours a day and 365 days a year plays a important role, therefore it requires a global but also detailed vision of the behavior of its applications. Among several existing tools in the software industry for the processing of large volumes of data with the capacity to deliver the information required by the mentioned company, a Big Data platform called Elastic Stack.
Downloads
Metrics
References
Andreassen, O., Charrondière, C., & De Dios Fuente, A. (2015). Monitoring Mixed-Language Applications with Elastic Search, Logstash and Kibana (ELK). 15th International Conference on Accelerator and Large Experimental Physics Control Systems (ICALEPCS 2015), WEPGF041.
Armbrust, M., Katz, R., Fox, A., Konwinski, A., Griffith, R., Joseph, A., Lee, G., Patterson, D., Rabkin, A., Stoica, I., & Zaharia, M. (2010). A view of cloud computing. Communications of the Acm, 53(4), 50–58.
Bajer, M. (2017). Building an IoT data hub with elasticsearch, Logstash and Kibana. Proceedings - 2017 5th International Conference on Future Internet of Things and Cloud Workshops, W-FiCloud 2017, 2017-Janua, 63–68. https://doi.org/10.1109/FiCloudW.2017.101
Elastic. (2019). Elastic Stack. Elastic.
González, A. C. (2015). Propuesta de Arquitectura Distribuida para la gestión de Logs. Universidad Carlos III de Madrid. https://e-archivo.uc3m.es/bitstream/handle/10016/22278/PFC_Abel_Cal_González.pdf
Hamilton, J., Gonzalez Berges, M., Tournier, J.-C., Schofield, B., Tournier, J.-C., CERN, Geneva, & Switzerland. (2018). SCADA Statistics monitoring using the elastic stack (Elasticsearch, Logstash, Kibana). 16th Int. Conf. on Accelerator and Large Experimental Control Systems, 451–455. https://doi.org/10.18429/JACoW-ICALEPCS2017-TUPHA034
Jaramillo Valbuena, S., & Londoño, J. M. (2014). Sistemas Para Almacenar Grandes Volúmenes De Datos. Revista Gti, 13(37), 17–28.
Jason, D. (2017). Monitoring with Graphite. O’Reilly Media, Inc.
Kent, K., & Souppaya, M. (2006). Guide to Computer Security Log Management. Nist Special Publication.
Langi, P. P. I., Widyawan, Warsun, N., & Aji, T. B. (2015). An evaluation of Twitter river and Logstash performances as elasticsearch inputs for social media analysis of Twitter. Proceedings of 2015 International Conference on Information and Communication Technology and Systems, ICTS 2015, 181–186. https://doi.org/10.1109/ICTS.2015.7379895
Lauriac, N. (2016). Diseño e implementación de un sistema de monitoreo. Terre Des Hommes, 46.
Ligus, S. (2013). Effective Monitoring and Alerting: For Web Operations (I. O’Reilly Media (ed.)).
Mateos Mohíno, J. C. (2017). LogsAnalyzer: Herramienta para la evaluación en tiempo real de registros log con tecnología Big Data. In UNIVERSIDAD DE CASTILLA-LA MANCHA. UCLM. (pp. 1–129).
Prakash, T., Kakkar, M., & Patel, K. (2016). Geo-identification of web users through logs using ELK stack. Proceedings of the 2016 6th International Conference - Cloud System and Big Data Engineering, Confluence 2016, 606–610. https://doi.org/10.1109/CONFLUENCE.2016.7508191
PDF (Español (España)) 104 HTML (Español (España)) 0
Authors maintain the rights to the articles and are therefore free to share, copy, distribute, execute, and publicly communicate the work on their personal websites or in institutional deposits, after its publication in this journal, as long as they provide bibliographic information that certifies its publication in this journal.
The works are under one https://creativecommons.org/licenses/by-nc-nd/4.0/
