<link rel="stylesheet" href="styles.f3b1fba60ec7970c.css">

Optimizing big data processing through lazy computations: a systematic review of techniques and applications

Скорочена інформація про документ
dc.contributor.authorТалах, М. В.uk
dc.contributor.authorУшенко, Ю. О.uk
dc.contributor.authorВатаманіца, Е. В.uk
dc.contributor.authorГалін, Ю. О.uk
dc.contributor.authorTalakh, M. V.en
dc.contributor.authorUshenko, Yu. O.en
dc.contributor.authorVatamanitsa, E. V.en
dc.contributor.authorHalin, Yu. O.en
dc.titleOptimizing big data processing through lazy computations: a systematic review of techniques and applicationsen
dc.title.alternativeОптимізація обробки великих даних за допомогою «лінивих обчислень»: систематичний огляд технологій та застосуванняuk
dc.date.issued2024
dc.publisherВінницький національний технічний університетuk
dc.identifier.citationTalakh M. V., Ushenko Yu. O., Vatamanitsa E. V., Halin Yu. O. Optimizing big data processing through lazy computations: a systematic review of techniques and applications // Оптико-електроннi iнформацiйно-енергетичнi технологiї. 2024. № 2. С. 24-33. URI: https://oeipt.vntu.edu.ua/index.php/oeipt/article/view/716.en, uk
dc.relation.ispartofОптико-електроннi iнформацiйно-енергетичнi технологiї. № 2 : 24-33.uk
dc.relation.urihttps://oeipt.vntu.edu.ua/index.php/oeipt/article/view/716
dc.identifier.doihttps://doi.org/10.31649/1681-7893-2024-48-2-24-33
dc.identifier.issn2311-2662
dc.identifier.udc004.75
dc.identifier.urihttps://ir.lib.vntu.edu.ua/handle/123456789/55753
dc.description.abstractУ статті розглянуто концепцію лінивих обчислень та її застосування для ефективної обробки великих обсягів даних. Проаналізовано основні принципи лінивих обчислень, їх реалізацію в різних мовах програмування та стратегії ефективного використання в контексті обробки Big Data. Досліджено переваги та обмеження лінивого підходу, зокрема щодо економії пам`яті, підвищення продуктивності та можливості роботи з нескінченними потоками даних. Запропоновано концепцію вибору стратегії обчислень залежно від розміру даних та складності обчислень.uk
dc.description.abstractThe article examines the concept of lazy operations and its application for efficient processing of large volumes of data. The main principles of lazy computations, their implementation in various programming languages, and strategies for effective use in Big Data processing are analyzed. The advantages and limitations of the lazy approach are investigated, particularly regarding memory savings, performance improvement, and the ability to work with infinite data streams. A concept for ing computation strategies based on data size and computational complexity is proposeden
dc.subject«ліниві обчислення»uk
dc.subjectвеликі даніuk
dc.subjectобробка данихuk
dc.subjectоптимізаціяuk
dc.subjectпотоки данихuk
dc.subjectобчислювальні стратегіїuk
dc.subjectмови програмування.uk
dc.subjectlazy operationsen
dc.subjectBig Dataen
dc.subjectdata processingen
dc.subjectoptimizationen
dc.subjectdata streamsen
dc.subjectcomputing strategiesen
dc.subjectprogramming languages.en
dc.typeArticle, professional native edition
dc.typeArticle
dc.language.isoenen
dc.relation.referencesZaharia M. Apache spark: a unified engine for big data processing / M. Zaharia, R. S. Xin, P. Wendell, T. Das, M. Armbrust, A. Dave et al., 14 authors in total // Communications of the ACM. –2016. –Vol. 59, No. 11. –P. 56-65.en
dc.relation.referencesDean J. MapReduce: simplified data processing on large clusters / J. Dean & S. Ghemawat // Communications of the ACM. –2008. –Vol. 51, No. 1. – P. 107-113.en
dc.relation.referencesCarbone P. Apache flink: Stream and batch processing in a single engine / P. Carbone, A. Katsifodimos, S. Ewen, V. Markl, S. Haridi & K. Tzoumas // Bulletin of the IEEE Computer Society Technical Committee on Data Engineering. –2015. – Vol. 36, No. 4.en
dc.relation.referencesRichter S. Preferred Operators and Deferred Evaluation in Satisficing Planning / S. Richter & M. Helmert // ICAPS. –2009. – Vol. 19, No. 1. – P. 13345.en
dc.relation.referencesExploring Lazy Evaluation and Compile-Time Simplifications for Efficient Geometric Algebra Computations // Systems, Patterns and Data Engineering with Geometric Calculi. –2021. – P. 111-131.en
dc.relation.referencesChen X. A Comparison of Greedy Algorithm and Dynamic Programming Algorithm / X. Chen // SHS Web of Conferences. –2022. – Vol. 144. – P. 03009.en
dc.relation.referencesGbedawo V. W. An Overview of Computer Memory Systems and Emerging Trends / V. W. Gbedawo, G. O. Agyeman, C. K. Ankah, M. I. Daabo // American Journal of Electrical and Computer Engineering. – 2023. – Vol. 7, No. 2. – P. 19-26.en
dc.relation.referencesRen S. A comprehensive review of big data analytics throughout product lifecycle to support sustainable smart manufacturing: A framework, challenges and future research directions / S. Ren, Y. Zhang, Y. Liu, T. Sakao, D. Huisingh, C. M. V. B. Almeida // Journal of Cleaner Production. –2018. – Vol. 210. – P. 1343-1365.en
dc.relation.referencesLim C. L. Lazy and eager approaches for the set cover problem / C. L. Lim, A. Moffat, A. Wirth // 37th ACSC. – 2014. – P. 19-27.en
dc.relation.referencesWang Y. Review on greedy algorithm / Y. Wang // Theoretical and Natural Science. – 2024. – Vol. 14, No. 1. – P. 233-239.en
dc.relation.referencesBadanidiyuru A. Streaming submodular maximization: massive data summarization on the fly / A. Badanidiyuru, B. Mirzasoleiman, A. Karbasi, A. Krause // 20th ACM SIGKDD. – 2014. – P. 671-680.en
dc.relation.referencesAkidau T. The dataflow model: a practical approach to balancing correctness, latency, and cost in massive-scale, unbounded, out-of-order data processing / T. Akidau, R. Bradshaw, C. Chambers, S. Chernyak, R. J. et al., 11 authors in total // Proceedings of the VLDB Endowment. –2015. –Vol. 8, No. 12. –P. 1792-1803.en
dc.relation.referencesZaharia M. Discretized streams: An efficient and fault-tolerant model for stream processing on large clusters / M. Zaharia, T. Das, H. Li, S. Shenker, I. Stoica // HotCloud. – 2012. – Vol. 12. –P. 10-10.en
dc.relation.referencesAgarwal S. Knowing when you're wrong: building fast and reliable approximate query processing systems / S. Agarwal, H. Milner, A. Kleiner, A. Talwalkar, et al., 8 authors in total // Proceedings of the 2014 ACM SIGMOD international conference on Management of data. –2014. –P. 481-492.en
dc.relation.referencesAkidau T. MillWheel: fault-tolerant stream processing at internet scale / T. Akidau, A. Balikov, K. Bekiroğlu, S. Chernyak, et al., 10 authors in total // Proc. VLDB Endowment. –2013. –Vol. 6, No. 11. – P. 1033-1044.en
dc.relation.referencesOlston C. Pig latin: a not-so-foreign language for data processing / C. Olston, B. Reed, U. Srivastava, R. Kumar, A. Tomkins // Proceedings of the 2008 ACM SIGMOD international conference on Management of data. –2008. –P. 1099-1110.en
dc.relation.referencesArmbrust M. Spark sql: Relational data processing in spark / M. Armbrust, R. S. Xin, C. Lian, Y. Huai, D. Liu, J. K. Bradley,... M. Zaharia // Proceedings of the 2015 ACM SIGMOD international conference on management of data. – 2015. – P. 1383-1394.en
dc.relation.referencesMcSherry F. Scalability! But at What COST? / F. McSherry, M. Isard, D. G. Murray // 15th Workshop on Hot Topics in Operating Systems (HotOS XV). –2015. –Kartause Ittingen, Switzerland.en
dc.relation.referencesCormode G. Synopses for massive data: Samples, histograms, wavelets, sketches / G. Cormode, M. Garofalakis, P. J. Haas, C. Jermaine // Foundations and Trends in Databases. –2012. –Vol. 4, No. 1-3. – P. 1-294.en
dc.relation.referencesCarbone P. Apache Flink: Stream and batch processing in a single engine / P. Carbone, A. Katsifodimos, S. Ewen, V. Markl, S. Haridi, K. Tzoumas // Bulletin of the IEEE Computer Society Technical Committee on Data Engineering. –2015. –Vol. 36, No. 4.en
dc.relation.referencesChen J. Deep Learning With Edge Computing: A Review / J. Chen, X. Ran // Proceedings of the IEEE. –2019. –Vol. 107, No. 8. –P. 1655-1674.en
dc.relation.referencesCai Z. Simulation of database-valued Markov chains using SimSQL / Z. Cai, Z. Vagena, L. Perez, S. Arumugam, P. J. Haas, C. Jermaine // Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data. –2013. –P. 637-648.en
dc.relation.referencesZaharia M. Resilient distributed datasets: A fault-tolerant abstraction for in-memory cluster computing / M. Zaharia, M. Chowdhury, T. Das, et al., 9 authors in total // 9th USENIX Symposium on Networked Systems Design and Implementation (NSDI 12). –2012. –P. 15-28.en
dc.relation.referencesCheng X. Optimizing Spark RDD Operations with Lazy Evaluation / X. Cheng, X. Yan // 2020 IEEE 44th Annual Computers, Software, and Applications Conference (COMPSAC). –2020. –P. 1457-1462.en
dc.relation.referencesIsard M. Dryad: distributed data-parallel programs from sequential building blocks / M. Isard, M. Budiu, Y. Yu, A. Birrell, D. Fetterly // ACM SIGOPS operating systems review. –2007. –Vol. 41, No. 3. –P. 59-72.en
dc.relation.referencesToshniwal A. Storm@ twitter / A. Toshniwal, S. Taneja, A. Shukla, K. Ramasamy, J. M. Patel, S. Kulkarni,... N. Merchant // Proceedings of the 2014 ACM SIGMOD international conference on Management of data. –2014. –P. 147-156.en
dc.relation.referencesKreps J. Kafka: A distributed messaging system for log processing / J. Kreps, N. Narkhede, J. Rao // Proceedings of the NetDB. –2011. –Vol. 11. –P. 1-7.en
dc.relation.referencesRomanyuk O., Pavlov S. (2017). Fast ray casting of function-based surfaces, Przeglad elektroteczny, 5, p. 83-86.en
dc.relation.referencesRomanyuk Olexander, Pavlov Sergii, etc. (2020). A function-based approach to real-time visualization using graphics processing units, Proc. SPIE 11581, Photonics Applications in Astronomy, Communications, Industry, and High Energy Physics Experiments 2020, 115810E https://doi.org/10.1117/12.2580212.en
dc.relation.referencesTimchenko Leonid, Kokriatskaia Natalia, etc. (2020). Q-processors for real-time image processing, Proc. SPIE 11581, Photonics Applications in Astronomy, Communications, Industry, and High Energy Physics Experiments 2020, 115810F, https://doi.org/10.1117/12.2580230.en
dc.date.accessioned2026-10-22T06:28:41Z

Файли

Контейнер файлів

Зараз показуємо 1 - 1 з 1
Ескіз
Назва:
209737.pdf
Розмір:
312,48 KB
Формат:
Adobe Portable Document Format
Завантажити

Зібрання

Оптико-електронні інформаційно-енергетичні технології. 2024. № 2