Mining source code from GitHub repositories
Вантажиться...
Файли
Дата
Автори
Назва журналу
Номер ISSN
Назва тому
DOI
Анотація
GitHub has become one of the most widely used platforms for code hosting and repository mining. However, mining source code from GitHub presents challenges, most notably, a strict rate limit of 30 requests per minute imposed on the search API. We propose a methodology for mining software repositories based on the UNIX philosophy and the concept of the Make build tool, prioritising modular design, composition, and text-based output to files. The proposed approach applies progressive refinement and filtering, and is suitable for collecting datasets of any kind of source code where relevant Git repositories are not known a priori.
Опис
Ключові слова
формування проєктних вибірокAbstractGitHub has become one of the most widely used platforms for code hosting and repository mining However , mining , source code mining , mining software repositories , projects samplingIntroductionOver the past two decades , GitHub has become one of the most popular platforms for code hosting andcollaborating on open-source software Consequently , most researchers use it as a platform for mining software
УДК
Тип документа
Мова
ISSN
Бібліографічний опис
Якубів В. Р., Терлецький Д. О. Mining source code from GitHub repositories // Матеріали LV Всеукраїнської науково-технічної конференції підрозділів ВНТУ, Вінниця, 24-27 березня 2026 р. Електрон. текст. дані. 2026. Електрон. текст. дані. 2026. URI: https://conferences.vntu.edu.ua/index.php/all-fitki/all-fitki-2026/paper/view/28031.
Схвалення
Рецензія
Доповнено
Цитується в
Список використаної літератури (6)
- Gousios G., Spinellis D. GHTorrent: Github's data from a firehose // Proceedings of the 2012 9th IEEE Working Conference on Mining Software Repositories. Zurich: IEEE, 2012. Pp. 12–21.
- Gousios G. The GHTorent dataset and tool suite // Proceedings of the 2013 10th Working Conference on Mining Software Repos itories (MSR). San Francisco, CA, USA: IEEE, 2013. Pp. 233–236.
- Gousios G. et al. Lean GHTorrent: GitHub data on demand // Proceedings of the 11th Working Conference on Mining Software Repositories. Hyderabad, India: ACM, 2014. Pp. 384–387.
- Cosentino V., Luis J., Cabot J. Findings from GitHub: methods, datasets and limitations // MSR '16: Proceedings of the 13th International Conference on Mining Software Repositories. New York, NY, USA: ACM, 2016. Pp. 137–141.
- Dabi O., Aghajani E., Bavota G. Sampling projects in GitHub for MSR studies // Proceedings of the 2021 IEEE/ACM 18th International Conference on Mining Software Repositories (MSR). IEEE, 2021. Pp. 560–564.
- Dabi O., Tufano R., Bavota G. SEART Data Hub: streamlining large-scale source code mining and pre-processing // Proceedings of the 2024 IEEE International Conference on Software Maintenance and Evolution (ICSME). Flagstaff, AZ, USA: IEEE, 2024. Pp. 888–892.