Research Article

Summarising big data: public GitHub dataset for software engineering challenges

Volume: 41 Number: 3 September 30, 2020
Cumhuriyet Science Journal Cover
Cumhuriyet Science Journal
PDF Download
EN

Summarising big data: public GitHub dataset for software engineering challenges

Abstract

In open-source software development environments; textual, numerical, and relationship-based data generated are of interest to researchers. Various data sets are available for this data, which is frequently used in areas such as software engineering and natural language processing. However, since these data sets contain all the data in the environment, the problem arises in the terabytes of data processing. For this reason, almost all of the studies using GitHub data use filtered data according to certain criteria. In this context, using a different data set in each study makes a comparison of the accuracy of the studies quite difficult. In order to solve this problem, a common dataset was created and shared with the researchers, which would allow to work on many software engineering problems.

Keywords

References

  1. V. Cosentino, J. Luis, and J. Cabot. Findings from GitHub: methods, datasets and limitations. Proceedings of the 13th International Workshop on Mining Software Repositories, (2016), 137–141.
  2. V. Cosentino, J. L. Canovas Izquierdo, and J. Cabot. A Systematic Mapping Study of Software Development With GitHub. IEEE Access, 5 (2017) 7173–7192.
  3. Z. Kotti and D. Spinellis. Standing on shoulders or feet?: the usage of the MSR data papers. Proceedings of the 16th International Conference on Mining Software Repositories, (2019) 565–576.
  4. G. Gousios. The GHTorrent dataset and tool suite. Proceedings of the 10th Working Conference on Mining Software Repositories, (2013) 233–236.
  5. Y. Zhang, G. Yin, Y. Yu, and H. Wang. Investigating social media in GitHub’s pull-requests: a case study on Ruby on Rails. Proceedings of the 1st International Workshop on Crowd-based Software Development Methods and Technologies - CrowdSoft 2014 (2014) 37–41.
  6. E. van der Veen, G. Gousios, and A. Zaidman. Automatically Prioritizing Pull Requests. 2015 IEEE/ACM 12th Working Conference on Mining Software Repositories. (2015) 357–361.
  7. Y. Yu, H. Wang, V. Filkov, P. Devanbu, and B. Vasilescu. Wait for It: Determinants of Pull Request Evaluation Latency on GitHub. 2015 IEEE/ACM 12th Working Conference on Mining Software Repositories, (2015) 367–371.
  8. M. L. de L. Júnior, D. M. Soares, A. Plastino, and L. Murta. Automatic assignment of integrators to pull requests: The importance of selecting appropriate attributes. J. Syst. Softw., 144 (2018) 181–196.

Details

Primary Language

English

Subjects

Engineering

Journal Section

Research Article

Authors

Publication Date

September 30, 2020

Submission Date

April 29, 2020

Acceptance Date

June 12, 2020

Published in Issue

Year 2020 Volume: 41 Number: 3

DOI

https://doi.org/10.17776/csj.728932

IZ

https://izlik.org/JA34NK67TE

Cite

RIS / Bibtex
APA
Şeker, A., Diri, B., Arslan, H., & Amasyalı, F. (2020). Summarising big data: public GitHub dataset for software engineering challenges. Cumhuriyet Science Journal, 41(3), 720-724. https://doi.org/10.17776/csj.728932

Cited By

New Developer Metrics for Open Source Software Development Challenges: An Empirical Study of Project Recommendation Systems

Applied Sciences

https://doi.org/10.3390/app11030920

As of 2026, Cumhuriyet Science Journal will be published in six issues per year, released in February, April, June, August, October, and December