Empirical Software Engineering

Article	Citations
Pandemic programming	141
Testing machine learning based systems: a systematic mapping	120
An exploratory study of smart contracts in the Ethereum blockchain platform	99
FixMiner: Mining relevant fix patterns for automated program repair	91
Predictors of well-being and productivity among software professionals during the COVID-19 pandemic – a longitudinal study	73
Sampling in software engineering research: a critical review and guidelines	73
What do Programmers Discuss about Deep Learning Frameworks	50
A practical guide on conducting eye tracking studies in software engineering	48
The state of adoption and the challenges of systematic variability management in industry	46
The practitioners’ point of view on the concept of technical debt and its causes and consequences: a design for a global family of industrial surveys and its first results from Brazil	43
The who, what, how of software engineering research: a socio-technical framework	42
Detection, assessment and mitigation of vulnerabilities in open source dependencies	41
The impact of automated feature selection techniques on the interpretation of defect models	39
A comprehensive study of bloated dependencies in the Maven ecosystem	39
A privacy and security analysis of early-deployed COVID-19 contact tracing Android apps	36
Perceived diversity in software engineering: a systematic literature review	34
Code cloning in smart contracts: a case study on verified contracts from the Ethereum blockchain platform	34
Automated patch assessment for program repair at scale	33
Systematic mapping study on domain-specific language development tools	33
Test case selection and prioritization using machine learning: a systematic literature review	32
Understanding and improving the quality and reproducibility of Jupyter notebooks	31
Topic modeling in software engineering research	31
An empirical investigation on the relationship between design and architecture smells	31
Promises and challenges of microservices: an exploratory study	29
AI lifecycle models need to be revised	29

Formal methods in dependable systems engineering: a survey of professionals from Europe and North America	28
Enjoy your observability: an industrial survey of microservice tracing and analysis	28
Lags in the release, adoption, and propagation of npm vulnerability fixes	27
On the time-based conclusion stability of cross-project defect prediction models	26
How software engineering research aligns with design science: a review	25
On the feasibility of automated prediction of bug and non-bug issues	25
MSRBot: Using bots to answer questions from software repositories	25
Practical relevance of software engineering research: synthesizing the community’s voice	24
An empirical investigation of performance overhead in cross-platform mobile development frameworks	24
Out of sight, out of mind? How vulnerable dependencies affect open-source projects	24
On the need of preserving order of data when validating within-project defect classifiers	23
Problems with SZZ and features: An empirical study of the state of practice of defect prediction data collection	23
An exploratory study on confusion in code reviews	23
Evaluating the agreement among technical debt measurement tools: building an empirical benchmark of technical debt liabilities	23
Software development with feature toggles: practices used by practitioners	22
Predicting the objective and priority of issue reports in software repositories	22
Wait for it: identifying “On-Hold” self-admitted technical debt	22
The secret life of test smells - an empirical study on test smell evolution and maintenance	21
How do i refactor this? An empirical study on refactoring trends and topics in Stack Overflow	20
On the assessment of software defect prediction models via ROC curves	20
How does combinatorial testing perform in the real world: an empirical study	20
The ‘as code’ activities: development anti-patterns for infrastructure as code	19
Security analysis of permission re-delegation vulnerabilities in Android apps	19
An empirical study of IoT topics in IoT developer discussions on Stack Overflow	19
Automated demarcation of requirements in textual specifications: a machine learning-based approach	19
Software provenance tracking at the scale of public source code	19
A teamwork effectiveness model for agile software development	19
Self-admitted technical debt practices: a comparison between industry and open-source	19
Why are many businesses instilling a DevOps culture into their organization?	19
On the impact of security vulnerabilities in the npm and RubyGems dependency networks	18
World of code: enabling a research workflow for mining and analyzing the universe of open source VCS data	18
Explicit programming strategies	18
Empirical evaluation of tools for hairy requirements engineering tasks	18
Game-based Sprint retrospectives: multiple action research	17
A longitudinal study of static analysis warning evolution and the effects of PMD on software quality in Apache open source projects	17
Can Offline Testing of Deep Neural Networks Replace Their Online Testing?	17
Topic recommendation for software repositories using multi-label classification algorithms	17
Industry practices and challenges for the evolvability assurance of microservices	16
Spearheading agile: the role of the scrum master in agile projects	16
Code and commit metrics of developer productivity: a study on team leaders perceptions	16
Development of recommendation systems for software engineering: the CROSSMINER experience	16
How agile teams make self-assignment work: a grounded theory study	16
Locating faults with program slicing: an empirical analysis	16
Strategies to manage quality requirements in agile software development: a multiple case study	15
Beyond the virus: a first look at coronavirus-themed Android malware	15
Predicting unstable software benchmarks using static source code features	15
Finding the sweet spot for organizational control and team autonomy in large-scale agile software development	15
A study of the performance of general compressors on log files	15
Test smells 20 years later: detectability, validity, and reliability	14
Learning to recognize actionable static code warnings (is intrinsically easy)	14

PHANTOM: Curating GitHub for engineered software projects using time-series clustering	14
The significance of bug report elements	14
Better software analytics via “DUO”: Data mining algorithms using/used-by optimizers	14
Publish or perish, but do not forget your software artifacts	14
A comprehensive study on software aging across android versions and vendors	14
Analysing app reviews for software engineering: a systematic literature review	14
A family of experiments on test-driven development	14
On systematically building a controlled natural language for functional requirements	13
Investigating types and survivability of performance bugs in mobile apps	13
Feature requests-based recommendation of software refactorings	13
StateAFL: Greybox fuzzing for stateful network servers	13
On the privacy of mental health apps	13
Building the perfect game – an empirical study of game modifications	13
GitHub Discussions: An exploratory study of early adoption	13
An empirical study of the characteristics of popular Minecraft mods	13
Understanding shared links and their intentions to meet information needs in modern code review:	13
Resource and dependency based test case generation for RESTful Web services	13
On the relationship between bug reports and queries for text retrieval-based bug localization	13
API compatibility issues in Android: Causes and effectiveness of data-driven detection techniques	13
An Empirical Investigation of Relevant Changes and Automation Needs in Modern Code Review	12
Software engineering whispers: The effect of textual vs. graphical software design descriptions on software design communication	12
Can pre-trained code embeddings improve model performance? Revisiting the use of code embeddings in software engineering tasks	12
A large scale analysis of mHealth app user reviews	12
Are datasets for information retrieval-based bug localization techniques trustworthy?	12
From anecdote to evidence: the relationship between personality and need for cognition of developers	12
An empirical study on changing leadership in agile teams	12
To what extent do DNN-based image classification models make unreliable inferences?	12
A multi-dimensional analysis of technical lag in Debian-based Docker images	12
Automatically recommending components for issue reports using deep learning	12
Assessment of off-the-shelf SE-specific sentiment analysis tools: An extended replication study	12
A longitudinal explanatory case study of coordination in a very large development programme: the impact of transitioning from a first- to a second-generation large-scale agile development method	12
Reuse and maintenance practices among divergent forks in three software ecosystems	12
Automated end-to-end management of the modeling lifecycle in deep learning	12
Maintenance-related concerns for post-deployed Ethereum smart contract development: issues, techniques, and future challenges	12
CROKAGE: effective solution recommendation for programming tasks by leveraging crowd knowledge	11
Ethics in the mining of software repositories	11
The entrepreneurial logic of startup software development: A study of 40 software startups	11
TaintBench: Automatic real-world malware benchmarking of Android taint analyses	11
Search-based fairness testing for regression-based machine learning systems	11
How to Better Distinguish Security Bug Reports (Using Dual Hyperparameter Optimization)	11
A configurable method for benchmarking scalability of cloud-native applications	11
Automated issue assignment: results and insights from an industrial case	11
Deep security analysis of program code	11
Evaluating network embedding techniques’ performances in software bug prediction	11
Uniform and scalable sampling of highly configurable systems	11
Breaking bad? Semantic versioning and impact of breaking changes in Maven Central	11
SMBFL: slice-based cost reduction of mutation-based fault localization	10
How does code readability change during software evolution?	10
CGT-FL: using cooperative game theory to effective fault localization in presence of coincidental correctness	10
An empirical study of Q&A websites for game developers	10
Characterizing the evolution of statically-detectable performance issues of Android apps	10
Learning from what we know: How to perform vulnerability prediction using noisy historical data	10
Demystifying the challenges and benefits of analyzing user-reported logs in bug reports	10
How Scrum adds value to achieving software quality?	10
What makes a popular academic AI repository?	9
A comparative study and analysis of developer communications on Slack and Gitter	9
Too many images on DockerHub! How different are images for the same system?	9
Improving energy-efficiency by recommending Java collections	9
Testing self-healing cyber-physical systems under uncertainty with reinforcement learning: an empirical study	9
An approach and benchmark to detect behavioral changes of commits in continuous integration	9
Standing on shoulders or feet? An extended study on the usage of the MSR data papers	9
Comparing the results of replications in software engineering	9
Lessons Learnt on Reproducibility in Machine Learning Based Android Malware Detection	9
Automated test reuse for highly configurable software	9
Developer-centric test amplification	9
A unified multi-task learning model for AST-level and token-level code completion	9
Automatic team recommendation for collaborative software development	9
An exploratory study on the introduction and removal of different types of technical debt in deep learning frameworks	9
Using code reviews to automatically configure static analysis tools	9
A first look at Android applications in Google Play related to COVID-19	9
Gamification in software engineering: the mediating role of developer engagement and job satisfaction	9
Systematic literature review on software quality for AI-based software	9
Software testing and Android applications: a large-scale empirical study	9
Automating system test case classification and prioritization for use case-driven testing in product lines	9
The effects of continuous integration on software development: a systematic literature review	9
Will you come back to contribute? Investigating the inactivity of OSS core developers in GitHub	9
A gamification solution for improving Scrum adoption	9
An empirical study on self-admitted technical debt in Dockerfiles	8
Interaction-based creation and maintenance of continuously usable trace links between requirements and source code	8
Pull request latency explained: an empirical overview	8

Towards effective assessment of steady state performance in Java software: are we there yet?	8
Using black-box performance models to detect performance regressions under varying workloads: an empirical study	8
Using a balanced scorecard to identify opportunities to improve code review effectiveness: an industrial experience report	8
The Teamwork Process Antecedents (TPA) questionnaire: developing and validating a comprehensive measure for assessing antecedents of teamwork process quality	8
Where were the repair ingredients for Defects4j bugs?	8
Learning by sampling: learning behavioral family models from software product lines	8
Do I really need all this work to find vulnerabilities?	8
Identifying self-admitted technical debt in issue tracking systems using machine learning	8
An empirical study of question discussions on Stack Overflow	8
Characteristics of method extractions in Java: a large scale empirical study	8
Dynamical analysis of diversity in rule-based open source network intrusion detection systems	8
Do code review measures explain the incidence of post-release defects?	8
Understanding and improving artifact sharing in software engineering research	8
Developers perception of peer code review in research software development	8
Is GitHub’s Copilot as bad as humans at introducing vulnerabilities in code?	8
Why and what happened? Aiding bug comprehension with automated category and causal link identification	8
A fine-grained data set and analysis of tangling in bug fixing commits	8
Generating API tags for tutorial fragments from Stack Overflow	7
The Relation of Test-Related Factors to Software Quality: A Case Study on Apache Systems	7
FACER: An API usage-based code-example recommender for opportunistic reuse	7
FeatCompare: Feature comparison for competing mobile apps leveraging user reviews	7
Revisiting reopened bugs in open source software systems	7
Towards an evidence-based theoretical framework on factors influencing the software development productivity	7
Efficient static analysis and verification of featured transition systems	7
Understanding developers’ privacy and security mindsets via climate theory	7
On the fulfillment of coordination requirements in open-source software projects: An exploratory study	7
Software product-line evaluation in the large	7
Revisiting process versus product metrics: a large scale analysis	7
On effort-aware metrics for defect prediction	7
Evolving software system families in space and time with feature revisions	7
Information correspondence between types of documentation for APIs	7
SPVF: security property assisted vulnerability fixing via attention-based models	7
Evaluating the robustness of source code plagiarism detection tools to pervasive plagiarism-hiding modifications	7
On the usage, co-usage and migration of CI/CD tools: A qualitative analysis	7
Weighted software metrics aggregation and its application to defect prediction	7
AndroEvolve: automated Android API update with data flow analysis and variable denormalization	7
Characterizing usages, updates and risks of third-party libraries in Java projects	7
Automated driver management for Selenium WebDriver	7
A conceptual model for unifying variability in space and time: Rationale, validation, and illustrative applications	7
FindICI: Using machine learning to detect linguistic inconsistencies between code and natural language descriptions in infrastructure-as-code	7
Flair: efficient analysis of Android inter-component vulnerabilities in response to incremental changes	7
What to share, when, and where: balancing the objectives and complexities of open source software contributions	7
Automatic identification of self-admitted technical debt from four different sources	7
An empirical study on release notes patterns of popular apps in the Google Play Store	7
Learning lenient parsing & typing via indirect supervision	7
Embedding API dependency graph for neural code generation	7
Does class size matter? An in-depth assessment of the effect of class size in software defect prediction	6
On the analysis of non-coding roles in open source development	6
Mining and relating design contexts and design patterns from Stack Overflow	6
Static detection of equivalent mutants in real-time model-based mutation testing	6
FIXME: synchronize with database! An empirical study of data access self-admitted technical debt	6
GreenHub: a large-scale collaborative dataset to battery consumption analysis of android devices	6
An empirical study of same-day releases of popular packages in the npm ecosystem	6
Helping or not helping? Why and how trivial packages impact the npm ecosystem	6
Analysing Time-Stamped Co-Editing Networks in Software Development Teams using git2net	6
A study of how Docker Compose is used to compose multi-component systems	6
Understanding peer review of software engineering papers	6
Omni: automated ensemble with unexpected models against adversarial evasion attack	6
Investigating design anti-pattern and design pattern mutations and their change- and fault-proneness	6
A systematic literature review on trust in the software ecosystem	6
On the adequacy of static analysis warnings with respect to code smell prediction	6
Towards cost-benefit evaluation for continuous software engineering activities	6
An empirical study on the use of SZZ for identifying inducing changes of non-functional bugs	6
Predicting health indicators for open source projects (using hyperparameter optimization)	6
E-APR: Mapping the effectiveness of automated program repair techniques	6
CT-IoT: a combinatorial testing-based path selection framework for effective IoT testing	6
Learning actionable analytics from multiple software projects	6
Mining Python fix patterns via analyzing fine-grained source code changes	6
Revisiting the VCCFinder approach for the identification of vulnerability-contributing commits	6
Training students in evidence-based software engineering and systematic reviews: a systematic review and empirical study	6
TraceSim: An Alignment Method for Computing Stack Trace Similarity	6
Mutation testing in the wild: findings from GitHub	6
DebtFree: minimizing labeling cost in self-admitted technical debt identification using semi-supervised learning	6
An automated framework for the extraction of semantic legal metadata from legal texts	6
Exploring Performance Assurance Practices and Challenges in Agile Software Development: An Ethnographic Study	6
Deep learning approaches for bad smell detection: a systematic literature review	5
An empirical study of developers’ discussions about security challenges of different programming languages	5
Characterizing refactoring graphs in Java and JavaScript projects	5
Practitioner’s view of the success factors for software outsourcing partnership formation: an empirical exploration	5
A qualitative study of developers’ discussions of their problems and joys during the early COVID-19 months	5
On the use of commit-relevant mutants	5
CsmithEdge: more effective compiler testing by handling undefined behaviour less conservatively	5
Empirical analysis of security vulnerabilities in Python packages	5
How do Android developers improve non-functional properties of software?	5
From one to hundreds: multi-licensing in the JavaScript ecosystem	5
On the preferences of quality indicators for multi-objective search algorithms in search-based software engineering	5
Revisiting the debate: Are code metrics useful for measuring maintenance effort?	5
Styler: learning formatting conventions to repair Checkstyle violations	5
Static test flakiness prediction: How Far Can We Go?	5
Open-source software product line extraction processes: the ArgoUML-SPL and Phaser cases	5
The forgotten role of search queries in IR-based bug localization: an empirical study	5
Conclusion stability for natural language based mining of design discussions	5
Evaluating refactorings for disciplining #ifdef annotations: An eye tracking study with novices	5
On the Removal of Feature Toggles	5
A machine and deep learning analysis among SonarQube rules, product, and process metrics for fault prediction	5