Empirical Software Engineering

Article	Citations
Introduction to the special issue on program comprehension	211
Effects of variability in models: a family of experiments	99
Consensus task interaction trace recommender to guide developers’ software navigation	69
On the adoption and effects of source code reuse on defect proneness and maintenance effort	66
Path context augmented statement and network for learning programs	65
Efficient static analysis and verification of featured transition systems	63
Shaky structures: The wobbly world of causal graphs in software analytics	57
Optimal priority assignment for real-time systems: a coevolution-based approach	51
An empirical study on the effectiveness of large language models for SATD identification and classification	50
Does the first response matter for future contributions? A study of first contributions	44
The human experience of comprehending source code in virtual reality	43
Can static analysis tools find more defects?	41
Understanding the characteristics and the role of visual issue reports	40
Toward effective secure code reviews: an empirical study of security-related coding weaknesses	40
More than React: Investigating the Role of Emoji Reaction in GitHub Pull Requests	40
An empirical study of IoT topics in IoT developer discussions on Stack Overflow	36
Seeing the invisible: test prioritization for object detection system	35
A study of documentation for software architecture	34
Evaluating few-shot and contrastive learning methods for code clone detection	32
Evaluating software user feedback classifier performance on unseen apps, datasets, and metadata	31
Bugs in machine learning-based systems: a faultload benchmark	30
Collaboration failure analysis in cyber-physical system-of-systems using context fuzzy clustering	28
Dynamical analysis of diversity in rule-based open source network intrusion detection systems	28
Cross-status communication and project outcomes in OSS development	28
(In)Security of mobile apps in developing countries: a systematic literature review	28

Smells in system user interactive tests	28
TestEvoViz: visualizing genetically-based test coverage evolution	28
Deep learning based identification of inconsistent method names: How far are we?	27
A fine-grained taxonomy of code review feedback in TypeScript projects	27
Towards cost-benefit evaluation for continuous software engineering activities	26
Evaluating the impact of flaky simulators on testing autonomous driving systems	26
Automatic prediction of rejected edits in Stack Overflow	26
Analyzing and mitigating (with LLMs) the security misconfigurations of Helm charts from Artifact Hub	26
On the use of commit-relevant mutants	25
Automated test generation for Scratch programs	25
Testing the past: can we still run tests in past snapshots for Java projects?	25
The impact of the COVID-19 pandemic on women’s contribution to public code	24
What causes exceptions in machine learning applications? Mining machine learning-related stack traces on Stack Overflow	24
Deep learning techniques to detect cybersecurity attacks: a systematic mapping study	23
On the impact of security vulnerabilities in the npm and RubyGems dependency networks	23
Developers’ perception matters: machine learning to detect developer-sensitive smells	23
App review driven collaborative bug finding	23
Practitioner’s view of the success factors for software outsourcing partnership formation: an empirical exploration	23
BTLink : automatic link recovery between issues and commits based on pre-trained BERT model	23
Static detection of equivalent mutants in real-time model-based mutation testing	22
An empirical evaluation of a novel domain-specific language – modelling vehicle routing problems with Athos	22
How far are we with automated machine learning? characterization and challenges of AutoML toolkits	22
Experimental comparison of features, analyses, and classifiers for Android malware detection	22
The impact of class imbalance techniques on crashing fault residence prediction models	22
Indentation and reading time: a randomized control trial on the differences between generated indented and non-indented if-statements	21
Visualizing the customization endeavor in product-based-evolving software product lines: a case of action design research	21
A grounded theory of community package maintenance organizations	21
Understanding practitioners’ reasoning and requirements for efficient tool support in technical debt management	20
On combining commit grouping and build skip prediction to reduce redundant continuous integration activity	20
The well-being of software engineers: a systematic literature review and a theory	20
Advantages and disadvantages of (dedicated) model transformation languages	20
An empirical study of untangling patterns of two-class dependency cycles	19
AI support for data scientists: An empirical study on workflow and alternative code recommendations	19
Code reviews in open source projects : how do gender biases affect participation and outcomes?	19
A large-scale empirical study of commit message generation: models, datasets and evaluation	19
How far are app secrets from being stolen? a case study on android	19
An empirical study of the impact of log parsers on the performance of log-based anomaly detection	19
A configurable method for benchmarking scalability of cloud-native applications	19
Securing dependencies: A comprehensive study of Dependabot’s impact on vulnerability mitigation	19
JNFuzz-Droid: a lightweight fuzzing and taint analysis framework for native code of Android applications	19
Towards a recipe for language decomposition: quality assessment of language product lines	18
An empirical study on the potential of word embedding techniques in bug report management tasks	18
Real world projects, real faults: evaluating spectrum based fault localization techniques on Python projects	18
LineFlowDP: A Deep Learning-Based Two-Phase Approach for Line-Level Defect Prediction	18
Take a deep breath: Benefits of neuroplasticity practices for software developers and computer workers in a family of experiments	18
Engineering recommender systems for modelling languages: concept, tool and evaluation	18
What really changes when developers intend to improve their source code: a commit-level study of static metric value and static analysis warning changes	18
Lightweight dynamic build batching algorithms for continuous integration	17
Gamification in software engineering: the mediating role of developer engagement and job satisfaction	16
Demystifying regular expression bugs	16

Systematic Evaluation of Deep Learning Models for Log-based Failure Prediction	16
Patterns of multi-container composition for service orchestration with Docker Compose	16
Language usage analysis for EMF metamodels on GitHub	16
Software product line testing: a systematic literature review	16
A metrics-based approach for selecting among various refactoring candidates	16
When less is more: on the value of “co-training” for semi-supervised software defect predictors	15
Enhanced SQL error messages facilitate faster error fixing	15
Software testing in the machine learning era	15
An empirical study of Q&A websites for game developers	15
Mastering uncertainty in performance estimations of configurable software systems	15
On the Investigation of Empirical Contradictions - Aggregated Results of Local Studies on Readability and Comprehensibility of Source Code	15
What kinds of contracts do ML APIs need?	14
A study of how Docker Compose is used to compose multi-component systems	14
Comparing effectiveness and efficiency of Interactive Application Security Testing (IAST) and Runtime Application Self-Protection (RASP) tools in a large java-based system	14
Is GitHub’s Copilot as bad as humans at introducing vulnerabilities in code?	14
Applying bayesian data analysis for causal inference about requirements quality: a controlled experiment	14
OpTrans: enhancing binary code similarity detection with function inlining re-optimization	14
Semantic matching in GUI test reuse	14
Can the configuration of static analyses make resolving security vulnerabilities more effective? - A user study	14
Test smells 20 years later: detectability, validity, and reliability	14
Correction to: Examining ownership models in software teams	14
Why secret detection tools are not enough: It’s not just about false positives - An industrial case study	14
RAG-Driven multiple assertions generation with large language models	14
Präzi: from package-based to call-based dependency networks	14
An investigation of online and offline learning models for online Just-in-Time Software Defect Prediction	14
Program transformation landscapes for automated program modification using Gin	14
Common challenges of deep reinforcement learning applications development: an empirical study	14
Defect prediction using deep learning with Network Portrait Divergence for software evolution	13
Which design decisions in AI-enabled mobile applications contribute to greener AI?	13
SmartFast: an accurate and robust formal analysis tool for Ethereum smart contracts	13
Challenges and practices of deep learning model reengineering: A case study on computer vision	13
Prioritizing test cases for deep learning-based video classifiers	13
Toward granular search-based automatic unit test case generation	13
Studying the explanations for the automated prediction of bug and non-bug issues using LIME and SHAP	12
Demystifying API misuses in deep learning applications	12
A multi-model framework for semantically enhancing detection of quality-related bug report descriptions	12
Cross-project defect prediction via semantic and syntactic encoding	12
Semantically-enhanced topic recommendation systems for software projects	12
A controlled experiment on the impact of microtasking on programming	12
Correction to: Towards a recipe for language decomposition: quality assessment of language product lines	12
Static analysis driven enhancements for comprehension in machine learning notebooks	12
Reflections on the Empirical Software Engineering journal	12
DDImage: an image reduction based approach for automatically explaining black-box classifiers	12
Experimental Evaluation of a Checklist-Based Inspection Technique to Verify the Compliance of Software Systems with the Brazilian General Data Protection Law	12
Seeing confusion through a new lens: on the impact of atoms of confusion on novices’ code comprehension	11
Learning to Predict Code Review Completion Time In Modern Code Review	11
Propagating frugal user feedback through closeness of code dependencies to improve IR-based traceability recovery	11
Modeling function-level interactions for file-level bug localization	11
CyberSAGE: The cyber security argument graph evaluation tool	11
What have we learned? A conceptual framework on New Zealand software professionals and companies’ response to COVID-19	11
Towards automatic labeling of exception handling bugs: A case study of 10 years bug-fixing in Apache Hadoop	11
CsmithEdge: more effective compiler testing by handling undefined behaviour less conservatively	11
Explainable automated debugging via large language model-driven scientific debugging	11
Unveiling overlooked performance variance in serverless computing	11
Styler: learning formatting conventions to repair Checkstyle violations	11
A fine-grained data set and analysis of tangling in bug fixing commits	11
A comprehensive overview of software product management challenges	11
A fine-grained evaluation of mutation operators to boost mutation testing for deep learning systems	11
APR4Vul: an empirical study of automatic program repair techniques on real-world Java vulnerabilities	10
SoftNER: Mining knowledge graphs from cloud incidents	10
From guidelines to practice: assessing Android app developer compliance with google’s security recommendations	10
Silent bugs in deep learning frameworks: an empirical study of Keras and TensorFlow	10
Assessing the exposure of software changes	10
Predicting merge conflicts considering social and technical assets	10
An empirical study on self-admitted technical debt in Dockerfiles	10
A qualitative study on refactorings induced by code review	10
Refactoring practices in the context of data-intensive systems	10
Transformer-based code model with compressed hierarchy representation	10
Inter-team communication in large-scale co-located software engineering: a case study	10
Fixing Dockerfile smells: an empirical study	10
On the spread and evolution of dead methods in Java desktop applications: an exploratory study	10
Understanding and effectively mitigating code review anxiety	10
Studying differentiated code to support smart contract update	10
A qualitative study of developers’ discussions of their problems and joys during the early COVID-19 months	10
Two N-of-1 self-trials on readability differences between anonymous inner classes (AICs) and lambda expressions (LEs) on Java code snippets	10
How to cherry pick the bug report for better summarization?	9
Predicting the objective and priority of issue reports in software repositories	9
An empirical study of the systemic and technical migration towards microservices	9
What happens in my code reviews? An investigation on automatically classifying review changes	9
Can search-based testing with pareto optimization effectively cover failure-revealing test inputs?	9

GitHub Discussions: An exploratory study of early adoption	9
Agile software development one year into the COVID-19 pandemic	9
Detecting data manipulation errors in android applications using scene-guided exploration	9
Empirically evaluating flaky test detection techniques combining test case rerunning and machine learning models	9
On the assignment of commits to releases	9
Hyperfuzzing: black-box security hypertesting with a grey-box fuzzer	9
Industrial adoption of machine learning techniques for early identification of invalid bug reports	9
Come for syntax, stay for speed, write secure code: an empirical study of security weaknesses in Julia programs	9
Characterizing refactoring graphs in Java and JavaScript projects	9
Studying the characteristics of AIOps projects on GitHub	9
An empirical study on developers’ shared conversations with ChatGPT in GitHub pull requests and issues	9
Navigating fairness: practitioners’ understanding, challenges, and strategies in AI/ML development	9
Towards understanding quality challenges of the federated learning for neural networks: a first look from the lens of robustness	9
Toward a theory on programmer’s block inspired by writer’s block	9
How do i refactor this? An empirical study on refactoring trends and topics in Stack Overflow	9
A comprehensive study of machine learning techniques for log-based anomaly detection	9
Machine learning-based test smell detection	9
Story points changes in agile iterative development	9
Automatic bi-modal question title generation for Stack Overflow with prompt learning	9
Model vs system level testing of autonomous driving systems: a replication and extension study	9
Multi-granular software annotation using file-level weak labelling	9
Correction to: Advantages and disadvantages of (dedicated) model transformation languages	8
A multi-objective effort-aware approach for early code review prediction and prioritization	8
Software reconfiguration in robotics	8
A longitudinal explanatory case study of coordination in a very large development programme: the impact of transitioning from a first- to a second-generation large-scale agile development method	8
Quality issues in machine learning software systems	8
Reuse and maintenance practices among divergent forks in three software ecosystems	8
On the suitability of hugging face hub for empirical studies	8
Understanding refactorings in Elixir functional language	8
IRJIT: A simple, online, information retrieval approach for just-in-time software defect prediction	8
Software selection in large-scale software engineering: A model and criteria based on interactive rapid reviews	8
Investigating user feedback from a crowd in requirements management in software ecosystems	8
WIA-SZZ: Work item aware SZZ	8
Correction to: Utilization of pre-trained language models for adapter-based knowledge transfer in software engineering	8
Ethics in AI through the practitioner’s view: a grounded theory literature review	8
Automated detection, categorisation and developers’ experience with the violations of honesty in mobile apps	8
Empirical evaluation of tools for hairy requirements engineering tasks	8
Evaluating pre-trained models for user feedback analysis in software engineering: a study on classification of app-reviews	8
Extracting enhanced artificial intelligence model metadata from software repositories	8
Does code review speed matter for practitioners?	8
Mining and relating design contexts and design patterns from Stack Overflow	8
Quantum circuit mutants: Empirical analysis and recommendations	8
Studying eventual connectivity issues in Android apps	8
Developer-centric test amplification	8
Just-in-Time crash prediction for mobile apps	8
Deep learning approaches for bad smell detection: a systematic literature review	8
The forgotten role of search queries in IR-based bug localization: an empirical study	8
How programmers find online learning resources	8
What makes a code review useful to OpenDev developers? An empirical investigation	7
SparseCoder: Advancing source code analysis with sparse attention and learned token pruning	7
Investigating developers’ perception on software testability and its effects	7
Design smells in multi-language systems and bug-proneness: a survival analysis	7
Fixing vulnerabilities potentially hinders maintainability	7
On the acceptance by code reviewers of candidate security patches suggested by Automated Program Repair tools	7
A preliminary investigation on using multi-task learning to predict change performance in code reviews	7
Causal inference of server- and client-side code smells in web apps evolution	7
Improving hardware/software interface management in systems of systems through documentation as code	7
The making of accessible Android applications: an empirical study on the state of the practice	7
The indolent lambdification of Java	7
On the usage and development of deep learning compilers: an empirical study on TVM	7
Correction to: Analysing app reviews for software engineering: a systematic literature review	7
Do I really need all this work to find vulnerabilities?	7
Developer discussion topics on the adoption and barriers of low code software development platforms	7
Deep security analysis of program code	7
Integrating human values in software development using a human values dashboard	7
Revisiting the building of past snapshots — a replication and reproduction study	7
Rotten green tests in Java, Pharo and Python	7
Mining Python fix patterns via analyzing fine-grained source code changes	7
Leveraging encoder-only large language models for mobile app review feature extraction	7
Works for Me! Cannot Reproduce – A Large Scale Empirical Study of Non-reproducible Bugs	7
Detecting outdated code element references in software repository documentation	7
What do class comments tell us? An investigation of comment evolution and practices in Pharo Smalltalk	7
Identifying self-admitted technical debt in issue tracking systems using machine learning	7
Bug characterization in machine learning-based systems	7
ROBUST: 221 bugs in the Robot Operating System	7
Fluently specifying taint-flow queries with fluentTQL	7
The evolution of the code during review: an investigation on review changes	7
Tracking bad updates in mobile apps: a search-based approach	7
The best ends by the best means: ethical concerns in app reviews	6
Using acceptance tests to predict merge conflict risk	6
The broken windows theory applies to technical debt	6
From anecdote to evidence: the relationship between personality and need for cognition of developers	6
Analyzing the BizDev interface in an enterprise context: a case of developers acting in business	6
A review of automatic source code summarization	6
DebtFree: minimizing labeling cost in self-admitted technical debt identification using semi-supervised learning	6
Balancing technology heterogeneity in microservice architectures	6
A theory of factors affecting continuous experimentation (FACE)	6
PTM4Tag+: Tag recommendation of stack overflow posts with pre-trained models	6
Enhancing the defectiveness prediction of methods and classes via JIT	6
An extensive replication study of the ABLoTS approach for bug localization	6
Simplifying software compliance: AI technologies in drafting technical documentation for the AI Act	6
Large scale reuse of microservices using CI/CD and InnerSource practices - a case study	6
Analysis of a many-objective optimization approach for identifying microservices from legacy systems	6
Assessing the opportunity of combining state-of-the-art Android malware detectors	6
MPDA: a data augmentation approach to improve deep learning for software vulnerability detection	6