Silverio Martínez-Fernández

30 Followers
14 Following
7 Posts
'Beatriz Galindo' Researcher in the GESSI research group, http://gessi.upc.edu/en Passionate about Software Engineering, Green AI, MLOps

🚀 Starting the new year on a high note! 🎉 Our paper "Do Developers Adopt Green Architectural Tactics for ML-Enabled Systems? A Mining Software Repository Study" has been accepted at #ICSE-SEIS2025!

We analyze 168 ML projects to uncover how developers adopt green architectural tactics for sustainable software. Huge thanks to @silveriomf & Fabio Palomba!

📄 Pre-Print here: https://arxiv.org/abs/2410.06708
#GreenAI #SoftwareEngineering #EmpiricalSE

Do Developers Adopt Green Architectural Tactics for ML-Enabled Systems? A Mining Software Repository Study

As machine learning (ML) and artificial intelligence (AI) technologies become more widespread, concerns about their environmental impact are increasing due to the resource-intensive nature of training and inference processes. Green AI advocates for reducing computational demands while still maintaining accuracy. Although various strategies for creating sustainable ML systems have been identified, their real-world implementation is still underexplored. This paper addresses this gap by studying 168 open-source ML projects on GitHub. It employs a novel large language model (LLM)-based mining mechanism to identify and analyze green strategies. The findings reveal the adoption of established tactics that offer significant environmental benefits. This provides practical insights for developers and paves the way for future automation of sustainable practices in ML systems.

arXiv.org
🚀 Thrilled to announce our paper "A Framework for Using LLMs for Repository Mining Studies in Empirical Software Engineering" has been accepted at #WSESE2025! 🎉
We introduce the PRIMES Framework to enhance dataset quality & reproducibility using LLMs. Big thanks to Joel Castaño, Fabio Palomba, Xavier Franch & @silveriomf #SoftwareEngineering #LLMs #EmpiricalSE #PromptEngineering
📄 For more details, you can read the full article here!
https://arxiv.org/abs/2411.09974
A Framework for Using LLMs for Repository Mining Studies in Empirical Software Engineering

Context: The emergence of Large Language Models (LLMs) has significantly transformed Software Engineering (SE) by providing innovative methods for analyzing software repositories. Objectives: Our objective is to establish a practical framework for future SE researchers needing to enhance the data collection and dataset while conducting software repository mining studies using LLMs. Method: This experience report shares insights from two previous repository mining studies, focusing on the methodologies used for creating, refining, and validating prompts that enhance the output of LLMs, particularly in the context of data collection in empirical studies. Results: Our research packages a framework, coined Prompt Refinement and Insights for Mining Empirical Software repositories (PRIMES), consisting of a checklist that can improve LLM usage performance, enhance output quality, and minimize errors through iterative processes and comparisons among different LLMs. We also emphasize the significance of reproducibility by implementing mechanisms for tracking model results. Conclusion: Our findings indicate that standardizing prompt engineering and using PRIMES can enhance the reliability and reproducibility of studies utilizing LLMs. Ultimately, this work calls for further research to address challenges like hallucinations, model biases, and cost-effectiveness in integrating LLMs into workflows.

arXiv.org
Packed room in the Empirical Research Methods section at #esem24. With great audience and intense discussions. I love it! #eseiw24
@seresearchers
After amazing days with the Workshop of ISERN and the doctoral symposium IDoESE, @silveriomf kicks off ESEM 2024.
@seresearchers
#eseiw24 #esem24

Two weeks left for the abstract deadline (April 26) of the technical track of #ESEM24

👉 Website: https://conf.researchr.org/home/esem-2024

ESEIW 2024

Welcome to the joint website of ESEIW 2024, the Empirical Software Engineering International Week 2024, and ESEM 2024, the 18th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement. The ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM) is the premier conference for presenting research results related to empirical software engineering. ESEM provides a stimulating forum where researchers and practitioners can present and discuss recent research results on a wide range of topics, in addition to exchanging ideas, experience ...

🍃 Really excited about starting the #GAISSA research project "Towards green AI‐based software systems: an architecture‐centric approach" in our group.

#SE4AI #GreenAI #SoftwareEngineering

My first research project as principal investigator together with Xavier Franch