AIware 2026
Mon 6 - Tue 7 July 2026 Montreal, Canada
co-located with FSE 2026

AIware 2026 Keynote Speakers

Lin Tan
Lin Tan
Purdue University and Amazon
From Features to Data and Domain Knowledge: Reflections on Two Decades of AI for Software
This talk traces how AI-driven software engineering—particularly bug finding—has evolved over two decades: from statistical machine learning and handcrafted features to today’s large language models and agentic pipelines. The central bottleneck has shifted—from features to data, and from implementation to validation and verification. Drawing on work spanning automated code generation, bug and vulnerability detection and repair, binary analysis, and robot task planning, this talk argues that the field is undergoing a broader transition from features to data and domain knowledge. Here, “code” is interpreted broadly: beyond source code to binaries, HTML and CSS, and LaTeX—and beyond functional correctness to maintenance and security. LLMs are powerful across all of these settings, yet they are not a silver bullet: they hallucinate fixes, overfit to test suites, and degrade on real-world tasks. The talk closes by examining what will likely define the decade ahead for software engineering research, including data generation, specification- and test-driven software development, rigorous benchmarks, and neurosymbolic AI.
Bio: Lin Tan is a Professor and University Faculty Scholar in the Department of Computer Science at Purdue University and an Amazon Scholar. Previously, she was a Canada Research Chair and an associate professor at the University of Waterloo. Her research interests include software-AI synergy (AI4Software and Software4AI), LLM4Code, software dependability, autoformalization, and software text analytics. Dr. Tan is an IEEE Fellow and an ELATES Fellow. She is a recipient of ICSE 2026 Most Influential Paper Award, ICSE 2026 retrospective Most Influential SEIP Paper Award, an Early Career Academic Achievement Alumni Award from the University of Illinois, Urbana-Champaign, Canada Research Chair, and multiple industry awards. Dr. Tan's co-authored papers have received Best Paper Award Finalist at ICRA 2025; ACM Distinguished Paper Awards at CCS 2024, ASE 2020, MSR 2018, and FSE 2016; Spotlight at NeurIPS 2025; Oral at AAAI 2023; and IEEE Micro's Top Picks in 2006. She has served as Program Co-Chair of FSE 2024 and LLM4Code, Associate Editor of IEEE Transactions on Software Engineering and Empirical Software Engineering, and ACM SIGSOFT Treasurer and elected Member-at-Large.
Thomas Cottenier
Thomas Cottenier
Arm
When Implementation Stops Being the Bottleneck: Design in AI-Native Software Engineering
AI is genuinely lowering the barriers to building software - but democratization is the surface effect. The deeper transformation is structural: AI shifts the primary bottleneck in software development from implementation to system design and reasoning. In agent-driven workflows, the constraint is no longer writing correct code across a large surface area. It is making good architectural decisions, managing system-level tradeoffs, and reasoning coherently across concerns - performance, modularity, data flow, hardware characteristics - that previously required deep specialization or large, coordinated teams. Individual developers and small groups can now operate fluidly across layers that were previously siloed not by technical necessity but by organizational scale. This shift raises fundamental questions for the software engineering research community. How do we evaluate design quality in systems that evolve continuously under agent-driven modification? What does meaningful modularity look like when the cost of cross-boundary reasoning approaches zero? How should practices like refactoring, testing, and performance validation be reconceived when the artifact being maintained is as much a set of agent instructions as a codebase? This talk draws on experience building AI-powered developer tools at AWS and working on AI acceleration across edge and cloud at Arm to ground these questions in observable shifts in how complex systems are actually being built today - and to argue that the SE community's next productive frontier is not productivity measurement, but the theory and practice of design in the age of capable agents.
Bio: Thomas Cottenier is a Senior Principal Engineer at Arm, working on developer platforms and AI services across edge and cloud environments. He previously served as a Principal Engineer at AWS, where he contributed to AI-powered developer tools including CodeWhisperer, Amazon Q, and Kiro. He holds a PhD in Computer Science in programming languages and software engineering and has over 20 years of experience spanning code generation, model-driven engineering, automated refactoring, and large-scale code modernization. His current work focuses on AI-native development, system design, and AI acceleration.
Pascal Kesseli
Pascal Kesseli
Microsoft
Formal Methods for Reliable AI Reasoning
In this talk, Pascal Kesseli explores how formal methods can enhance reasoning capabilities in modern AI systems, drawing on his research at the University of Oxford and his work at Meta GenAI and FAIR. He introduces an agentic inference-time reasoning engine, Logic.py, and shows how it supports structured decision-making in agents. He then turns to follow-on work that applies AlphaGo-style reinforcement learning training pipelines to improve reasoning behavior, and he closes by outlining how inference-time and training-time approaches are beginning to converge into a unified direction for building more capable, dependable agents.
Bio: Pascal Kesseli is a researcher and engineer working at the intersection of formal methods and AI. He earned a DPhil from the University of Oxford, focusing on static code analysis and program synthesis using formal reasoning engines. At Meta, he worked across GenAI and FAIR on agentic LLM systems and research infrastructure, including inference-time tool use with formal reasoning engines, contributions to Meta’s Code World Model, and reinforcement-learning environments grounded in static analysis. Most recently he started a position at Microsoft AI, working on RL and coding capabilities.
Qidi Xu
Qidi Xu
MiniMax
From Chatbots to Colleagues: Steering Code-Driven Agents for End-to-End Autonomy
The paradigm of Generative AI is rapidly evolving from passive assistants to autonomous entities. Moving beyond the chatbot and simple code-completion copilots, the next generation of AI agents functions as digital colleagues capable of end-to-end task execution. This talk explores how these agents leverage code not merely as an output, but as their fundamental reasoning engine and interface for interacting with the world. We will focus on the shift from manual prompting to high-level Steering, discussing how human intent can guide code-driven agents to autonomously navigate complex workflows, resolve software engineering challenges, and bridge the gap between abstract requirements and finished, functional results.
Bio: Qidi Xu is a Researcher at MiniMax, specializing in post-training research for Large Language Models (LLMs) focused on software engineering and terminal usage. As a contributor to the coding capabilities of MiniMax M2 series, he is dedicated to evolving AI from simple code generation tools into "digital colleagues" capable of end-to-end autonomous execution. He leads technical iterations in complex code generation, multi-step task execution, and downstream framework adaptability. By leveraging code as a core reasoning engine, he has significantly enhanced the model's engineering performance in real-world development environments, enabling it to autonomously navigate complex workflows and bridge the gap between abstract requirements and functional implementation.
Pascal Kesseli
Rajdeep Mukherjee
Amazon
Spec-Driven Development for Autonomous Coding Agents Across the SDLC
In this talk, I will introduce Spec-Driven Development (SDD) in the era of large foundation models and autonomous AI agents, arguing for re-centering the Software Development Life Cycle (SDLC) around specifications to improve alignment, reliability, and long-term maintainability. By placing structured, semi-formal specifications at the core of development, we can ensure higher fidelity between intent, implementation, and system behavior. I will use Kiro (https://kiro.dev/) as a concrete example to demonstrate how development begins with specifications that systematically guide code generation, validation, and evolution. We will explore how SDD supports both greenfield systems, by enforcing clarity and architectural rigor from inception, and brownfield systems, by extracting and leveraging specs from legacy codebases for feature development, bug fix, and modernization. I’ll discuss how coding agents grounded in specs can improve correctness, reduce hallucination, and enforce invariants, while also highlighting open challenges such as spec completeness, ambiguity, trust, and semantic alignment. Finally, we’ll discuss the need for offline benchmarks, high-quality {Code, Spec} datasets, and rigorous evaluation metrics, and conclude with a forward-looking perspective on how specifications may evolve into the primary artifact of software engineering, with code becoming a compiled byproduct of intent.
Bio: Rajdeep Mukherjee is a Tech Lead and Senior Applied Scientist at Amazon, leading developer tools such as Kiro that power developer experiences both inside and outside Amazon. Prior to working on Kiro, Rajdeep developed AI-based coding assistant products such as Amazon Q Developer Customization, as well as code review products such as Amazon CodeGuru. He earned his PhD in Computer Science from University of Oxford, specializing in formal methods and program analysis for system correctness. Prior to joining Amazon, Rajdeep worked in the Electronic Design Automation industry, where he built formal verification tools at Cadence Design Systems that check the correctness of hardware, software, and safety-critical systems. He has also held research roles at Arm Cambridge, Microsoft Research, IBM Research, and Diffblue. His expertise spans coding agents, LLM applications, static analysis, program synthesis, and formal verification systems.
Pascal Kesseli
Dickson Tsai
Claude Code
Harness Design for Increasingly Capable Models: How Newer Claude Code Features Shape Agent Trajectories
A coding agent's harness, the software that mediates the agent's interaction with the world, determines how much of a model's capability translates into delivered engineering work. As models have grown more capable, Claude Code's harness has evolved alongside them. This talk is a retrospective on Claude Code's public releases since the start of the year, detailing the design considerations behind each and the aggregate patterns they reveal. We frame each agent session as a trajectory: a search through the user's environment that accumulates knowledge and enacts changes within it. Through that lens, the year's launches sort into two moves: letting trajectories run further per unit of human attention (auto mode, routines, remote control, worktrees), and managing what each trajectory is conditioned on (memory, multi-agent code review). Meanwhile, increased model capability strengthens the trajectories themselves. We conclude by examining how to orient these trajectories toward desired outcomes. Once step-by-step correctness is no longer the constraint, the binding problems become reconciliation—merging many independently correct trajectories into one repository—and validation—making it cheap for humans to review and revise intent for agents that are competent but not clairvoyant. Both can be software engineering problems, and we offer them to this audience as open questions.
Bio: Dickson Tsai is a Member of Technical Staff at Anthropic, where he has worked on Claude Code since shortly after its launch. He pioneered hooks and built the foundations for skills support—Claude Code's core extensibility primitives. Before Claude Code, he worked on pre-training data research at Anthropic and spent six years as a growth engineer on Google Search. He is currently interested in the right extension points for developer teams to run richer coding agent trajectories.
Dates
Tracks
You're viewing the program in a time zone which is different from your device's time zone change time zone

Sun 5 Jul

Displayed time zone: Eastern Time (US & Canada) change

15:30 - 16:00
Coffee BreakFSE Catering
15:30
30m
Coffee break
Break
FSE Catering

17:00 - 20:00
AIware ReceptionBenchmark & Dataset Track / Keynotes / ArXiv Track / Main Track at Concordia - MB-9 EFG

Join us for the AIware 2026 Welcome Reception to kick off the conference!

Food and drinks will be provided.

Mon 6 Jul

Displayed time zone: Eastern Time (US & Canada) change

08:30 - 08:50
OpeningMain Track at MB 1.210
Chair(s): Tse-Hsun (Peter) Chen Concordia University, Chao Peng Tencent, Baishakhi Ray Columbia University
08:50 - 10:30
Coding Agents, Software Testing, and Code UnderstandingArXiv Track / Main Track at MB 1.210
Chair(s): Song Wang York University
08:50
5m
Talk
Collaborator or Assistant? How AI Coding Agents Partition Work across Pull Request Lifecycles
Main Track
Young Jo Chung , Safwat Hassan University of Toronto
DOI
08:55
5m
Talk
When Code Authors Are Agents: A Large-Scale Study of Human–Agent Collaboration in Pull Requests
Main Track
Anthonia Oluchukwu Njoku École Polytechnique de Montréal, Université de Montréal, CA, Zohreh Sharafi Polytechnique Montréal, Foutse Khomh Polytechnique Montréal
DOI
09:00
5m
Talk
Understanding Conversational Patterns in Multi-agent Programming: A Case Study on Fibonacci Game Development
Main Track
Srijita Basu Chalmers University of Technology and University of Gothenburg, Viktor Kjellberg Göteborg University, SE, Simin Sun , Bengt Haraldsson Chalmers University of Technology and University of Gothenburg, Scania CV AB, Md Abu Ahammed Babu Volvo Cars AB, Wilhelm Meding Ericsson, Farnaz Fotrousi Chalmers University of Technology and University of Gothenburg, Miroslaw Staron Chalmers University of Technology and University of Gothenburg
DOI File Attached
09:05
5m
Talk
Wink: Recovering from Misbehaviors in Coding Agents
Main Track
Rahul Nanda Facebook, US, Chandra Maddila Meta Platforms, Inc., Smriti Jha Facebook, US, Euna Mehnaz Khan , Satish Chandra Meta Platforms, Inc., Matteo Paltenghi University of Stuttgart
DOI
09:10
5m
Talk
Configuring Agentic AI Coding Tools: An Exploratory Study
Main Track
Matthias Galster University of Canterbury, Seyedmoein Mohsenimofidi Heidelberg University, Jai Lal Lulla Singapore Management University, Muhammad Auwal Abubakar Otto-Friedrich Universität Bamberg, DE, Christoph Treude Singapore Management University, Sebastian Baltes Heidelberg University
DOI Pre-print
09:15
5m
Talk
Deterministic vs. LLM-Controlled Orchestration for COBOL-to-Python ModernizationAIware Honorable Mention Paper Award
Main Track
Naing Oo Lwin Bucknell University, US, Rajesh Kumar Bucknell University, US
DOI
09:20
5m
Talk
Developer Experience with AI Coding Agents: HTTP Behavioral Signatures in Documentation Portals
ArXiv Track
Oleksii Borysenko Cisco DevNet
09:25
5m
Talk
VISOR: A Vision-Language Model-Based Test Oracle for Testing Robots
Main Track
Prasun Saurabh Simula Research Laboratory, NO, Pablo Valle Mondragon University, Aitor Arrieta Mondragon University, Shaukat Ali Simula Research Laboratory and Oslo Metropolitan University, Paolo Arcaini National Institute of Informatics
DOI
09:30
5m
Talk
Fixpad++: Automated Bug Fix Verification using LLM AgentsAIware Honorable Mention Paper Award
Main Track
Mustafa Özkan İr Bilkent University, Bilkent University, TR, Mehmet Dedeler Bilkent University, Anil Koyuncu Bilkent University, Eray Tüzün Bilkent University
DOI
09:35
5m
Talk
Co-located Tests, Better AI Code: How Test Syntax Structure Affects Foundation Model Code Generation
Main Track
Éric Jacopin Cosmic AI, FR
DOI
09:40
5m
Talk
Using Mutation-Analysis to Examine an LLM’s Ability to Summarize Code
Main Track
Lara Khatib University of Waterloo, Michael Pu University of Waterloo, Bogdan Vasilescu Carnegie Mellon University, Mei Nagappan University of Waterloo
DOI
09:45
5m
Talk
Testing AIware Systems: A Software Engineering SurveyAIware Honorable Mention Paper Award
Main Track
Karla Gonzalez Royal Military College of Canada, Mariam El Mezouar Royal Military College
DOI
09:50
5m
Talk
TestMap: Evidence Infrastructure for Foundation-Model-Assisted Test Generation
ArXiv Track
Hunter Leary Virginia Tech, Luke Hanuska Virginia Tech, Chris Brown Virginia Tech
09:55
5m
Talk
Metamorphic Testing for Clinical ML Models: A Framework Proposal and Pilot Study
ArXiv Track
Jie JW Wu Michigan Technological University, USA, Feiyu E Michigan Technological University, USA, Bo Chen Michigan Technological University, USA
10:00
5m
Talk
An Empirical Study of Reasoning Steps in Thinking Code LLMsAIware Honorable Mention Paper Award
Main Track
Haoran Xue York University, CA, Gias Uddin York University, Canada, Song Wang York University
DOI
10:05
5m
Talk
Can LLMs Really Reason about Code? Studying How Well LLMs Understand the Relation between Input, Code, and Output
Main Track
Norman Becker CISPA Helmholtz Center for Information Security, DE, Tural Mammadov CISPA Helmholtz Center for Information Security, Andreas Zeller CISPA Helmholtz Center for Information Security
Link to publication DOI File Attached
10:10
5m
Talk
How Robustly Do LLMs Understand Execution Semantics?
Main Track
Claudio Spiess University of California, Davis, Premkumar Devanbu UC Davis, Earl T. Barr University College London
DOI
10:15
5m
Talk
Program-as-Weights: A Programming Paradigm for Fuzzy Functions
ArXiv Track
Wentao Zhang University of Waterloo, Liliana Hotsko University of Waterloo, Woojeong Kim Cornell University, Pengyu Nie University of Waterloo, Stuart Shieber Harvard University, Yuntian Deng University of Waterloo
Pre-print
10:20
10m
Live Q&A
Joint Q&A
Main Track

10:30 - 11:00
Coffee BreakFSE Catering
10:30
30m
Coffee break
Break
FSE Catering

12:30 - 14:00
12:30
90m
Lunch
Lunch
FSE Catering

14:00 - 15:30
Trustworthy Code Generation, Reliability, and Engineering of AIware SystemsMain Track at MB 1.210
Chair(s): Zhijie Wang Concordia University
14:00
5m
Talk
VeriTrans: Fine-Tuned LLM-Assisted NL→PL Translation via a Deterministic Neuro-symbolic Pipeline
Main Track
Xuan Liu , Dheeraj Kodakandla Pennsylvania State University, US, Kushagra Srivastva Pennsylvania State University, US, Mahfuza Farooque Pennsylvania State University, US
DOI
14:05
5m
Talk
Kubernetes Misconfigurations in the Wild: Taxonomy, Evolution, and Automated Repair with Large Language Models
Main Track
GHORAB Mostafa Anouar Université Laval, CA, Ahmad Abdellatif University of Calgary, Mohamed Aymen saied Laval University
DOI
14:10
5m
Talk
Quality and Security Signals in AI-Generated Python Refactoring Pull RequestsAIware Honorable Mention Paper Award
Main Track
Mohamed Almukhtar University of Michigan-Flint, Anwar Ghammam University of Michigan - Dearborn, Hua Ming
DOI
14:15
5m
Talk
From Assistance to Agency: Rethinking Autonomy and Control in CI/CD Pipelines
Main Track
Marcus Barnes University of Toronto, Taher A. Ghaleb Trent University, Safwat Hassan University of Toronto
DOI Pre-print
14:20
5m
Talk
Beyond Translation Accuracy: Addressing False Failures in LLM-Based Code Translation
Main Track
Fazle Rabbi Concordia University, Soumit Kanti Saha Concordia University, CA, Jinqiu Yang Concordia University
DOI
14:25
5m
Talk
Executable but Unlearnable: Designing Code That Resists LLM-Based Learning
Main Track
Viraaji Mothukuri Kennesaw State University, Reza M. Parizi Kennesaw State University
DOI
14:30
5m
Talk
Detecting Unsoundness in Neural Network Verifiers via Concrete–Abstract Consistency
Main Track
Kaijie Liu University of New South Wales, Sydney, Yulei Sui University of New South Wales
DOI Pre-print
14:35
5m
Talk
From Correctness to Consistency: Redefining Reliability for the Agentware Era
Main Track
Xue Qin Villanova University, Mauricio Gouvea Gruppi
DOI
14:40
5m
Talk
A Preliminary Study on Explaining Risk of Code Changes using LLM-Based Prediction Models
Main Track
Yalin Liu Facebook, US, Kosay Jabre Meta Platforms, Inc., Rui Abreu Meta, Zachariah J Carmichael Facebook, US, Vijayaraghavan Murali Rice University, Akshay Patel Meta Platforms, Inc., Jun Ge Meta Platforms, Inc., Weiyan Sun Meta Platforms, Inc., Cong Zhang Southern Methodist University, Southern Methodist University, US, Audris Mockus The University of Tennessee, Knoxville / Vilnius University, David Khavari , Peter Rigby Concordia University; Meta, Nachiappan Nagappan Meta Platforms, Inc.
DOI
14:45
5m
Talk
When AI Coding Assistants Leak Training Data: A Study of LLM Memorization in Code GenerationAIware Honorable Mention Paper Award
Main Track
Xiaoyu Cheng , Kundi Yao Ontario Tech University, Pengyu Nie University of Waterloo, Weiyi Shang University of Waterloo
DOI
14:50
5m
Talk
Zombie Agents: Detecting Semantic Livelock in Long-Horizon Autonomous Software
Main Track
DOI
14:55
5m
Talk
Neural-Symbolic Multi-objective Optimization for Performance-Aware ORM Database Design
Main Track
Sasan Azizian Bellevue University, Ayoub Hazrati The Vanguard Group, Artin Azizian McGill University, School of Computer Science, Elham Rastegari Creighton University, Hamid Bagheri University of Nebraska-Lincoln, Juan Cui University of Nebraska, Lincoln, US
DOI
15:00
5m
Talk
TriORM: Workload-Aware Neural-Symbolic Multi-objective Optimization for ORM Mapping Design
Main Track
Sasan Azizian Bellevue University, Ayoub Hazrati The Vanguard Group, Artin Azizian McGill University, School of Computer Science, Elham Rastegari Creighton University
DOI
15:05
5m
Talk
Artifact Readiness Gates with Saturation Stop Rules and Host-Parity Admissibility for FM Release Evaluation
Main Track
Yanick Kanyiki InvarLock Inc., CA
DOI
15:10
5m
Talk
Towards Migrating Neural Network ImplementationsAIware Honorable Mention Paper Award
Main Track
Nadia Daoudi Luxembourg Institute of Science and Technology, Iván Alfonso Luxembourg Institute of Science and Technology, Jordi Cabot Luxembourg Institute of Science and Technology
DOI
15:15
5m
Talk
From Code Review to Spec-Driven Contracts: A Vision for Auditable AIWare Systems
Main Track
Mohammad Hamdaqa Polytechnique Montreal, Moataz Chouchen Concordia University
DOI
15:20
10m
Live Q&A
Joint Q&A
Main Track

15:30 - 16:00
Coffee BreakFSE Catering
15:30
30m
Coffee break
Break
FSE Catering

16:00 - 17:00
Poster Session AMain Track at MB 1.210
17:00 - 17:45
Brainstorming Panel 1: Model Capability and the Future of Agent HarnessesMain Track at MB 1.210
Chair(s): Hao Li Queen's University

We are honored to host the following experts for an in-depth discussion and exchange of ideas:

  • Dickson Tsai, (Claude Code)
  • Pascal Kesseli, (Microsoft)
  • Tse-Hsun (Peter) Chen, (Concordia University)
  • Chao Peng, (Tencent)
18:30 - 22:00
AIware BanquetBenchmark & Dataset Track / Keynotes / ArXiv Track / Main Track at FUNHUB Montreal

Welcome to the AIware 2026 Banquet! Join us for a memorable evening of networking, great food, and entertainment to celebrate the conference.

FUNHUB Montreal is approximately a 15-minute walk from the conference venue.

Address: FUNHUB Montreal, 733 Rue Cathcart #2, Montréal, QC H3B 1M6

Banquet Event Schedule (Monday, July 6, 2026):

  • 6:30 PM – Departure from the conference venue
  • 7:00 PM – Banquet begins and meal service starts

Tue 7 Jul

Displayed time zone: Eastern Time (US & Canada) change

08:30 - 10:30
Day 1 OpeningFSE Plenary Events at H110
08:30
30m
Day opening
Welcome
FSE Plenary Events
Foutse Khomh Polytechnique Montréal, Shin Hwei Tan Concordia University
09:00
40m
Keynote
Keynote 1: Benoit Baudry - Punking Up Dependency Hell
FSE Plenary Events
K: Benoit Baudry Université de Montréal
10:30 - 11:00
Coffee BreakFSE Catering
10:30
30m
Coffee break
Break
FSE Catering

11:00 - 12:00
AIware Keynotes Session 2Keynotes / Main Track at MB 1.210
Chair(s): Baishakhi Ray Columbia University
11:00
20m
Keynote
Formal Methods for Reliable AI Reasoning
Keynotes
K: Pascal Kesseli Microsoft
11:20
20m
Keynote
Spec-Driven Development for Autonomous Coding Agents Across the SDLC
Keynotes
K: Rajdeep Mukherjee Amazon, USA
11:40
20m
Live Q&A
Joint Q&A
Keynotes

12:00 - 12:30
Benchmarks, Datasets, and Evaluation of AIware Benchmark & Dataset Track / ArXiv Track / Main Track at MB 1.210
Chair(s): Mohammad Hamdaqa Polytechnique Montreal
12:00
5m
Talk
ClassEval-Pro: A Cross-Domain Benchmark for Class-Level Code Generation
Benchmark & Dataset Track
Yeheng Chen Shanghai Jiao Tong University, Chaoxiang Xie Hohai University, Yuling Shi Shanghai Jiao Tong University, Wenhao Zeng Shanghai Jiao Tong University, Yongpan Wang Shanghai Jiaotong University, CN, Hongyu Zhang Chongqing University, Xiaodong Gu Shanghai Jiao Tong University
DOI
12:05
5m
Talk
SWE-Bench+: Enhanced LLM Coding Benchmark
Benchmark & Dataset Track
Haoran Xue York University, CA, Reem Aleithan York University, Canada, Nafid Enan York University, CA, Gias Uddin York University, Canada, Song Wang York University
DOI
12:10
5m
Talk
Do Agents Dream of Root Shells? Partial-Credit Evaluation of LLM Agents in Capture the Flag Challenges
Benchmark & Dataset Track
Ali Al-Kaswan Delft University of Technology, Netherlands, Maksim Plotnikov Delft University of Technology, NL, Maxim Hájek Delft University of Technology, NL, Roland Vízner Delft University of Technology, NL, Arie van Deursen TU Delft, Mali Izadi Google & TU Delft
DOI
12:15
5m
Talk
A Dataset of Agentic AI Coding Tool Configurations
Benchmark & Dataset Track
Matthias Galster University of Canterbury, Seyedmoein Mohsenimofidi Heidelberg University, Levi Böhme Universität Bayreuth, DE, Jai Lal Lulla Singapore Management University, Muhammad Auwal Abubakar Otto-Friedrich Universität Bamberg, DE, Christoph Treude Singapore Management University, Sebastian Baltes Heidelberg University
DOI
12:20
5m
Talk
AgenticFlict: A Large-Scale Dataset of Merge Conflicts in AI Coding Agent Pull Requests on GitHub
Benchmark & Dataset Track
Daniel Ogenrwot University of Nevada Las Vegas, John Businge University of Nevada, Las Vegas
DOI Pre-print
12:25
5m
Talk
TestEvo-Bench: An Executable and Live Benchmark for Test and Code Co-Evolution
ArXiv Track
Jiale Amber Wang University of Waterloo, Kaiyuan Wang Google, Inc., Pengyu Nie University of Waterloo
Pre-print
12:30 - 14:00
12:30
90m
Lunch
Lunch
FSE Catering

12:30 - 14:00
FSE Steering Committee (SC) meetingFSE Catering at MB 2.210
12:30 - 14:00
TSE Editorial Board MeetingFSE Catering at MB 3.210
14:00 - 15:30
Human Factors, Responsible AIware, and Benchmarks & DatasetsBenchmark & Dataset Track / Main Track at MB 1.210
Chair(s): Diego Elias Costa Concordia University, Canada
14:00
5m
Talk
Is Artificial Intelligence an Elixir to the Software Engineering Community? An Empirical Study among ManagersACM SIGSOFT Distinguished Paper Award
Main Track
Xin Zhao Seattle University, Brian Vu Seattle University, US, Sitesh Pattanaik Donald Bren School of Information and Computer Sciences, University of California, Irvine, US
DOI
14:05
5m
Talk
Towards AI as a Collaborative Partner: A Taxonomy of AI Agent Behavior in Software Engineering
Main Track
Tao Dong Google, Sherry Shi Google, Harini Sampath , Andrew Macvean Google, Inc.
DOI Pre-print
14:10
5m
Talk
Auditing Who Appears to Belong: A Large-Scale Empirical Study of Bias in Deployed Text-to-Image Systems for Software Engineering
Main Track
Mohamad Kassab Boston University
DOI
14:15
5m
Talk
Operationalizing Ethics for AI Agents: How Developers Encode Values into Repository Context Files
Main Track
Christoph Treude Singapore Management University, Sebastian Baltes Heidelberg University, Marc Cheong the University of Melbourne
DOI Pre-print
14:20
5m
Talk
Accountable Agents in Software Engineering: An Analysis of Terms of Service and a Research Roadmap
Main Track
Christoph Treude Singapore Management University
DOI Pre-print
14:25
5m
Talk
SOSecure: The Wisdom of the Crowd for Safer AI-Generated Code
Main Track
Manisha Mukherjee Carnegie Mellon University, Vincent J. Hellendoorn Google DeepMind
DOI
14:30
5m
Talk
SecVulEval: Context-Aware Benchmarking of LLMs for Vulnerability DetectionAIware Best Benchmark/Dataset Paper Award
Benchmark & Dataset Track
Md Basim Uddin Ahmed York University, CA, Nima Shiri Harzevili York University, Jiho Shin York University, Hung Viet Pham York University, Song Wang York University
DOI
14:35
5m
Talk
SecMutBench: Evaluating LLM-Generated Security Tests via Mutation-Based Vulnerability Detection
Benchmark & Dataset Track
Mariam ALMutairi Virginia Polytechnic Institute and State University, US
DOI
14:40
5m
Talk
CrossCommitVuln-Bench: A Dataset of Multi-commit Python Vulnerabilities Invisible to Per-Commit Static Analysis
Benchmark & Dataset Track
Arunabh Majumdar Independent Researcher, IN
DOI
14:45
5m
Talk
REBench: A Procedural, Fair-by-Construction Benchmark for LLMs on Stripped-Binary Types and Names
Benchmark & Dataset Track
Jun Yeon Won Ohio State University, Columbus, US, Xin Jin Meta, Shiqing Ma University of Massachusetts at Amherst, Zhiqiang Lin The Ohio State University
DOI
14:50
5m
Talk
RustBuildEq: A Benchmark for Binary Equivalence under Build Variability
Benchmark & Dataset Track
Elliott Wen The University of Auckland, Chenye Ni , Valerio Terragni University of Auckland, Jens Dietrich Victoria University of Wellington
DOI
14:55
5m
Talk
TOGBench: A Developer-Written Multi-variant Dataset and Benchmark Suite for Test Oracle Generation
Benchmark & Dataset Track
Tasfia Tasnim University of Texas at Dallas, US, Matthew B Dwyer University of Virginia, Soneya Binta Hossain University of Texas at Dallas
DOI
15:00
5m
Talk
HEJ-Robust: A Robustness Benchmark for LLM-Based Automated Program Repair
Benchmark & Dataset Track
Fazle Rabbi Concordia University, Jinqiu Yang Concordia University
DOI
15:05
5m
Paper
JunoBench: A Benchmark Dataset of Crashes in Python Machine Learning Jupyter Notebooks
Benchmark & Dataset Track
Yiran Wang Linköping University, José Antonio Hernández López Department of Computer Science and Systems, University of Murcia, Ulf Nilsson Linköping University, Daniel Varro Linköping University / McGill University
DOI Pre-print
15:10
5m
Talk
AgentTelemetry: A Fault Detection Benchmark and Toolkit for LLM Agent Observability
Benchmark & Dataset Track
DOI
15:15
15m
Live Q&A
Joint Q&A
Benchmark & Dataset Track

15:30 - 16:00
Coffee BreakFSE Catering
16:00 - 16:45
Poster Session BMain Track at MB 1.210
16:45 - 17:45
Brainstorming Panel 2: Software Engineering Beyond Code GenerationMain Track at MB 1.210
Chair(s): Weiyi Shang University of Waterloo

We are honored to host the following experts for an in-depth discussion and exchange of ideas:

  • Lin Tan (Purdue University and Amazon)
  • Thomas Cottenier (Arm)
  • Rajdeep Mukherjee (Amazon)
  • Baishakhi Ray (Columbia University)
  • Yintong Huo (Singapore Management University)
17:45 - 18:00
Awards & ClosingMain Track at MB 1.210
Chair(s): Tse-Hsun (Peter) Chen Concordia University, Chao Peng Tencent, Baishakhi Ray Columbia University