KDD 2025 Tutorial on Production-ready Trustworthy FMware
Foundation Models (FMs) such as Large Language Models (LLMs) are reshaping the software industry by enabling FMware, systems that integrate these FMs as core components. This tutorial seeks to provide a comprehensive exploration of FMware that combines a curated catalogue of challenges with real-world production concerns. Attendees will gain practical strategies to enable the creation of trustworthy FMware in the evolving technology landscape. The tutorial will cover a multitude of topics such as:
- Overview of state of research and practice in building FMware.
- Difficulties in selecting suitable models, aligning high-quality domain-specific data, engineering robust prompts, and orchestrating autonomous agents.
- Insights into the complex journey of going from impressive demos to production-ready systems.
- Dicussion of issues in system testing, optimization, deployment, and integration with legacy software.
We welcome researchers, practitioners, and students interested in all aspects of developing FMware to join us and engage in this tutorial.
Program
(Monday, Aug. 4, 8:00 AM - 11:00 AM UTC-4, New York Time)
Our tutorial will be held on Monday, August 4 at 8:00 AM - 11:00 AM (EST/UTC-4 Toronto/New York time), room to be announced, in conjunction with KDD 2025. You are welcome to join our tutorial either in-person or virtually via Zoom.
Virtual Link: (Zoom link coming soon)
Check out our survey paper on arXiv: Vasilevski, K., Rombaut, B., Rajbahadur, G. K., Oliva, G. A., Gallaba, K., Cogo, F. R., Lin, J., Lin, D., Zhang, H., Chen, B., Thangarajah, K., Hassan, A. E., & Jiang, Z. M.. The Hitchhikers Guide to Production‑ready Trustworthy Foundation Model powered Software (FMware). ACM KDD 2025.
The program schedule is as follows (topics order still to be finalized):
| Time | Event | Speaker | Materials |
|---|---|---|---|
| 8:05 AM - 8:45 AM | Introduction to FMware and Current State of Practice | TBD | slides (to be provided later) |
| 8:45 AM - 9:00 AM | Coffee Break | ||
| 9:00 AM - 9:45 AM | FM in FMware: Design and Engineering Challenges | TBD | slides (to be provided later) |
| 9:45 AM - 10:00 AM | Break & Question Period | ||
| 10:00 AM - 10:45 PM | Going From Demos to Production: Challenges and Insights | TBD | slides (to be provided later) |
| 10:45 PM - 11:00 AM | Question Period & Networking |
Tutorial Speakers
Contact
Please contact Kirill Vasilevski for general inquiries.
Website template graciously borrowed from KDD 2024 Tutorial on Multimodal Pretraining, Adaptation, and Generation for Recommendation