BEGIN:VCALENDAR
VERSION:2.0
PRODID:https://github.com/derhansen/sf_event_mgt
METHOD:PUBLISH
BEGIN:VEVENT
UID:7129-1413@rg-rhein-neckar.gi.de
CLASS: PUBLIC
SUMMARY:How do you test an AI application?
DESCRIPTION:INVITATION\n\n\n\nThis is a role model talk for women, but ever
 ybody is invited to join. We particularly encourage students to attend.\n\n
 \n\nHow do you test an AI application?\n\n\n\nDr. Anja Kleebaum \n\nAgile S
 oftware Engineer at andrena objects ag\n\n\n\nSoftware with AI can assist p
 eople with tasks that previously required a great deal of effort (e.g., ext
 racting information from images or answering questions about all kinds of i
 nternal company matters). But how can you automatically test that the AI ap
 plication really does what it is supposed to do? In this presentation, I wi
 ll report on my experiences with the use of AI in industry and outline appr
 oaches for evaluating AI applications. The following questions will be addr
 essed:\n\n 	How do you build an evaluation dataset (self-created vs. synthe
 tic data)? 	How do you assess whether a returned answer matches the expecte
 d answer (regular expressions vs. LLM-as-a-judge)? 	What metrics can be col
 lected (e.g., for retrieval and generation)? 	What platforms are available 
 (e.g., Langfuse, LangSmith, or a custom solution)? 	How can user feedback b
 e collected and used to improve the AI application? \n\nAnja received her P
 hD from the Chair of Software Engineering at Heidelberg University and work
 ed as a research assistant in software engineering education. In her disser
 tation, she designed methods and tools for lightweight decision management 
 (rational management) during agile software development. Since 2023, she ha
 s been working as an agile software engineer at andrena objects and on vari
 ous AI projects.\n\n\n\n\n\nTuesday, 27 MAY 2025, 7.15 pm-8.15pm           
                             \n\nSeminarraum A, Mathematikon, EG\n\nIm Neuen
 heimer Feld 205, 69120 Heidelberg\n\nhttps://fg-frauen-informatik.gi.de/fac
 hgruppe/regionales/ak-rhein-neckar
DTSTAMP:20250513T082932Z
DTSTART:20250527T172500Z
DTEND:20250527T182500Z
END:VEVENT
END:VCALENDAR