Master's Thesis Expert-in-the-Loop AgentOps/LLMOps Pipeline for Systems Engineering Process Agents

Master's Thesis: Expert-in-the-Loop AgentOps/LLMOps Pipeline for Systems Engineering Process Agents

Location: Aachen, FEV GmbH

Employment Type: Full-time, Permanent Qualification Level: University Activities

About FEV.io GmbH

FEV.io GmbH is a dynamic division of FEV, dedicated to developing the future of mobility. We aim to redefine technological boundaries and create intelligent mobility solutions for everyone, making vehicles safer, greener, and more connected. We utilize cutting-edge software and agile engineering systems, serving both automotive startups and established OEMs. Our mission is driven by innovation and a team of bright software minds, supported by the extensive expertise of our parent company, FEV, with 6,100 employees.

Your Role

This Master's thesis focuses on developing an Expert-in-the-Loop AgentOps/LLMOps pipeline for Systems Engineering Process Agents. The pipeline will integrate domain experts into iterative feedback loops to capture corrections and context, which will then be used to selectively adapt the system. This approach optimizes both forward flow (methods/data -> agent output -> user feedback -> iteration) and backward flow (user feedback -> classification/context engineering -> selective LLM adaptation/test-update), minimizing retraining and emphasizing context engineering and selective adaptation.

Main Tasks:

• Conduct a literature and state-of-the-art review on MLOps, LLMOps, and AgentOps, focusing on engineering process agents and expert-in-the-loop systems.
• Design and implement an open-source AgentOps/LLMOps pipeline tailored for Systems Engineering (SE) use-cases.
• Empirically compare adaptation strategies (context engineering, parameter-efficient fine-tuning, hybrid) on two SE tasks:
  • Requirements derivation for subsystems.
  • Test-case derivation from requirements.
• Measure precision/recall, semantic correctness, expert corrections per iteration, and cost-benefit metrics.
• Quantify the value of expert feedback in iterative agent improvement.

Your Profile:

• Solid programming skills, preferably in Python (C++/Java experience is a plus).
• Fundamental knowledge of machine learning / AI, ideally including large language models, prompt engineering, retrieval-augmented generation (RAG), and context engineering.
• Basic understanding of software engineering concepts (APIs, data models, version control, testing) and cloud development (Azure preferred).
• Analytical skills for designing experiments, measuring performance metrics, and interpreting results.
• Ability to work independently, structure complex problems, and document results in scientific English.
• Interest in operationalizing AI agents and integrating expert feedback loops.

Nice to have:

• Experience with context engineering, RAG, or fine-tuning LLMs.
• Interest in systems engineering processes and tools.
• German language skills (>B1).

What We Offer:

• Cutting-Edge Innovation: Work with leading Automotive OEMs on next-generation software systems.
• Flexibility: Choose your work times and enjoy up to 100% remote work options for optimal work-life balance.
• Agility: Experience 2-day sprints, agile workflows, and an atmosphere of openness, trust, and innovation.
• Academic Support: Assistance to help you successfully complete your studies.
• Benefits:
  • Bridge days
  • Up to 100% remote work
  • Flexible working hours
  • FEV Academy and LinkedIn Learning access
  • Spendit Card (cashless benefits)
  • Team events and parties
  • Modern office amenities (adjustable desks, flex desk, gaming, coffee/tea)
  • Company canteen or discounts

Contact:

Alina Lara Senn Human Resources - Aachen Phone: +49 241 56892924

Professional Requirements:

APIs, C++, Cloud Engineering, Computer Programming, Data Modeling, Experimentation, Java, Cost-Benefit Analysis, Artificial Intelligence, Large Language Models, Machine Learning, Machine Learning Operations, Metrics, Microsoft Azure, Open Source, Performance Management, Prompt Engineering, Python, Semantics, Software Version Control, Software Development, Systems Engineering, Testing, User Feedback, Process Engineering

Personal Skills:

Analytical Thinking, Self-Motivation

Language Skills:

German, English

Apply Now

Employer: FEV GmbH

Address: FEV GmbH, Neuenhofstr 181, 52078 Aachen

Website: http://fev.com