ASSIST

ASSIST beinhaltet die Entwicklung eines chirurgisch kontrollierten, autonomen Manipulators für die Assistenz bei chirurgischen Operationen, der das Aufspannen und Präsentieren von Gewebe und Organen übernimmt. Das Projekt verbindet im höchsten Maße innovative Ansätze der maschinellen Intelligenz und Navigation mit chirurgischen Prinzipien und besetzt eine Nische im Grenzgebiet zwischen wissenschaftlicher Innovation und ethisch-rechtlich vertretbarer Autonomie.

AVATAR

Coming soon…

FAIRPLAN

Ziel des Projektes FAIRPLAN ist es, Schicht- und OP-Pläne im Krankenhaus KI-basiert zu generieren, die Personalplanung durch eine multidimensionale Betrachtung fairer und effizienter zu gestalten, Mitarbeiterwünsche in der Planung flexibel zu berücksichtigen und Ressourcen effizienter auszulasten.

2026

• Wagner, L., Bernhard, L., Geiger, A., Schneider, D., Knoll, A., and Wilhelm, D. “Modeling surgeon-specific instrument usage profiles to improve instrument anticipation”. In: Proceedings on Automation in Medical Engineering (AUTOMED). Vol. 3. 1. 18th Interdisciplinary AUTOMED Symposium in Collaboration with the TC Medical Robotics. Infinite Science Publishing, 2026, p. 2482. https://doi.org/10.18416/AUTOMED.2026.2482
   
• Schneider D., Wagner, L., Rueckert, D., Wilhelm. “Attachment Anchors: A Novel Framework for Laparoscopic Grasping Point Prediction in Colorectal Surgery”.  In: arXiv preprint (2026), https://doi.org/10.48550/arXiv.2602.17310

2025

• Geiger, A., Wagner, L., Rueckert, D., Wilhelm, D., and Jell, A. “A deep learning-based approach to enhance accuracy and feasibility of long-term high-resolution manometry examinations”. In: Communications Medicine 5.1 (Dec. 2, 2025), p. 513. https://doi.org/10.1038/s43856-025-01255-1 
   
• Geiger, A., Wagner, L., Rueckert, D., Wilhelm, D., and Jell, A. “On the notion of missingness for path attribution explainability methods in medical settings: Guiding the selection of medically meaningful baselines”. In: arXiv preprint (2025), https://doi.org/10.48550/arXiv.2508.14482
   
• Stabenow, S., Wagner, L., Knoll, A., Bengler, K., and Wilhelm, D. “Action recognition in medical environments for robotic assistance”. In: International Journal of Computer Assisted Radiology and Surgery (2025), https://doi.org/10.1007/s11548-025-03551-6
   
• Jurosch, F., Zeller, J., Wagner, L., Özsoy, E., Jell, A., Kolb, S., and Wilhelm, D. “Video-based multi-target multi-camera tracking for postoperative phase recognition”. In: International Journal of Computer Assisted Radiology and Surgery (2025), https://doi.org/10.1007/s11548-025-03344-x

2024

• Scheppach, C., Wagner, L., Spinner, C., Jell, A., and Wilhelm, D. “Innovating Instrument Handover Techniques for Robotic Scrub Nurses”. In: Current Directions in Biomedical Engineering 10.2 (2024), pp. 5–9. https://doi.org/10.1515/cdbme-2024-1052
   
• Wagner, L., Jourdan, S., Mayer, L., Müller, C., Bernhard, L., Kolb, S., Harb, F., Jell, A., Berlet, M., Feussner, H., et al. “Robotic scrub nurse to anticipate surgical instruments based on real-time laparoscopic video analysis”. In: Communications Medicine 4.1 (Aug. 2, 2024), p. 156. https://doi.org/10.1038/s43856-024-00581-0
   
• Jurosch, F., Wagner, L., Jell, A., Islertas, E., Wilhelm, D., Berlet, Max. "Extra-abdominal trocar and instrument detection for enhanced surgical workflow understanding". In: International Journal of Computer Assisted Radiology and Surgery (2024), https://doi.org/10.1007/s11548-024-03220-0
   
• Wagner, L., Schneider, D. N., Mayer, L., Jell, A., Müller, C., Lenz, A., Knoll, A., and Wilhelm, D. "Towards multimodal graph neural networks for surgical instrument anticipation". In: International Journal of Computer Assisted Radiology and Surgery (2024), https://doi.org/10.1007/s11548-024-03226-8
   
• Berlet, M., Jell, A., Wagner, L., Bernhard, L., Fuchtmann, J., Wegener, L., Feussner, H., Friess, H., and Wilhelm, D. “Model-based individual life-spanning documentation in visceral surgery: a proof of concept”. In: International Journal of Computer Assisted Radiology and Surgery (2024), https://doi.org/10.1007/s11548-024-03214-y
   
• Fuchtmann, J., Riedel, T., Berlet, M., Jell, A., Wegener, L., Wagner, L., Graf, S., Wilhelm, D., and Ostler-Mildner, D. “Audio-based event detection in the operating room”. In: International Journal of Computer Assisted Radiology and Surgery (2024), https://doi.org/10.1007/s11548-024-03211-1

2023

• Wagner, L., Kolb, S., Leuchtenberger, P., Bernhard, L., Jell, A., and Wilhelm, D. “Deep learning assisted intraoperative instrument cleaning station for robotic scrub nurse systems”. In: at-Automatisierungstechnik 71.7 (2023), pp. 572–579. https://doi.org/10.1515/auto-2023-0062
   
• Wagner, L., Kolb, S., Looschen, C., Bernhard, L., Fuchtmann, J., Berlet, M., Fottner, J., Knoll, A., and Wilhelm, D. “Versatile end effector for laparoscopic robotic scrub nurse”. In: International Journal of Computer Assisted Radiology and Surgery 18.9 (2023), pp. 1589–1600. https://doi.org/10.1007/s11548-023-02892-4

2022

• Wagner, L., Bernhard, L., Fuchtmann, J., Asim Karaoglu, M., Ladikos, A., Feußner, H., and Wilhelm, D. “Integrating 3D cameras into sterile surgical environments: A comparison of different protective materials regarding scan accuracy: Development of a sterile camera enclosure for the detection of laparoscopic instruments”. In: Current Directions in Biomedical Engineering 8.1 (2022), pp. 25–29. https://doi.org/10.1515/cdbme-2022-0007

2026

• Master thesis: Data-Driven Prediction of Surgery Times from Clinical and Operational Features (ongoing)
• Master thesis: Adaptive Surgery Time Prediction Using Preoperative Data and Intraoperative Imaging (ongoing)

2025

• Masterarbeit: A Non-Invasive Approach to Visualize Esophageal Motility (went on to: Mag-Instruments UG)
• Masterarbeit: Development of a User Interface for Telemedical Robotic Applications (went on to: EnBW)
• Bachelorarbeit: Evaluation of the Surgical Scheduling Process: A Case Study of the Department of Surgery at the TUM University Hospital

2024

• Masterarbeit: Development of a Robotic End Effector for Decompression of Tension Pneumothorax (went on to: piur imaging GmbH)
• Masterarbeit: Visualization and Explainability of Deep Learning Based Swallow Event Detection and Classification Results (went on to: SAP)
• Masterarbeit: Postoperative Video-based Patient Tracking Using Deep Learning
• Semesterarbeit: Entwicklung eines sterilen Endeffektors für das Manipulieren laparoskopischer Instrumente

2023

• Masterarbeit: Spatio-Temporal Graph Neural Networks for Multimodal Surgical Workflow Understanding (went on to: Research Group CAMMA)
• Masterarbeit: Extra-abdominal trocar and instrument detection for enhanced surgical workflow recognition (went on to: Floy)
• Semesterarbeit: Hygienekonzept für einen robotischen OP-Assistenzroboter

2022

• Masterarbeit: Entwicklung eines universellen sterilen Endeffektors für die Manipulation von chirurgischen Instrumenten (went on to: TUM)
• Masterarbeit: Entwicklung einer intelligenten Übergabestrategie für das robotische Anreichen chirurgischer Instrumente (went on to: ottobock)
• Masterarbeit: Machine learning for prediction of laparoscopic instrument changes integrating surgical knowledge (went on to: DKFZ Heidelberg)
• Bachelorarbeit: Entwicklung einer smarten intraoperativen Reinigungsstation für laparoskopische Instrumente