Challenge: Holistic Evaluation of Generative Foundation Models in a Security Context by Agentur für Innovation in der Cybersicherheit
Holistic Evaluation of Generative Foundation Models in a Security Context (HEGEMON)
Agentur für Innovation in der Cybersicherheit GmbH
About
The Agentur für Innovation in der Cybersicherheit GmbH (Agency for Innovation in Cybersecurity), a German federal entity focused on advancing defense-related research and innovation, is launching a Pre-Commercial Procurement under the HEGEMON initiative. The process follows a multi-phase negotiation procedure designed to foster innovation through competitive R&D challenges.
The Challenge
The core challenge of the HEGEMON procurement centers on the development of robust, holistic evaluation methodologies for generative foundation models (GFMs) within security-relevant contexts. Unlike traditional AI models, GFMs produce complex outputs—such as text, image, or audio—based on free-form user prompts, requiring qualitative, multi-dimensional evaluation frameworks. The solution sought must address critical issues like factual hallucination, susceptibility to prompt injection attacks, biases embedded in training data, and the high computational costs of inference. Given the growing importance of these models in defense and cybersecurity, the challenge calls for innovative, context-sensitive evaluation strategies tailored to German-language settings and specific security-domain applications.
Timeframe
Deadline for receipt of requests to participate: 31/07/2025 10:00:00 (UTC+2) Eastern European Time, Central European Summer Time
Who can apply
The tender is open to small and medium-sized enterprises (SMEs), as well as other entities, as specified in the procedure's descriptive document. To access the relevant procurement documents, please refer to this page: 📄 Tender documents.
How to apply
You can find all the details of the procedure here: 358520‑2025 – Holistic Evaluation of Generative Foundation Models in a Security Context (HEGEMON). Please note that tenders or requests to participate must be submitted in German.
The SPIN4EIC consortium is not responsible for the challenges launched by private or public buyers. Each participating entity is solely responsible for its own challenge, including the selection process, communication with applicants, and all information provided to participants.