Wie Sie SAP BTP AI Core nutzen

SAP BTP stellt mit SAP AI Core in mächtiges Werkzeug für Generative AI zur Verfügung. Allerdings kann die Konfiguration auf BTP eine schwer zu überwindende Hürde darstellen. In diesem Beitrag führe ich Sie Schritt für Schritt durch den gesamten Prozess. Sie lernen, wie Sie SAP AI Core und SAP AI Launchpad installieren, Ihre ersten LLM Abfragen machen und SAP AI Core API sowie SDK nutzen. Außerdem zeige ich Ihnen, wie Sie Data Privacy für Anonymisierung der Daten nutzen, die Sie an das LLM übergeben.

Übersicht

• Entitlement konfigurieren
• SAP AI Core mit Booster installieren
• SAP AI Launchpad mit Booster installieren
• SAP AI Core Key einsehen
• SAP AI Launchpad nutzen
• POST API mit Bruno nutzen
• SAP SDK nutzen
• Data Privacy für Masking installieren
• SAP AI Launchpad Orchestration zur Generation von JSON Vorlagen verwenden

Entitlement konfigurieren

Bevor Sie mit der Einrichtung von SAP AI Core und SAP AI Launchpad beginnen können, müssen Sie diese Dienste zunächst Ihrem Subaccount zuweisen. Wählen Sie Ihren globalen Account aus und selektieren Sie unter Entitlements den Eintrag Entity Assignments.Wählen Sie Ihren Subaccount aus und klicken Sie auf Edit.

Klicken Sie anschließend auf Add Service Plans.

Wählen Sie unter Solutions den Eintrag Data and Analytics aus bzw. geben Sie einfach AI im Suchfeld ein. Selektieren Sie zunächst SAP AI Core. Dies ist der grundlegende Service, der die LLMs beinhaltet. Wählen Sie die Service Pläne aus und klicken Sie auf Add Service Plans.

Wiederholen Sie die Prozedur für SAP AI Launchpad Service. Dieser Service wird als Frontend für SAP AI Core genutzt.

Speichern Sie die neu zugewiesenen Dienste.

SAP AI Core mit Booster installieren

Nun können Sie den SAP AI Core Dienst mithilfe eines Booster auf ihrem Subaccount installieren. Wählen Sie dazu im Menü den Eintrag Boosters aus. Suchen Sie nach AI und starten Sie den Set Up Account for SAP AI Core Booster.

Folgen Sie dem Prozess. Zunächst werden Ihre Berechtigungen und die benötigten Entitlements geprüft. Klicken Sie auf Next.

Nun können Sie einen neuen Subaccount anlegen oder einen existierenden nutzen. Wir wollen einen bereits vorhanden Subaccount nutzen.

Selektieren Sie nun den Plan sowie den Subaccount. Andere Einstellungen können Sie so belassen und auf Next klicken.

Überprüfen Sie nochmals die Einstellungen und klicken Sie auf Finish.

Holen Sie sich einen Kaffee und warten Sie, bis die Einrichtung abgeschlossen wurde.

Nach der erfolgreicher Einrichtung können Sie mit dem nächsten Schritt fortfahren.

SAP AI Launchpad mit Booster installieren

Die Einrichtung von SAP AI Launchpad läuft analog.

Starten Sie den Booster, der Sie durch die Einrichtungsschritte führt.

Wechseln Sie nach der erfolgreichen Einrichtung zu Ihrem Subaccount. Klicken Sie dazu auf Navigate to Subaccount in der Erfolgsmeldung.

SAP AI Core Key einsehen

Um die SAP AI Core Dienste zu nutzen, benötigen Sie den geheimen Schlüssel. Wechseln Sie dazu zu Instances and Subscriptions.

Unter Instances sehen bei Credentials den Key Eintrag. Klicken Sie darauf.

Nun werden die Zugangsdaten für SAP AI Core angezeigt. Behandeln Sie diese wie Passwörter. Sie können zwischen der JSON- und Form-Ansicht wechseln. Klicken Sie auf Download, um die Zugangsdaten herunterzuladen. Anschließend können Sie das Fenster mit Close schließen.

Sie können einen neuen Key unter Actions (…) – Create Service Key anlegen.

SAP AI Launchpad nutzen

Sie können SAP AI Launchpad als Frontend für SAP AI Core nutzen. Wählen Sie unter Subscriptions SAP AI Launchpad aus und klicken Sie auf Go to Application.

Zunächst sind keine Verbindungen vorhanden. Klicken Sie auf Add, um eine neue API Verbindung zu SAP AI Core anzulegen.

Geben Sie einen Namen für die Verbindung ein und laden Sie den Service Key aus dem vorherigen Schritt hoch. Alle für die Verbindung vom Typ Secret benötigten Daten werden automatisch ausgefüllt.

Nun wird die Verbindung zu SAP AI Core hergestellt. Sie sehen den Verbindungsnamen und die Ressourcengruppe oben. Links wird das Navigatinsmenü geladen. Unter Umständen kann es etwas dauern. Keine Panik. Prüfen Sie, ob die korrekte Ressourcengruppe ausgewählt ist.

Wenn Sie einen anderen Nutzer als Admin nutzen, vergeben Sie diesem Nutzer die notwendigen Berechtigungen. Navigieren Sie dazu zu Ihrem Subaccount – Security – Users.

Wählen Sie im Navigationsmenü links unter Generative AI Hub den Eintrag Chat aus. Selektieren Sie bei Configure das gewünschte Modell und geben Sie eine Nachricht ein. Das LLM antwortet. Gratuliere, Sie haben SAP AI Core erfolgreich eingerichtet!

POST API mit Bruno nutzen

Während SAP AI Launchpad für schnelle Tests gut geeignet ist, werden Sie in der Praxis entweder über POST API oder SAP Python SDK mit SAP AI Core kommunizieren. Zum Testen von APIs können Sie einen Client wie Postman oder Bruno verwenden. Das SAP AI Core API ist auf Business Accelerator Hub dokumentiert. Nachfolgend führe ich Sie durch die Einrichtung von Bruno.

Nachdem Sie Bruno heruntergeladen und installiert haben, legen Sie bitte eine neue Collection an.

Vergeben Sie einen Namen, definieren Sie den Speicherort und klicken Sie auf Create.

Nachdem die Collection angelegt wurde, wählen Sie diese aus und legen Sie die JavaScript Einstellungen fest.

Um sich mit SAP AI Core zu verbinden, brauchen Sie die Zugangsdaten. Diese und weitere Variablen können Sie in einer Umgebung speichern. Um eine Umgebung einzurichten, klicken Sie auf No Environment in der oberen rechten Ecke. Wählen Sie anschließend Configure aus.

Wählen Sie anschließend Ceate Environment.

Vergeben Sie einen Namen und klicken Sie auf Create.

Legen Sie die Variablen wie auf dem folgenden Bild an:

Die Werte bekommen Sie zum einen aus dem SAP AI Core Schlüssel. Die Deployment URL finden Sie indem Sie im SAP AI Launchpad zu ML Operations – Deployments navigieren und das jeweilige Deployment auswählen (später können Sie das GET {{AI_API_URL}}/v2/lm/deployments API nutzen).

Geben Sie unter RESOURCE_GROUP default ein und unter chat-model das gewünschte LLM, z. B. gpt-4o-mini (später können Sie die Liste der Models. auch über GET {{AI_API_URL}}/v2/lm/scenarios/foundation-models/models abrufen)

Tragen Sie die Werte ein und klicken Sie auf Save. Um den Token kümmern wir uns als Nächstes.

Um die LLMs nutzen zu können benötigen wir einen Token, der für 12 Stunden gültig ist. Dieser kann mithilfe der API {{AUTH_URL}}/oauth/token abgerufen werden. Also legen wir in Bruno einen neues Request an. Wählen Sie dazu Ihre Collection aus und selektieren Sie den Eintrag New Request.

Geben Sie einen Namen an, selektieren Sie POST als Methode und geben Sie {{AUTH_URL}}/oauth/token als URL an. Damit wird die zuvor definierte Umgebungsvariable AUTH_URL ausgelesen. Klicken Sie anschließend auf Create. (Fortgeschrittene Nutzer können auch den cURL request von weiter unten nutzen.)

Wechseln Sie nun zu dem Reiter Body und wählen Sie Form URL Encoded aus dem Dropdown Menü.

Klicken Sie auf drei Mal auf Add Param, um drei Parameter zu definieren. Füllen Sie diese wie auf dem Screenshot aus. Damit übergeben Sie den Client ID und Secret aus den Umgebungsvariablen CLIENT_ID und CLIENT_SECRET.

Wechseln Sie nun in den Reiter Headers. Klicken Sie auf Add Header und geben Sie content-type als Key und application/x-www-form-urlencoded als Value ein.

Speichern Sie Ihre Änderungen und führen Sie den Request aus. Sie bekommen eine Antwort in JSON Format. Nun können Sie den Schlüssel unter access_token kopieren und in Ihre TOKEN Umgebungsvariable einfügen. Als Hilfestellung können Sie das Trichter Icon in der unteren rechten Ecke nutzen, um nach access_token zu filtern. Oder Sie können einen kleinen Script schreiben, der das Ganze automatisch erledigt.

Wechseln Sie dazu in den Reiter Script und fügen Sie unter Post Response den folgenden Code ein. Damit wird nach jedem erfolgreichen Aufruf die Umgebungsvariable TOKEN automatisch gefüllt.

const token = res.getBody()?.access_token;
if (token) bru.setEnvVar("TOKEN", token);

Mit Bruno können Sie über Generate Code Icon Code für so ziemlich jede Programmiersprache generieren.

Zum Beispiel einen cURL Request:

curl --request POST \
  --url https://[your_auth_url_here]/oauth/token \
  --header 'content-type: application/x-www-form-urlencoded' \
  --data grant_type=client_credentials \
  --data 'client_id={{CLIENT_ID}}' \
  --data 'client_secret={{CLIENT_SECRET}}'

Oder Python Code:

import requests

url = "https://[your_auth_url_here]/oauth/token"

payload = {
    "grant_type": "client_credentials",
    "client_id": "{{CLIENT_ID}}",
    "client_secret": "{{CLIENT_SECRET}}"
}
headers = {"content-type": "application/x-www-form-urlencoded"}

response = requests.post(url, data=payload, headers=headers)

print(response.json())

Mit dem Token ausgestattet, können wir nun endlich mit dem LLM sprechen. Legen Sie dazu einen neuen Request mit der URL{{ORCH_DEPLOYMENT_URL}}/completion in Bruno an.

Wechseln Sie in den Reiter Body und wählen Sie als Typ JSON aus.

Kopieren Sie den folgenden Code rein. In der offiziellen Dokumentation finden Sie weitere Beispiele.

{
  "orchestration_config": {
    "module_configurations": {
      "templating_module_config": {
        "template": [
          {
            "role": "user",
            "content": "Tell me {{?number}} jokes about {{?topic}}"
          }
        ],
        "defaults": {
          "topic": "cats",
          "number": "3"
        }
      },
      "llm_module_config": {
        "model_name": "{{chat-model}}",
        "model_params": {
          "temperature": 0.7
        },
        "model_version": "latest"
      }
    }
  },
  "input_params": {
    "topic": "Consultants",
    "number": "2"
  }
}

Wechseln Sie nun in den Reiter Headers und übergeben Sie den zuvor erhaltenen Token sowie die Ressourcengruppe. Speichern Sie anschließend Ihre Änderungen und führen Sie die Abfrage aus. Gratuliere, Sie können nun SAP AI Core API einsetzen.

Neben direkter API Nutzung könne Sie auch SDKs zur Kommunikation mit SAP AI Core nutzen. Nachfolgend stelle ich das Python SDK vor.

SAP Python SDK nutzen

Für die Interaktion mit SAP AI Core stellt SAP Cloud SDK for AI bereit. Sie können die Bibliothek über den folgenden Befehl installieren.

pip install "sap-ai-sdk-gen[all]"

Die Zugängsdaten können Sie entweder in den Umgebungsvariablen oder in einer JSON Datei unter ~/.aicore/config.json bzw. auf Windows %USERPROFILE%.aicore\config.json ablegen. Zum Beispiel C:\Users\denis\.aicore\config.json.

Nachfolgend die Struktur der Konfigurationsdatei basierend auf den Bruno Umgebungsvariablen.

{
  "AICORE_AUTH_URL": "[AUTH_URL]",
  "AICORE_CLIENT_ID": "[CLIENT_ID]",
  "AICORE_CLIENT_SECRET": "[CLIENT_SECRET]",
  "AICORE_RESOURCE_GROUP": "[RESOURCE_GROUP]",
  "AICORE_BASE_URL": "[AI_API_URL]/v2"
}

Zum Beispiel:

{
  "AICORE_AUTH_URL": "https://xyz.authentication.eu10.hana.ondemand.com",
  "AICORE_CLIENT_ID": "sb-f5...",
  "AICORE_CLIENT_SECRET": "1e6a23...",
  "AICORE_RESOURCE_GROUP": "default",
  "AICORE_BASE_URL": "https://api.ai.prod.eu-central-1.aws.ml.hana.ondemand.com/v2"
}

Das SDK unterstützt sowohl die nativen Modelle (für die ein eigenes Deployment notwendig ist) als auch den Orchestration Service.

Anbei ein Codebeispiel:

from gen_ai_hub.orchestration.models.message import SystemMessage, UserMessage
from gen_ai_hub.orchestration.models.template import Template, TemplateValue
from gen_ai_hub.orchestration.models.config import OrchestrationConfig
from gen_ai_hub.orchestration.models.llm import LLM
from gen_ai_hub.orchestration.service import OrchestrationService

# Define a template
template = Template(
    messages=[
        SystemMessage("You are a witty and creative joke-telling comedian. Your task is to generate a specific number of jokes about a given topic."),
        UserMessage(
            "Tell me {{?number}} jokes about {{?topic}}"
        ),
    ],
    defaults=[
        TemplateValue(name="number", value="3"),
        TemplateValue(name="topic", value="cats"),
    ],
)

# Create an LLM instance with the desired parameters
llm = LLM(name="gpt-4o", version="latest", parameters={"max_tokens": 256, "temperature": 0.7})

# Create an orchestration configuration
config = OrchestrationConfig(
    template=template, 
    llm=llm,
)

# Create an orchestration service instance with the configuration
orchestration_service = OrchestrationService(config=config)

# Run the orchestration service with specific template values
result = orchestration_service.run(template_values=[
    TemplateValue(name="number", value="2"),
    TemplateValue(name="topic", value="SAP consultants")
])
print(result.orchestration_result.choices[0].message.content)

Data Privacy für Masking installieren

Eins der coolen Features von SAP AI Core ist die Möglichkeit, die Daten vor der Übergabe an das LLM zu anonymisieren. Dazu wird der Serivce Data Privacy Integration benötigt, den wir nun bereitstellen. Wählen Sie Ihren globalen Account aus und selektieren Sie unter Entitlements den Eintrag Entity Assignments.Wählen Sie Ihren Subaccount aus und klicken Sie auf Edit.

Klicken Sie anschließend auf Add Service Plans.

#

Wählen Sie unter Solutions den Eintrag Foundation / Cross Services aus bzw. geben Sie einfach Data Privacy Integration im Suchfeld ein. Selektieren Sie nun den Eintrag Data Privacy Integration. Wählen Sie die Service Pläne aus und klicken Sie auf Add Service Plans.

Speichern Sie anschließend über Save.

Wechseln Sie nun über Account Explorer zu Ihrem Subaccount. Wählen Sie unter Services den Eintrag Service Marketplace aus. Geben Sie im Suchfeld Data Privacy ein und legen Sie über Create den Service in Ihrem Subaccount an.

Selektieren Sie den Plan, bestätigen Sie die Info und klicken Sie auf Create.

Nun sehen Sie die folgende Meldung. Klicken Sie auf View Subscription.

Wenn der Status Subscribed statt Processing anzeigt, können Sie Data Masking in Ihrem Orchestration Workflow nutzen nutzen.

SAP AI Launchpad Orchestration zur Generation von JSON Vorlagen verwenden

Eine der nützlichen Eigenschaften von SAP AI Launchpad ist die Möglichkeit, den JSON Payload für den Body der API Aufrufe zu generieren, anstatt sich durch die SAP AI Core Dokumentation zu wühlen. Wählen Sie dazu unter Generative AI Hub den Eintrag Orchestration und definieren Sie Ihre Anfrage in der Oberfläche. Klicken Sie anschließend auf JSON, um den Inhalt zu kopieren.

Legen Sie nun einen neuen Request in Bruno an, indem Sie den vorherigen Inference Request klonen.

Geben Sie einen Namen ein und klicken Sie nochmals auf Clone.

Fügen Sie nun den aus SAP AI Launchpad kopierten JSON Code unter orchestration_config Tag ein.

{
  "orchestration_config": {
    "module_configurations": {
      "templating_module_config": {
        "template": [
          {
            "role": "user",
            "content": "Summarize the following CV in 10 sentences: {{?orgCV}}"
          }
        ]
      },
      "llm_module_config": {
        "model_name": "{{chat-model}}",
        "model_params": {
          "temperature": 0.7
        }
      },
      "masking_module_config": {
        "masking_providers": [
          {
            "type": "sap_data_privacy_integration",
            "method": "anonymization",
            "entities": [
              {"type": "profile-email"},
              {"type": "profile-person"},
              {"type": "profile-phone"},             
              {"type": "profile-org"},
              {"type": "profile-location"}
              ],
              "allowlist": ["PwC AG", "Deloitte AG"] // "PwC" and "Daloitte" will be preserved and not masked
          }
        ]
      }
    }
  },
  "input_params": {
    "orgCV": "Denis Reis \n +49 (815) 1337-1433 \n denis.reis@beispiel.com \n\nExperience\nSenior Manager - 02/2023 to Present\nPwC AG, Switzerland\n- Analyzed business processes and evaluated the optimal use of SAP products in collaboration with clients.\n- Advised on the design and implementation of best practice SAP BW solutions.\n- Provided management, functional, and technical consulting in EPM projects.\n- Developed strategies to solve complex technical challenges.\n- Led large-scale projects, including risk assessment, team development, and result evaluation.\n- Ensured project delivery met or exceeded client expectations and internal quality standards.\n- Trained, coached, and supervised team members.\n\nManager - 10/2020 to 02/2023\nDeloitte AG, Germany\n- Implemented planning and consolidation solutions tailored to client needs.\n- Managed and delivered large-scale, complex projects involving business and technology solutions.\n- Analyzed financial and controlling processes and assessed optimal analytics deployment.\n- Trained and coached project team members.\n\nManager - 02/2017 to 09/2020\nDahlbeer GmbH, Germany\n- Developed high-quality SAP BI strategies and solutions with clients.\n- Led multi-million budget projects and maintained client relationships.\n- Held responsibility for staffing, revenue, and budgeting.\n- Successfully acquired new business.\n\nLecturer - 09/2017 to 09/2018\nWiesbaden Business School, Germany\n- Delivered lectures in Controlling and Project Management.\n- Trained tutors and prepared teaching materials and exams.\n\nSenior Consultant - 01/2015 to 01/2017\nDahlbeer GmbH, Germany\n- Specified, designed, and implemented BI-based planning and reporting solutions.\n- Acted as project manager and team lead, maintaining client relationships.\n- Supported presales activities, workshops, and business development in SAP BI and CPM.\n\nConsultant - 05/2012 to 12/2014\nCamelot ITLab GmbH, Germany\n- Specialized in SAP BPC 10.0 and SAP BI 7.x Integrated Planning.\n- Designed and developed customized BI applications for controlling, planning, and forecasting.\n- Delivered reporting solutions using SAP TM 8.1 and TM 9.0.\n\nJunior Consultant - 07/2011 to 05/2012\nCamelot ITLab GmbH, Germany\n- Worked on EPM and SEM projects with SAP BPC and SAP BI platforms.\n- Created tailored planning and forecasting applications on BI basis.\n- Developed reporting based on SAP TM 8.1 and 9.0.\n\nProject Manager - 11/2010 to 04/2011\nABB AG, Germany\n- Managed the “Rolling Forecast” project during thesis.\n- Developed and implemented a rolling forecast system using SAP ERP and BI.\n- Optimized workflows and coordinated procurement, production, sales, and suppliers.\n\nFreelance IT Consultant - 09/2004 to 10/2010\nGermany\n- Developed databases and implemented internet projects.\n- Handled programming, design, web hosting, and customer support.\n- Supervised two employees."
  }
}

Führen Sie anschließend die Abfrage aus. Unter input_masking sehen Sie die Meldung „Input to LLM is masked successfully.“ sowie den anonymisierten Input, der an das LLM übergeben wird. Die Antwort basiert auf dem anonymisierten Inhalt.

{
  "request_id": "f1da40f5-2803-9356-920e-2af9fe1e5e4b",
  "module_results": {
    "templating": [
      {
        "content": "Summarize the following CV in 10 sentences: Denis Reis \n +49 (815) 1337-1433 \n denis.reis@beispiel.com \n\nExperience\nSenior Manager - 02/2023 to Present\nPwC AG, Switzerland\n- Analyzed business processes and evaluated the optimal use of SAP products in collaboration with clients.\n- Advised on the design and implementation of best practice SAP BW solutions.\n- Provided management, functional, and technical consulting in EPM projects.\n- Developed strategies to solve complex technical challenges.\n- Led large-scale projects, including risk assessment, team development, and result evaluation.\n- Ensured project delivery met or exceeded client expectations and internal quality standards.\n- Trained, coached, and supervised team members.\n\nManager - 10/2020 to 02/2023\nDeloitte AG, Germany\n- Implemented planning and consolidation solutions tailored to client needs.\n- Managed and delivered large-scale, complex projects involving business and technology solutions.\n- Analyzed financial and controlling processes and assessed optimal analytics deployment.\n- Trained and coached project team members.\n\nManager - 02/2017 to 09/2020\nDahlbeer GmbH, Germany\n- Developed high-quality SAP BI strategies and solutions with clients.\n- Led multi-million budget projects and maintained client relationships.\n- Held responsibility for staffing, revenue, and budgeting.\n- Successfully acquired new business.\n\nLecturer - 09/2017 to 09/2018\nWiesbaden Business School, Germany\n- Delivered lectures in Controlling and Project Management.\n- Trained tutors and prepared teaching materials and exams.\n\nSenior Consultant - 01/2015 to 01/2017\nDahlbeer GmbH, Germany\n- Specified, designed, and implemented BI-based planning and reporting solutions.\n- Acted as project manager and team lead, maintaining client relationships.\n- Supported presales activities, workshops, and business development in SAP BI and CPM.\n\nConsultant - 05/2012 to 12/2014\nCamelot ITLab GmbH, Germany\n- Specialized in SAP BPC 10.0 and SAP BI 7.x Integrated Planning.\n- Designed and developed customized BI applications for controlling, planning, and forecasting.\n- Delivered reporting solutions using SAP TM 8.1 and TM 9.0.\n\nJunior Consultant - 07/2011 to 05/2012\nCamelot ITLab GmbH, Germany\n- Worked on EPM and SEM projects with SAP BPC and SAP BI platforms.\n- Created tailored planning and forecasting applications on BI basis.\n- Developed reporting based on SAP TM 8.1 and 9.0.\n\nProject Manager - 11/2010 to 04/2011\nABB AG, Germany\n- Managed the “Rolling Forecast” project during thesis.\n- Developed and implemented a rolling forecast system using SAP ERP and BI.\n- Optimized workflows and coordinated procurement, production, sales, and suppliers.\n\nFreelance IT Consultant - 09/2004 to 10/2010\nGermany\n- Developed databases and implemented internet projects.\n- Handled programming, design, web hosting, and customer support.\n- Supervised two employees.",
        "role": "user"
      }
    ],
    "input_masking": {
      "message": "Input to LLM is masked successfully.",
      "data": {
        "masked_template": "[{\"content\": \"Summarize the following CV in 10 sentences: MASKED_PERSON \\n MASKED_PHONE_NUMBER \\n MASKED_EMAIL \\n\\nExperience\\nSenior Manager - 02/2023 to Present\\nPwC AG, MASKED_LOCATION\\n- Analyzed business processes and evaluated the optimal use of MASKED_ORG products in collaboration with clients.\\n- Advised on the design and implementation of best practice MASKED_ORG solutions.\\n- Provided management, functional, and technical consulting in MASKED_ORG projects.\\n- Developed strategies to solve complex technical challenges.\\n- Led large-scale projects, including risk assessment, team development, and result evaluation.\\n- Ensured project delivery met or exceeded client expectations and internal quality standards.\\n- Trained, coached, and supervised team members.\\n\\nManager - 10/2020 to 02/2023\\nDeloitte AG, MASKED_LOCATION\\n- Implemented planning and consolidation solutions tailored to client needs.\\n- Managed and delivered large-scale, complex projects involving business and technology solutions.\\n- Analyzed financial and controlling processes and assessed optimal analytics deployment.\\n- Trained and coached project team members.\\n\\nManager - 02/2017 to 09/2020\\nMASKED_ORG, MASKED_LOCATION\\n- Developed high-quality MASKED_ORG strategies and solutions with clients.\\n- Led multi-million budget projects and maintained client relationships.\\n- Held responsibility for staffing, revenue, and budgeting.\\n- Successfully acquired new business.\\n\\nLecturer - 09/2017 to 09/2018\\nMASKED_ORG, MASKED_LOCATION\\n- Delivered lectures in Controlling and Project Management.\\n- Trained tutors and prepared teaching materials and exams.\\n\\nSenior Consultant - 01/2015 to 01/2017\\nMASKED_ORG, MASKED_LOCATION\\n- Specified, designed, and implemented MASKED_ORG-based planning and reporting solutions.\\n- Acted as project manager and team lead, maintaining client relationships.\\n- Supported presales activities, workshops, and business development in MASKED_ORG and MASKED_ORG.\\n\\nConsultant - 05/2012 to 12/2014\\nMASKED_ORG, MASKED_LOCATION\\n- Specialized in MASKED_ORG 10.0 and MASKED_ORG 7.x Integrated Planning.\\n- Designed and developed customized MASKED_ORG applications for controlling, planning, and forecasting.\\n- Delivered reporting solutions using MASKED_ORG 8.1 and TM 9.0.\\n\\nJunior Consultant - 07/2011 to 05/2012\\nMASKED_ORG, MASKED_LOCATION\\n- Worked on MASKED_ORG and SEM projects with MASKED_ORG and MASKED_ORG platforms.\\n- Created tailored planning and forecasting applications on MASKED_ORG basis.\\n- Developed reporting based on MASKED_ORG 8.1 and 9.0.\\n\\nProject Manager - 11/2010 to 04/2011\\nMASKED_ORG, MASKED_LOCATION\\n- Managed the “Rolling Forecast” project during thesis.\\n- Developed and implemented a rolling forecast system using MASKED_ORG and MASKED_ORG.\\n- Optimized workflows and coordinated procurement, production, sales, and suppliers.\\n\\nFreelance IT Consultant - 09/2004 to 10/2010\\nMASKED_LOCATION\\n- Developed databases and implemented internet projects.\\n- Handled programming, design, web hosting, and customer support.\\n- Supervised two employees.\", \"role\": \"user\"}]"
      }
    },
    "llm": {
      "id": "chatcmpl-BokvKI1nt7uQqKEhOniNQ0T9laOPQ",
      "object": "chat.completion",
      "created": 1751436474,
      "model": "gpt-4o-mini-2024-07-18",
      "system_fingerprint": "fp_efad92c60b",
      "choices": [
        {
          "index": 0,
          "message": {
            "role": "assistant",
            "content": "The individual is currently a Senior Manager at PwC AG, where they analyze business processes and implement optimal solutions for clients, ensuring project delivery meets high standards. Prior to this role, they served as a Manager at Deloitte AG, focusing on planning and consolidation solutions while managing complex projects. They have extensive experience in developing strategies and leading large-scale projects throughout their career, having previously held managerial positions at another organization where they maintained client relationships and oversaw significant budgets.\n\nIn addition to their managerial roles, the individual has experience as a lecturer in Controlling and Project Management, where they trained tutors and prepared educational materials. Their consulting career began as a Junior Consultant, where they specialized in integrated planning and developed customized applications for various organizations. They also have experience as a Project Manager, where they developed a rolling forecast system.\n\nEarlier in their career, they worked as a Freelance IT Consultant, where they handled various aspects of database development and internet projects. Their comprehensive background includes expertise in technical consulting, team leadership, project management, and client engagement across various organizations. The individual possesses a strong ability to analyze and solve complex challenges, contributing significantly to their teams and clients."
          },
          "finish_reason": "stop"
        }
      ],
      "usage": {
        "completion_tokens": 231,
        "prompt_tokens": 699,
        "total_tokens": 930
      }
    }
  },
  "orchestration_result": {
    "id": "chatcmpl-BokvKI1nt7uQqKEhOniNQ0T9laOPQ",
    "object": "chat.completion",
    "created": 1751436474,
    "model": "gpt-4o-mini-2024-07-18",
    "system_fingerprint": "fp_efad92c60b",
    "choices": [
      {
        "index": 0,
        "message": {
          "role": "assistant",
          "content": "The individual is currently a Senior Manager at PwC AG, where they analyze business processes and implement optimal solutions for clients, ensuring project delivery meets high standards. Prior to this role, they served as a Manager at Deloitte AG, focusing on planning and consolidation solutions while managing complex projects. They have extensive experience in developing strategies and leading large-scale projects throughout their career, having previously held managerial positions at another organization where they maintained client relationships and oversaw significant budgets.\n\nIn addition to their managerial roles, the individual has experience as a lecturer in Controlling and Project Management, where they trained tutors and prepared educational materials. Their consulting career began as a Junior Consultant, where they specialized in integrated planning and developed customized applications for various organizations. They also have experience as a Project Manager, where they developed a rolling forecast system.\n\nEarlier in their career, they worked as a Freelance IT Consultant, where they handled various aspects of database development and internet projects. Their comprehensive background includes expertise in technical consulting, team leadership, project management, and client engagement across various organizations. The individual possesses a strong ability to analyze and solve complex challenges, contributing significantly to their teams and clients."
        },
        "finish_reason": "stop"
      }
    ],
    "usage": {
      "completion_tokens": 231,
      "prompt_tokens": 699,
      "total_tokens": 930
    }
  }
}

Wenn Sie dagegen pseudonymization als Methode wählen, werden die Werte wieder zurückverwandelt. Wie MASKED_PERSON_1 und MASKED_ORG_01 im folgenden Beispiel.

{
  "request_id": "c1d42ff6-f331-9b2e-9f3d-76ec6f013a95",
  "module_results": {
    "templating": [
      {
        "content": "Summarize the following CV in 10 sentences: Denis Reis \n +49 (815) 1337-1433 \n denis.reis@beispiel.com \n\nExperience\nSenior Manager - 02/2023 to Present\nPwC AG, Switzerland\n- Analyzed business processes and evaluated the optimal use of SAP products in collaboration with clients.\n- Advised on the design and implementation of best practice SAP BW solutions.\n- Provided management, functional, and technical consulting in EPM projects.\n- Developed strategies to solve complex technical challenges.\n- Led large-scale projects, including risk assessment, team development, and result evaluation.\n- Ensured project delivery met or exceeded client expectations and internal quality standards.\n- Trained, coached, and supervised team members.\n\nManager - 10/2020 to 02/2023\nDeloitte AG, Germany\n- Implemented planning and consolidation solutions tailored to client needs.\n- Managed and delivered large-scale, complex projects involving business and technology solutions.\n- Analyzed financial and controlling processes and assessed optimal analytics deployment.\n- Trained and coached project team members.\n\nManager - 02/2017 to 09/2020\nDahlbeer GmbH, Germany\n- Developed high-quality SAP BI strategies and solutions with clients.\n- Led multi-million budget projects and maintained client relationships.\n- Held responsibility for staffing, revenue, and budgeting.\n- Successfully acquired new business.\n\nLecturer - 09/2017 to 09/2018\nWiesbaden Business School, Germany\n- Delivered lectures in Controlling and Project Management.\n- Trained tutors and prepared teaching materials and exams.\n\nSenior Consultant - 01/2015 to 01/2017\nDahlbeer GmbH, Germany\n- Specified, designed, and implemented BI-based planning and reporting solutions.\n- Acted as project manager and team lead, maintaining client relationships.\n- Supported presales activities, workshops, and business development in SAP BI and CPM.\n\nConsultant - 05/2012 to 12/2014\nCamelot ITLab GmbH, Germany\n- Specialized in SAP BPC 10.0 and SAP BI 7.x Integrated Planning.\n- Designed and developed customized BI applications for controlling, planning, and forecasting.\n- Delivered reporting solutions using SAP TM 8.1 and TM 9.0.\n\nJunior Consultant - 07/2011 to 05/2012\nCamelot ITLab GmbH, Germany\n- Worked on EPM and SEM projects with SAP BPC and SAP BI platforms.\n- Created tailored planning and forecasting applications on BI basis.\n- Developed reporting based on SAP TM 8.1 and 9.0.\n\nProject Manager - 11/2010 to 04/2011\nABB AG, Germany\n- Managed the “Rolling Forecast” project during thesis.\n- Developed and implemented a rolling forecast system using SAP ERP and BI.\n- Optimized workflows and coordinated procurement, production, sales, and suppliers.\n\nFreelance IT Consultant - 09/2004 to 10/2010\nGermany\n- Developed databases and implemented internet projects.\n- Handled programming, design, web hosting, and customer support.\n- Supervised two employees.",
        "role": "user"
      }
    ],
    "input_masking": {
      "message": "Input to LLM is masked successfully.",
      "data": {
        "masked_template": "[{\"content\": \"Summarize the following CV in 10 sentences: MASKED_PERSON_1 \\n MASKED_PHONE_NUMBER_1 \\n MASKED_EMAIL_1 \\n\\nExperience\\nSenior Manager - 02/2023 to Present\\nPwC AG, MASKED_LOCATION_1\\n- Analyzed business processes and evaluated the optimal use of MASKED_ORG_13 products in collaboration with clients.\\n- Advised on the design and implementation of best practice MASKED_ORG_06 solutions.\\n- Provided management, functional, and technical consulting in MASKED_ORG_02 projects.\\n- Developed strategies to solve complex technical challenges.\\n- Led large-scale projects, including risk assessment, team development, and result evaluation.\\n- Ensured project delivery met or exceeded client expectations and internal quality standards.\\n- Trained, coached, and supervised team members.\\n\\nManager - 10/2020 to 02/2023\\nDeloitte AG, MASKED_LOCATION_2\\n- Implemented planning and consolidation solutions tailored to client needs.\\n- Managed and delivered large-scale, complex projects involving business and technology solutions.\\n- Analyzed financial and controlling processes and assessed optimal analytics deployment.\\n- Trained and coached project team members.\\n\\nManager - 02/2017 to 09/2020\\nMASKED_ORG_01, MASKED_LOCATION_2\\n- Developed high-quality MASKED_ORG_08 strategies and solutions with clients.\\n- Led multi-million budget projects and maintained client relationships.\\n- Held responsibility for staffing, revenue, and budgeting.\\n- Successfully acquired new business.\\n\\nLecturer - 09/2017 to 09/2018\\nMASKED_ORG_09, MASKED_LOCATION_2\\n- Delivered lectures in Controlling and Project Management.\\n- Trained tutors and prepared teaching materials and exams.\\n\\nSenior Consultant - 01/2015 to 01/2017\\nMASKED_ORG_01, MASKED_LOCATION_2\\n- Specified, designed, and implemented MASKED_ORG_04-based planning and reporting solutions.\\n- Acted as project manager and team lead, maintaining client relationships.\\n- Supported presales activities, workshops, and business development in MASKED_ORG_08 and MASKED_ORG_11.\\n\\nConsultant - 05/2012 to 12/2014\\nMASKED_ORG_12, MASKED_LOCATION_2\\n- Specialized in MASKED_ORG_05 10.0 and MASKED_ORG_08 7.x Integrated Planning.\\n- Designed and developed customized MASKED_ORG_04 applications for controlling, planning, and forecasting.\\n- Delivered reporting solutions using MASKED_ORG_07 8.1 and TM 9.0.\\n\\nJunior Consultant - 07/2011 to 05/2012\\nMASKED_ORG_12, MASKED_LOCATION_2\\n- Worked on MASKED_ORG_02 and SEM projects with MASKED_ORG_05 and MASKED_ORG_08 platforms.\\n- Created tailored planning and forecasting applications on MASKED_ORG_04 basis.\\n- Developed reporting based on MASKED_ORG_07 8.1 and 9.0.\\n\\nProject Manager - 11/2010 to 04/2011\\nMASKED_ORG_03, MASKED_LOCATION_2\\n- Managed the “Rolling Forecast” project during thesis.\\n- Developed and implemented a rolling forecast system using MASKED_ORG_10 and MASKED_ORG_04.\\n- Optimized workflows and coordinated procurement, production, sales, and suppliers.\\n\\nFreelance IT Consultant - 09/2004 to 10/2010\\nMASKED_LOCATION_2\\n- Developed databases and implemented internet projects.\\n- Handled programming, design, web hosting, and customer support.\\n- Supervised two employees.\", \"role\": \"user\"}]"
      }
    },
    "llm": {
      "id": "chatcmpl-BsLFWx60TJ55NElzxkSPnhux3Yncl",
      "object": "chat.completion",
      "created": 1752291094,
      "model": "gpt-4o-mini-2024-07-18",
      "system_fingerprint": "fp_efad92c60b",
      "choices": [
        {
          "index": 0,
          "message": {
            "role": "assistant",
            "content": "MASKED_PERSON_1 is an accomplished professional with extensive experience in management consulting and project delivery. Currently, they serve as a Senior Manager at PwC AG, where they analyze business processes and collaborate with clients to implement best practice solutions. Prior to this, they were a Manager at Deloitte AG, focusing on planning and consolidation solutions for complex projects. They also held a managerial role at MASKED_ORG_01, where they developed high-quality strategies and managed multi-million budget projects while maintaining client relationships. Additionally, they have experience as a lecturer in Controlling and Project Management, where they trained tutors and prepared educational materials. Earlier in their career, they worked as a Senior Consultant and Consultant, specializing in planning and reporting solutions across various platforms. Their experience also includes a Junior Consultant role, where they created tailored planning applications and reporting solutions. They began their professional journey as a Project Manager, developing a rolling forecast system, and worked as a Freelance IT Consultant, managing projects related to database development and web hosting. Throughout their career, they have demonstrated strong leadership, team development, and client management skills. Overall, MASKED_PERSON_1 has a proven track record in delivering results and driving business success through strategic consulting and technical expertise."
          },
          "finish_reason": "stop"
        }
      ],
      "usage": {
        "completion_tokens": 247,
        "prompt_tokens": 771,
        "total_tokens": 1018
      }
    },
    "output_unmasking": [
      {
        "index": 0,
        "message": {
          "role": "assistant",
          "content": "Denis Reis is an accomplished professional with extensive experience in management consulting and project delivery. Currently, they serve as a Senior Manager at PwC AG, where they analyze business processes and collaborate with clients to implement best practice solutions. Prior to this, they were a Manager at Deloitte AG, focusing on planning and consolidation solutions for complex projects. They also held a managerial role at Dahlbeer GmbH, where they developed high-quality strategies and managed multi-million budget projects while maintaining client relationships. Additionally, they have experience as a lecturer in Controlling and Project Management, where they trained tutors and prepared educational materials. Earlier in their career, they worked as a Senior Consultant and Consultant, specializing in planning and reporting solutions across various platforms. Their experience also includes a Junior Consultant role, where they created tailored planning applications and reporting solutions. They began their professional journey as a Project Manager, developing a rolling forecast system, and worked as a Freelance IT Consultant, managing projects related to database development and web hosting. Throughout their career, they have demonstrated strong leadership, team development, and client management skills. Overall, Denis Reis has a proven track record in delivering results and driving business success through strategic consulting and technical expertise."
        },
        "finish_reason": "stop"
      }
    ]
  },
  "orchestration_result": {
    "id": "chatcmpl-BsLFWx60TJ55NElzxkSPnhux3Yncl",
    "object": "chat.completion",
    "created": 1752291094,
    "model": "gpt-4o-mini-2024-07-18",
    "system_fingerprint": "fp_efad92c60b",
    "choices": [
      {
        "index": 0,
        "message": {
          "role": "assistant",
          "content": "Denis Reis is an accomplished professional with extensive experience in management consulting and project delivery. Currently, they serve as a Senior Manager at PwC AG, where they analyze business processes and collaborate with clients to implement best practice solutions. Prior to this, they were a Manager at Deloitte AG, focusing on planning and consolidation solutions for complex projects. They also held a managerial role at Dahlbeer GmbH, where they developed high-quality strategies and managed multi-million budget projects while maintaining client relationships. Additionally, they have experience as a lecturer in Controlling and Project Management, where they trained tutors and prepared educational materials. Earlier in their career, they worked as a Senior Consultant and Consultant, specializing in planning and reporting solutions across various platforms. Their experience also includes a Junior Consultant role, where they created tailored planning applications and reporting solutions. They began their professional journey as a Project Manager, developing a rolling forecast system, and worked as a Freelance IT Consultant, managing projects related to database development and web hosting. Throughout their career, they have demonstrated strong leadership, team development, and client management skills. Overall, Denis Reis has a proven track record in delivering results and driving business success through strategic consulting and technical expertise."
        },
        "finish_reason": "stop"
      }
    ],
    "usage": {
      "completion_tokens": 247,
      "prompt_tokens": 771,
      "total_tokens": 1018
    }
  }
}