feat(eval): add SimulateComponentMocker for per-component API-based simulation by AAgnihotry · Pull Request #1732 · UiPath/uipath-python

AAgnihotry · 2026-06-17T19:34:24Z

Summary

Adds a new components format to simulation.json that routes each tool call to the
/agentsruntime_/api/execution/simulations/simulate-component API instead of the local LLM mocker
Introduces SimulateComponentMocker, SimulateComponentService, and 7 new types
(SimulationStrategy, RuleOperator, SimulationAnswerType, SimulationAnswer,
SimulationCondition, SimulationBehavior, ComponentSimulationConfig) mirroring the API contract
Legacy format (toolsToSimulate + instructions) is fully preserved — no breaking changes

Design decisions

Endpoint uses agentsruntime_ service prefix, which means UIPATH_SERVICE_URL_AGENTSRUNTIME
env var can redirect to a local service for development
componentId in the payload uses the configured component ID (not the normalised invoked name)
to ensure server-side simulation rules match correctly
Empty components: [] does not activate the API mocker (truthiness check, not is not None)

Test plan

Existing simulation tests pass (pytest tests/cli/test_debug_simulation.py)
New tests in tests/cli/eval/mocks/test_simulate_component.py all pass (coverage 100%)
ruff check . passes with no errors
mypy passes with no errors
Manual: run uipath debug with a simulation.json using the new components format and
verify the API call is made to agentsruntime_/api/execution/simulations/simulate-component
Manual: verify legacy toolsToSimulate format still routes to the local LLM mocker

🤖 Generated with Claude Code

ANIPIK--FFQTDV0N47:simulate-component-agent anipik$ uv run uipath run main -f input.json --simulation "$(cat simulation.json)"  
Resource overwrites config file not found: __uipath/uipath.json
▶ START 
[simulate-component] mocker set: SimulateComponentMocker
simulate-component: mocker created (SimulateComponentMocker)
[simulate-component] get_mocked_response called for 'get_current_weather', mocker=SimulateComponentMocker
simulate-component: calling API for 'get_current_weather'
HTTP Request: POST https://alpha.uipath.com/agentsurt/DefaultTenant/agentsruntime_/api/execution/simulations/simulate-component "HTTP/1.1 200 OK"
simulate-component: 'get_current_weather' simulated successfully
[simulate-component] get_mocked_response called for 'get_forecast', mocker=SimulateComponentMocker
simulate-component: calling API for 'get_forecast'
HTTP Request: POST https://alpha.uipath.com/agentsurt/DefaultTenant/agentsruntime_/api/execution/simulations/simulate-component "HTTP/1.1 200 OK"
simulate-component: 'get_forecast' simulated successfully
● END
output
├── current (dict)
│   ├── city: London
│   ├── temperature: 6.5
│   ├── condition: cloudy
│   └── humidity: 70
├── forecast (list, 3 items)
│   ├── #0 (dict)
│   │   ├── date: 2024-01-15
│   │   ├── high: 8.0
│   │   ├── low: 3.0
│   │   └── condition: Partly cloudy
│   ├── #1 (dict)
│   │   ├── date: 2024-01-16
│   │   ├── high: 6.0
│   │   ├── low: 2.0
│   │   └── condition: Light rain
│   └── #2 (dict)
│       ├── date: 2024-01-17
│       ├── high: 7.0
│       ├── low: 4.0
│       └── condition: Overcast
└── summary: London: 6.5°C, cloudy. 3-day forecast available.
✓  Successful execution.
'id' field not present in uipath.json

Copilot

Pull request overview

Adds support for a new simulation.json format that simulates tool/component calls by delegating to the /agentsruntime_/api/execution/simulations/simulate-component endpoint, while preserving the legacy toolsToSimulate + instructions local LLM mocker behavior.

Changes:

Introduces per-component simulation schema/types (components + API-contract enums/models) and wires them into mocking context creation.
Adds SimulateComponentService + SimulateComponentMocker and routes mocking through them when components-based config is active.
Extends tests to cover loading the new components format and updates legacy assertions accordingly.

Reviewed changes

Copilot reviewed 9 out of 9 changed files in this pull request and generated 9 comments.

Show a summary per file

File	Description
packages/uipath/tests/cli/test_debug_simulation.py	Adds a test for the new `components` simulation format and updates legacy assertions.
packages/uipath/src/uipath/eval/mocks/_types.py	Adds API-contract enums/models and extends `SimulationConfig` / `MockingContext` with `components`.
packages/uipath/src/uipath/eval/mocks/_simulate_component_service.py	New service wrapper around the simulate-component API endpoint.
packages/uipath/src/uipath/eval/mocks/_simulate_component_mocker.py	New mocker that calls the simulate-component API per tool invocation.
packages/uipath/src/uipath/eval/mocks/_mocker_factory.py	Routes to the new mocker based on context.
packages/uipath/src/uipath/eval/mocks/_mock_runtime.py	Builds mocking context for new format and adjusts execution-context setup.
packages/uipath/src/uipath/eval/mocks/_mock_context.py	Updates tool-simulation detection to support components-based configs.
packages/uipath/src/uipath/eval/mocks/init.py	Exposes new types in the public mocks module API.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Copilot

Pull request overview

Copilot reviewed 10 out of 11 changed files in this pull request and generated 2 comments.

github-actions · 2026-06-18T17:24:37Z

🚨 Heads up: `uipath-integrations` cross-tests are FAILING 🚨

Your changes may break one or more integrations in uipath-integrations-python:

uipath-openai-agents
uipath-google-adk
uipath-agent-framework
uipath-llamaindex
uipath-pydantic-ai

⚠️ These checks are NOT enforced by branch protection rules. Please review the failures before merging.

🔍 Inspect the failed run →

github-actions · 2026-06-22T18:48:21Z

🚨 Heads up: `uipath-langchain` cross-tests are FAILING 🚨

Your changes may break the uipath-langchain-python integration.

⚠️ These checks are NOT enforced by branch protection rules. Please review the failures before merging.

🔍 Inspect the failed run →

sonarqubecloud · 2026-06-22T19:45:20Z

Quality Gate passed

Issues
1 New issue
0 Accepted issues

Measures
0 Security Hotspots
96.6% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud

Copilot AI review requested due to automatic review settings June 17, 2026 19:34

github-actions Bot added test:uipath-langchain Triggers tests in the uipath-langchain-python repository test:uipath-integrations labels Jun 17, 2026

Copilot started reviewing on behalf of AAgnihotry June 17, 2026 19:34 View session

Copilot AI reviewed Jun 17, 2026

View reviewed changes

AAgnihotry force-pushed the feat/simulate-component-mocker branch from 294eb67 to 213dc99 Compare June 17, 2026 19:55

AAgnihotry requested a review from Copilot June 17, 2026 20:02

Copilot started reviewing on behalf of AAgnihotry June 17, 2026 20:03 View session

Copilot AI reviewed Jun 17, 2026

View reviewed changes

Comment thread packages/uipath/src/uipath/eval/mocks/_simulate_component_mocker.py

Comment thread packages/uipath/src/uipath/eval/mocks/_simulate_component_service.py Outdated

AAgnihotry force-pushed the feat/simulate-component-mocker branch 2 times, most recently from 1cd9526 to 73ec8ff Compare June 22, 2026 18:05

feat: add simulate component support

cff64d7

AAgnihotry force-pushed the feat/simulate-component-mocker branch from ff012a3 to cff64d7 Compare June 22, 2026 18:35

feat: remove debug statements

68f9904

smflorentino self-requested a review June 22, 2026 23:21

smflorentino approved these changes Jun 22, 2026

View reviewed changes

AAgnihotry merged commit 3753803 into main Jun 22, 2026
238 of 240 checks passed

AAgnihotry deleted the feat/simulate-component-mocker branch June 22, 2026 23:23

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat(eval): add SimulateComponentMocker for per-component API-based simulation#1732

feat(eval): add SimulateComponentMocker for per-component API-based simulation#1732
AAgnihotry merged 2 commits into
mainfrom
feat/simulate-component-mocker

AAgnihotry commented Jun 17, 2026 •

edited

Loading

Uh oh!

Copilot AI left a comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Copilot AI left a comment

Uh oh!

Uh oh!

Uh oh!

github-actions Bot commented Jun 18, 2026

Uh oh!

github-actions Bot commented Jun 22, 2026

Uh oh!

sonarqubecloud Bot commented Jun 22, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Conversation

AAgnihotry commented Jun 17, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Design decisions

Test plan

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Uh oh!

github-actions Bot commented Jun 18, 2026

🚨 Heads up: uipath-integrations cross-tests are FAILING 🚨

Uh oh!

github-actions Bot commented Jun 22, 2026

🚨 Heads up: uipath-langchain cross-tests are FAILING 🚨

Uh oh!

sonarqubecloud Bot commented Jun 22, 2026

Quality Gate passed

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

AAgnihotry commented Jun 17, 2026 •

edited

Loading

🚨 Heads up: `uipath-integrations` cross-tests are FAILING 🚨

🚨 Heads up: `uipath-langchain` cross-tests are FAILING 🚨