Implement remote Python WebAssemblyExecutor #1261

albertvillanova · 2025-04-28T13:21:22Z

Implement remote Python WebAssemblyExecutor.

aymeric-roucher · 2025-04-28T14:51:20Z

Looking forward to this! 👀

HuggingFaceDocBuilderDev · 2025-04-29T05:34:09Z

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

rth

Thanks for working on this @albertvillanova ! Regarding the use of pyodide with deno I don't have too many comments, it looks reasonable. As you probably saw in pyodide/pyodide#3420 Deno is not exactly an officially supported platform so you might run into some edge cases. Still if you tested on your side and it works well enough then it should be fine :)

Syntax highlighting would be better if the JS code is a standalone file but then you have to read it from python so maybe this is simpler indeed.

I'll also cc @ryanking13 @hoodmane who are more up to date on pyodide development, in case they have comments.

rth · 2025-05-26T16:43:12Z

src/smolagents/remote_executors.py

+                # --allow-net=cdn.jsdelivr.net,0.0.0.0:8000;
+                # --allow-net=pypi.org,files.pythonhosted.org;  # allow fetch pyodide packages from PyPI
+                "--allow-net",  # allow fetch pyodide packages & server
+                "--allow-read",  # grant read access for pyodide packages


Might be safer to restrict to a particular folder (node_modules?) where pydide files are. Both for reading and writing.

Thanks! Definitely, the access to the filesystem needs to be restricted here, as it will be the case for the net access as well. I take note so I don't forget:

# TODO: Set minimal permissions

rth · 2025-05-26T16:47:42Z

src/smolagents/remote_executors.py

+                for (const pkg of packages) {
+                  try {
+                    // await pyodide.loadPackage(pkg);
+                    await micropip.install(pkg);


+1 to use micropip here

ryanking13 · 2025-05-27T06:48:54Z

Thanks for the ping @rth!

As you probably saw in pyodide/pyodide#3420 Deno is not exactly an officially supported platform so you might run into some edge cases. Still if you tested on your side and it works well enough then it should be fine :)

Yep, Deno is not officially supported in Pyodide, but there are already some projects like PydanticAI and Langchain Sandbox that are utilizing Pyodide + Deno combination. So I think it is a reasonable choice. If you encounter any bugs, then feel free to open an issue in the Pyodide repository (or in the Deno repository).

albertvillanova · 2025-06-04T11:26:25Z

What about renaming it to WasmExecutor (instead of WebAssemblyExecutor)?

Copilot

Pull Request Overview

This PR adds a new WebAssemblyExecutor to enable secure remote Python code execution in a sandboxed WebAssembly environment using Pyodide and Deno. It includes new unit and integration tests, updates to the CodeAgent to support the new executor type, and documentation and security updates across examples, docs, README, and SECURITY files.

Reviewed Changes

Copilot reviewed 8 out of 8 changed files in this pull request and generated no comments.

Show a summary per file

File	Description
tests/test_remote_executors.py	Added tests for WebAssemblyExecutor unit and integration.
src/smolagents/remote_executors.py	Implemented the WebAssemblyExecutor and its startup logic.
src/smolagents/agents.py	Updated CodeAgent to include the "wasm" executor type.
examples/sandboxed_execution.py	Provided an example usage of the WebAssembly executor.
docs/source/en/tutorials/secure_code_execution.mdx, docs/source/en/reference/agents.mdx, SECURITY.md, README.md	Updated documentation to cover the new WebAssembly sandbox.

aymeric-roucher

LGTM! So If you're happy with the current state @albertvillanova, let's merge this!

hoodmane · 2025-06-27T10:26:29Z

We'd like to support Deno so bug reports are welcome.

hoodmane · 2025-06-27T10:30:22Z

src/smolagents/remote_executors.py

+          }
+
+          return {
+            result: result,


JS note: you can just do

Suggested change

result: result,

result,

hoodmane · 2025-06-27T10:31:46Z

src/smolagents/remote_executors.py

+        self.cleanup()
+
+    JS_CODE = dedent("""\
+        // pyodide_runner.js - Runs Python code in Pyodide within Deno


Seems like this would be good to put in a separate file...

hoodmane · 2025-06-27T10:34:04Z

src/smolagents/remote_executors.py

+                for (const pkg of packages) {
+                  try {
+                    // await pyodide.loadPackage(pkg);
+                    await micropip.install(pkg);


This is really inefficient since you are waterfalling the package installation. Micropip accepts a list as argument.

yes, definitely. I missed that in the review somehow :)

Thanks for your useful review! 🤗 Done.

…-assembly

albertvillanova · 2025-06-30T07:30:45Z

We can consider this as an initial implementation of WasmExecutor that supports simple straightforward use cases, and merge it in its current form.

We can afterwards progressively add support for other scenarios in subsequent PRs.

albertvillanova · 2025-06-30T07:33:59Z

For example, I get this error when trying to make an HTTP request:

urllib3 only works in Node.js with pyodide.runPythonAsync and requires the flag --experimental-wasm-stack-switching in versions of node
<24.

Any hint on this?
CC: @hoodmane @rth

albertvillanova added 3 commits April 28, 2025 15:19

Test WebAssemblyExecutor

8f227a1

tmp

3e35ef4

Implement WebAssemblyExecutor

c966c25

albertvillanova added 2 commits April 29, 2025 07:22

Add wasm executor_type to CodeAgent

2157093

Add Python code executors to Reference docs

eb25cf9

albertvillanova added 5 commits April 29, 2025 11:01

Use micropip to install packages with pyodide

e8de046

Override send_tools

13f539b

Refactor

5650d4f

Allow fetch packages from PyPI

ad6580c

Update __all__

7b5664d

This was referenced Apr 30, 2025

Lower Pillow dependency minimum version to 10.0.1 #1270

Merged

Remove duckduckgo-search as required dependency #1271

Merged

Merge branch 'main' into remote-executor-web-assembly

9cf381b

albertvillanova mentioned this pull request May 2, 2025

Remove smolagents installation from remote executors #1274

Merged

Update send_tools by overriding new parent's

94d3ee6

albertvillanova mentioned this pull request May 2, 2025

Refactor RemotePythonExecutor.send_tools to call install_packages #1281

Merged

albertvillanova added 10 commits May 3, 2025 08:24

Merge branch 'main' into remote-executor-web-assembly

bc5ee04

Merge branch 'main' into remote-executor-web-assembly

9fe9ed6

Add WebAssembly executor example

f5521e8

Update Secure Code Execution tutorials docs

f269011

Update README

32a36f1

Update SECURITY

64e763b

Merge branch 'main' into remote-executor-web-assembly

7eb0800

Remove send_tools overriding

c2d427a

Merge branch 'main' into remote-executor-web-assembly

46a8e8c

Support urllib3 (requests) which require pyodide.runPythonAsync

4c19167

rth reviewed May 26, 2025

View reviewed changes

albertvillanova added 2 commits June 4, 2025 08:23

Merge branch 'main' into remote-executor-web-assembly

fce1477

Set minimal permissions for Deno execution

7cc765b

albertvillanova marked this pull request as ready for review June 4, 2025 11:18

albertvillanova requested a review from Copilot June 4, 2025 13:06

Copilot AI reviewed Jun 4, 2025

View reviewed changes

aymeric-roucher approved these changes Jun 27, 2025

View reviewed changes

hoodmane reviewed Jun 27, 2025

View reviewed changes

src/smolagents/remote_executors.py Outdated

}

return {

result: result,

Copy link

hoodmane Jun 27, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JS note: you can just do

Suggested change

result: result,

result,

hoodmane reviewed Jun 27, 2025

View reviewed changes

albertvillanova added 7 commits June 27, 2025 15:47

Merge remote-tracking branch 'upstream/main' into remote-executor-web…

844aa6a

…-assembly

Address requested changes

563f441

Rename to WasmExecutor

fef2875

Update with CodeOutput

cfdaf65

Fix test with final_answer by calling send_tools

b0d96c7

Implement exception mechanism for final answer

6ddf7ee

Use context manager for resource cleanup in examples

44459f5

albertvillanova merged commit 99e2e29 into huggingface:main Jun 30, 2025
4 checks passed

albertvillanova deleted the remote-executor-web-assembly branch June 30, 2025 07:35

Implement remote Python WebAssemblyExecutor #1261

Implement remote Python WebAssemblyExecutor #1261

Conversation

albertvillanova commented Apr 28, 2025

Uh oh!

aymeric-roucher commented Apr 28, 2025

Uh oh!

HuggingFaceDocBuilderDev commented Apr 29, 2025

Uh oh!

rth left a comment

Choose a reason for hiding this comment

Uh oh!

rth May 26, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

albertvillanova May 27, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

rth May 26, 2025

Choose a reason for hiding this comment

Uh oh!

ryanking13 commented May 27, 2025

Uh oh!

albertvillanova commented Jun 4, 2025

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull Request Overview

Reviewed Changes

Uh oh!

aymeric-roucher left a comment

Choose a reason for hiding this comment

Uh oh!

hoodmane commented Jun 27, 2025

Uh oh!

hoodmane Jun 27, 2025

Choose a reason for hiding this comment

Uh oh!

hoodmane Jun 27, 2025

Choose a reason for hiding this comment

Uh oh!

hoodmane Jun 27, 2025

Choose a reason for hiding this comment

Uh oh!

rth Jun 27, 2025

Choose a reason for hiding this comment

Uh oh!

albertvillanova Jun 30, 2025

Choose a reason for hiding this comment

Uh oh!

albertvillanova commented Jun 30, 2025

Uh oh!

albertvillanova commented Jun 30, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Uh oh!

rth May 26, 2025 •

edited

Loading

albertvillanova May 27, 2025 •

edited

Loading

albertvillanova commented Jun 30, 2025 •

edited

Loading