What's new on 2025-04-28? AI Agent with Anthropic Computer Use support!

📢 What's New?
1

New Action: UxerAction now live — AI agent with Anthropic Computer Use model support! :tada:

Hi everyone,

We’ve just released UxerAction, a new action that lets you use the Anthropic Computer Use model within Uxer.

Why this matters

  • AI agents look incredibly promising, but, in real-life business cases, you often hit limits of knowledge or reliability.
  • Uxer’s answer is controlled automation: combine solid scripted actions with AI-powered steps only where they add real value.
  • The result? Faster, cheaper, and far more predictable workflows.

What you can do today

  • Run end-to-end desktop or web workflows with one command.
  • Blend solid Uxer steps with AI only where you need flexibility.

Example Scenario

Let’s look at how to create a simple workflow with AI, without AI, and with a hybrid approach for the below sample scenario.

Example 1 — AI only

UxerAction "Go to portal.uxer.ai and log in with my credentials. Mail: [email protected] Password '123'"

Pros: one-line flow; easy to build.
Cons: slower; more expensive; the AI may struggle to find the browser or miss edge cases.

image
image1920Ă—919 54.1 KB

Example 2 — Scripted only

Openbrowser chrome "portal.uxer.ai"
Click Text "E-Mail Address"
Write "[email protected]"
Click Text "Password"
Write "123"
Click Text "Login"

Pros: fastest; cheapest; most reliable.
Cons: you must spell out every step.

image
image1920Ă—919 52.6 KB

Example 3 — Hybrid

Openbrowser chrome "portal.uxer.ai"
UxerAction "Log in with my credentials. Mail: [email protected] Password '123'"

Pros: browser launch is guaranteed; AI fills the form, so you save time without guessing.
Cons: you decide where AI adds value versus scripted steps.

image
image1920Ă—919 47.1 KB

Getting started

  1. Get your Anthropic API key (UxerAction uses your own Anthropic API key. Steps explained below).
  2. Update the Uxer agent to the Latest version by clicking Install New Version. If the button is unavailable, you are already on the latest version.
  3. In your project, choose Add Action → UxerAction.
  4. Describe the task in plain language (e.g., “Open the quarterly report, create a three-slide summary, save to Drive.”).
  5. Hit Run and watch it work.

We’d love your feedback

Early impressions, bugs, or wish-list features—let us know!
Reply below or open a thread in Feedback → UxerAction.

Thanks for helping us push Uxer forward!

— The Uxer Team :rocket:

How to add your API key

UxerAction uses your own Anthropic API key. Bring-Your-Own-Key (Important!).

  1. Obtain your key from your Anthropic account.

    Obtaining the key
    Obtaining the key1920Ă—919 90.3 KB

  2. Create a text file and save the key in the file.

    Saving the key
    Saving the key950Ă—633 6.8 KB

  3. Place the file in your sensitive folder inside your Uxer workspace (the exact path is shown in the agent).

    Sensitive folder
    Sensitive folder1612Ă—777 96.6 KB

  4. In Options, enter the key file name.

    Entering the key file name
    Entering the key file name1920Ă—919 70.5 KB

How to test

  1. In the Scenario Editor, click the Take Screenshot button to confirm the agent is running.
  2. Create a step with UxerAction and add the prompt: “Click the Monitor tab.”
  3. Run the step. Ensure you are on the Uxer page and that the Monitor tab is visible at the top.
  4. Open the last execution report and confirm the step ran.
  5. If it failed, check Details to see why.
  6. If it switched to the Monitor page, you are ready.
5 Likes
2

Happy to see that uxer is being developed and maintained. :smiley:

1 Like