What's new on 2024-08-19? - A built-in ChatGPT-like command with live screen data integration and smart scraping and more

📢 What's New?
1

New Features

Ask Anything or Smart Scraping with New Action: “AskUxer”

Introducing AskUxer, a built-in ChatGPT-like command with live screen data integration.

  • Ask Anything: Instantly get dynamic responses and integrate them into your automation workflows.

    {Response} = AskUxer "Give me a random number"
{Response} = AskUxer "Generate a random email"
{Response} = AskUxer "Create a catchy subject line for my company"

  • Smart Screen Scraping: Extract on-screen data to power your automations.

    {Response} = AskUxer "Summarize the PDF on the screen" -UseScreenshot true
{Response} = AskUxer "Generate a reply to this email" -UseScreenshot true
{Response} = AskUxer "Summarize the content of the website" -UseScreenshot true
{Response} = AskUxer "Extract the price from the screen" -UseScreenshot true

image
image1920Ă—963 74.8 KB


Bug Fixes and Improvements

Performance Improvements

Resolved key performance issues caused by architectural updates. Further improvements coming in future releases.

RunScenario/Repeat/Loop Bug Fix

Loop creation improved. If using Repeat with RunScenario, set “Retry” to 0 to avoid endless loops. Default of Retry is 10. We will change default Retry to 0 for Runscenario in upcoming releases.

OCR Improvements

Enhanced OCR algorithm for improved accuracy.

Run a Single Step for Image Click

Now, run a single step using the image click functionality.

4 Likes
2

Genius!

Can’t find better words to express my excitement, always speechless with U-xer updates.

Vision based automation, now with brain.

Questions:

  1. Can we BYOK in the future?
  2. Will there be option to set temperature?
  3. Can we use local AI endpoint to handle private data in the future?

Thank you.

3

We already thought about BYOK but it is becoming harder to manage different aspects. There are points which we can make BYOK and there are points which we can’t. For that reason, we are going simple, and without BYOK at the moment to keep our development resources busy with other things.

As a summary, I am not sure how it can turn out in the future but it is not prioritized at the moment.

Any other setting like temperature, may be added in future based on the requests coming from Users.

1 Like
4

This is a really good update, absolutly amazing new option in the automation. Congratulations to the team.