LAM Playground testing with Rabbit R1: Trying to save library books, order flowers and shop for jackets

I recently conducted several experiments using the LAM Playground for the Rabbit R1, testing various automation scenarios. Here are my findings:

:books:Library tests

Basic Book Search

Prompt:
Go to the website of the library of the city of Antwerp, search for books by the author Helen Fields and show me the books which are available in English language versions.

Success! The R1 executed all steps perfectly.

Adding book to a list (logged in as a user)

Prompt:
Go to the website of the library of the city of Antwerp and then add the book “The Institution” by Helen Fields to my “To read” list.

  • Success: Navigated to library website
  • Failure: Incorrect search behavior (entered “format=boek” in search bar)

Adding book to a list - Variation (logged in as a user)

Prompt:
Go to the website of the library of the city of Antwerp and then search for books by the author Helen Fields and then look for the book “The Institution” and then add that book to my list called “To read”.

  • Successes:
    • Navigated to website
    • Found author’s books
    • Located correct book
    • Clicked “Add to list”
  • Failure: Couldn’t interact with the final pop-up to select the “To read” list :disappointed_relieved:

:lab_coat:Shopping for a jacket

Prompts:
-Go to the website of Sportpursuit and then search for merino jackets with a zipper in the colours blue, grey, black or olive in the size Large. Add 5 jackets to my cart.

-Go to the website of Sportpursuit and then search for merino jackets and then look for jackets in the colours blue, grey, black or olive. Then choose 5 of those jackets and add a size Large of those jackets to my shopping cart.

-Go to the website of Sportpursuit and then search for merino jackets. In the search results use a filter to look for jackets in the colours blue, grey, black or olive. In the search results then choose the first 5 of those jackets and then add a size Large of those jackets to my shopping cart.

All three variations showed similar results:

  • Success: Initial website navigation and basic search
  • Failure: Got stuck on My Account page after search (it shouldn’t have even gone there)

:flower_playing_cards:Cardmarket search

Prompt:
Go to the cardmarket site and then search for the card “Shining Gyarados” and then search for the cheapest card in Good condition from a seller in Belgium, The Netherlands or Germany.

  • Success: Initial website navigation
  • Failure: Couldn’t pass Cloudflare human verification

:bouquet:Ordering flowers at a local flower shop

Prompts:
-Go to the website of the flower store Degroote Bloemen in Wilrijk. Then navigate to the webshop. Then choose a bouquet of flowers for maximum 40€ and then place an order for pick-up tomorrow.

-Go to the website of the flower store Degroote Bloemen in Wilrijk and then search for a bouquet of flowers for maximum 40€ and then place an order for pick-up tomorrow.

Two variations tested:

  • Success: Reached website and webshop page
  • Failure: Couldn’t progress beyond initial shop page navigation

:mag_right:Key observations

  1. Basic navigation works well
  2. Simple search functions are generally successful
  3. Common failure points:
    • Complex multi-step processes
    • Pop-up interactions
    • Human verification systems
    • Advanced filtering and selection tasks

In other words: none of my planned use-cases work right now :face_with_peeking_eye:

I’ll need to wait for the “teach mode” to see if it can learn how to navigate selection menus, dropdowns, verification systems, and similar interfaces.

Currently, it really struggles with complex interactions, especially those requiring multiple steps or dealing with security measures.

I’m open to feedback on my prompt structure or suggestions for variations to test!

3 Likes