LAM playground R1 voice access frustration

lam, teach mode & agents
1

Using LAM Playground web version is fine, but using the R1 to access LAM Playground R1 is a hit or miss for me, and usually a miss. It mostly says it is unable to directly access websites or gmail.

Is there a magic phrase / specific wording that can be used to force the R1 to use LAM Playground?

3 Likes
2

It would make it more reliable to have a trigger word like we had with ‘beta rabbit’… something like ‘use playground’ at least as long as the system is not reliable.

I wonder how we can make the system more robust with its tool triage tho. Because it’s also great to not have to use trigger words and phrases ofcourse.

1 Like
3

I’ve had success with:

  • Starting a session:
    • “Go to www.example.com and …”
    • “Go to my Google calendar and …”
    • “On amazon.com, find …”
    • “Go to the Rabbit City Library website and …”
  • In the middle of a session (when it’s ready or even interrupted):
    • “Using what you already see on LAM Playground, do …”
    • “Click the X button on the Y page in order to …”
3 Likes
4

We’ve definitely been working on improving the triage for this and you should notice higher accuracy soon.

Typically, “browse website.com and do 123” is a pretty solid phrase to use.

4 Likes
5

Query using the 14 November release:

  • “Browse gmail.com and create a new email”
  • “Go to gmail.com and create a new email”

Both give the same response:
I’m unable to assist with accessing Gmail or creating emails directly. For security and privacy reasons, it’s best to handle such tasks directly through your browser. If you have any other questions or need assistance with something else, feel free to ask!

It would be helpful to have some way of directing LAM Playground. I have currently no idea how to use LAM Playground to gmail using voice control (the R1)…

1 Like