AssertWithAI returning false instead of true

[alecalma]

Is there an existing issue for this?

• I have searched the existing issues and didn't find mine.

Steps to reproduce

Start Pixel 9 Pro API35 from AndroidStudio and install MySports app from PlayStore
Login and select ZSC as your favourite club

appId: com.w4a.mysports
tags:

• android
  --
• launchApp
• assertNotVisible:
  text: "Login"
• scrollUntilVisible:
  element:
  text: TABELLE
  direction: DOWN
• assertWithAI:
  assertion: the ZSC row has a different background than the other rows

Actual results

Normally the assert with AI works well or it's clear why the assert is failing, however there are cases like the one above where the assert is false and the explanation is wrong.

I tried to replicate it with chatGPT for web and the assert returns true. Can it be an implementation bug from your side?

Expected results

In the screenshots above, I expect the assert to be true.

About app

Native app for android mobile in ReactNative.

About environment

Pixel 9 Pro API35 from AndroidStudio.

Logs

Logs

<!-- Replace this line with your logs. *DO NOT* remove the backticks! -->

Maestro version

1.39.0

How did you install Maestro?

Homebrew

Anything else?

No response

[linear]

MA-2428 AssertWithAI returning false instead of true