AI test analysis
Use AI-powered analysis to understand test failures and improve test coverage.
AI in Astra Scout can check what a screen looks like, explain why a run failed, and propose a fix. Setup comes right below.
WARNING
AI output is probabilistic. Treat an AI check as a helpful signal, not a guarantee. This is why AI commands default to optional: true: a failed AI check only reports a warning and does not stop the flow, unless you set optional: false.
Set up AI
The AI features run on an AI command-line tool (AI CLI) that is already installed and signed in on your Mac. Astra Scout supports three: Claude Code, OpenAI Codex, and Gemini CLI. You need only one.
- Install one tool and sign in with your own account.
- In Astra Scout, open Settings → Intelligence → Agents and click Rescan.
- The tool shows "Ready" when it is usable.
Astra Scout needs no API key or separate account. Only the AI features need the AI tool; plain flows run without it.
AI-powered assertions in your flows
You can use AI right in a flow with these commands. Astra Scout runs them with the AI tool you set up:
assertWithAI: verify a complex UI state in natural language, for example "Verify the user is shown a success message in Spanish".assertNoDefectsWithAI: check the current screen for common UI issues, such as clipped or overlapping text, a blank screen, or a broken layout.extractTextWithAI: read a piece of text from the screen into a variable.
- launchApp
- assertWithAI: "The screen shows a Sign in button"
- assertNoDefectsWithAIUnderstand and fix failures
When a run fails, Fix with AI explains why it failed and proposes a change to the flow. Auto-Fix… repeats this until the flow passes. The pass or fail verdict of a run always comes from the results of each step, never from the AI. See Run flows.
Want to check for UI issues?
Astra Scout does not produce an HTML report about spelling or grammar. Put assertNoDefectsWithAI on the screens you care about.
Next steps
See the reference pages for assertWithAI and assertNoDefectsWithAI.