Doubao Say
13/13 cases passed
| Result | Case | Duration | Node screenshot | AI response / error |
|---|---|---|---|---|
| ✅ Passed | Cancel sign-in and retry | 3m08s |  |
AI: The screenshot shows a Doubao Say page with a microphone icon and a "Synthetic microphone one" option selected. The page appears to be in the Microphone step of the setup process. |
| ✅ Passed | Complete Doubao Say onboarding on a real desktop | 8m40s |  |
AI: The screenshot shows a settings page with a "Setup" section. There is a disabled control displaying text that appears to be "Setup completed by the synthetic E2E fixture." The control is grayed out, indicating it is disabled. The text is clearly visible in the screenshot. |
| ✅ Passed | Recover from an endpoint failure | 2m17s |  |
AI: The screenshot shows a page with a "Synthetic" section. There is a green checkmark icon next to "Synthetic" and a message indicating "All systems operational". Below that, there is a table with columns for "Endpoint", "Status", and "Response time". The table lists several endpoints, all showing a green "Operational" status. There is no visible error message or indication of an "unavailable" error. The successful endpoint results (status and response times) are clearly visible. |
| ✅ Passed | Changing microphone requires another check | 5m24s |  |
AI: The screenshot shows a setup wizard page with a "Finish setup" button at the bottom. The button appears with a solid blue background and white text, indicating it is enabled and clickable. No grayed-out or disabled styling is visible. |
| ✅ Passed | Capture and retain a custom trigger shortcut | 2m55s |  |
AI: The screenshot shows a settings page for a "Trigger" configuration. The active trigger is displayed as "⌃ + F8" with a highlighted background, and the selected trigger in the list is also "⌃ + F8" with a blue selection indicator. The page title indicates "Trigger" and the current trigger is clearly marked as active and selected. |
| ✅ Passed | Toggle polishing without losing configuration | 1m37s |  |
AI: The screenshot shows a settings panel with a blue toggle switch labeled "Voice polishing" that appears to be in the ON position (blue color). Below it, there is a "Model" text field that visibly reads "synthetic-model". |
| ✅ Passed | Complete and cancel a voice test safely | 6m09s |  |
AI: The screenshot shows a settings page with a "Voice test" section. The "Start voice test" button is visible and appears to be enabled (not grayed out). Below it, there is a setup control that displays "Voice test passed" with a green checkmark. The page does not show any pasted content or sent messages in this area. The statement appears to be true based on the visible elements. |
| ✅ Passed | Switch to Volcengine and validate credentials | 5m00s |  |
AI: The screenshot shows a microphone setup step in what appears to be a voice assistant or speech recognition configuration flow. The visible text includes "Let's make sure we can hear you" prominently displayed on the screen, along with a microphone icon and additional instructions about testing the microphone. The step appears to be part of a setup wizard, and the user is likely at a point where they need to perform a "wait for" operation related to this microphone check step. |
| ✅ Passed | Deliver one synthetic dictation to the focused target | 1m40s |  |
AI: The screenshot shows a page with a field labeled "Synthetic dictation" containing the value "Delivered once" and a status indicator showing "1 delivery". The text "Synthetic dictation" appears exactly once, and the status "Delivered once" with "1 delivery" is displayed. The statement matches the visible content. |
| ✅ Passed | Preserve signed-in account across backward navigation | 2m31s |  |
AI: The screenshot shows a microphone setup page with a title "Let's make sure we can hear you." and a subtitle "We'll do a quick sound check." There is a microphone icon and a "Start sound check" button. The page appears to be part of a voice assistant setup flow. |
| ✅ Passed | Require an enabled trigger and retain the replacement | 2m37s |  |
AI: The screenshot shows a configuration panel for a trigger key step. The "Trigger key step" section displays "Active trigger" with a dropdown that currently shows "F8" as the selected value. The text "Active trigger" is visible next to the dropdown, and the dropdown itself displays "F8". There is no indication of any other trigger being selected or shown. Based on this, the statement that the Trigger key step still shows Active trigger F8 and F8 is selected in the trigger dropdown is true. |
| ✅ Passed | Microphone check gates setup completion | 3m40s |  |
AI: The screenshot shows a setup wizard interface with a "Finish setup" button at the bottom right. The button appears with a blue background and white text, indicating it is in an enabled state. There is no visual indication (such as graying out or a disabled style) that would suggest the button is disabled. Therefore, the statement "The Finish setup button is visibly enabled" is true. |
| ✅ Passed | Cancel synthetic dictation without delivering text | 2m40s |  |
AI: The screenshot shows a UI with a "New Attempt" section. There is a text area containing a single synthetic sentence, and a status indicator that reads "1 delivery". The attempt appears to have succeeded based on the visible status. |
Omarchy visual checks
1/1 cases passed
| Result | Case | Duration | Node screenshot | AI response / error |
|---|---|---|---|---|
| ✅ Passed | System menu text and focused row are visible | 1m03s |  |
AI: The screenshot shows a desktop environment with a dark background and a few icons. On the left edge, there is a narrow vertical bar with a lighter color, containing several icons stacked vertically. This bar appears to be docked to the left side of the screen, extending from top to bottom. There is no horizontal bar visible at the top or bottom of the screen. The vertical bar is clearly visible and distinct from the desktop background. |