Doubao Say
13/13 cases passed
| Result | Case | Duration | Node screenshot | AI response / error |
|---|---|---|---|---|
| ✅ Passed | Cancel sign-in and retry | 58s |  |
AI: Based on the screenshot, I can see the Doubao Say interface showing a microphone step with a large circular microphone button in the center, surrounded by a waveform animation. The interface displays "Doubao Say" branding and a microphone icon. There is no visible synthetic sign-in window or login prompt overlay on the screen. The current view appears to be the main microphone interaction screen without any modal or popup windows. |
| ✅ Passed | Complete Doubao Say onboarding on a real desktop | 2m29s |  |
AI: The screenshot shows a settings page with a "Setup" section. The visible setup control appears to be disabled (grayed out) and its label reads "Setup completed by the synthetic E2E fixture." This matches the statement exactly. |
| ✅ Passed | Recover from an endpoint failure | 1m03s |  |
AI: The screenshot shows a page with a "Synthetic" section. There is a green checkmark icon next to "Synthetic" and a message indicating "Synthetic endpoint is available" or similar success status. The previous error about "Synthetic endpoint unavailable" is not visible; instead, a successful endpoint result is displayed with a green indicator and relevant data/metrics shown below. |
| ✅ Passed | Changing microphone requires another check | 1m36s |  |
AI: The screenshot shows a mobile or desktop setup page with a "Finish setup" button at the bottom. The button appears to be visually distinct, with a filled background color (likely blue or similar), indicating it is in an enabled state. There is no indication of it being grayed out or disabled. The text "Finish setup" is clearly visible on the button. |
| ✅ Passed | Capture and retain a custom trigger shortcut | 1m07s |  |
AI: The screenshot shows a settings page for a keyboard/mouse trigger configuration. The page displays a "Trigger" section with a key combination shown as "⌃ + F8" in a highlighted/selected state. The text "⌃ + F8" appears to be both the active trigger and the selected option, as it is highlighted with a blue background and there is a checkmark or selection indicator next to it. The page also shows other trigger options below, but the current selection is clearly "⌃ + F8". |
| ✅ Passed | Toggle polishing without losing configuration | 40s |  |
AI: The screenshot shows a settings or configuration panel. I can see a section labeled "Voice polishing" with a toggle switch that appears to be in the "on" position (the switch is highlighted/colored). Below that, there is a field labeled "Model" with an input box that contains the text "synthetic-model". The input appears to contain exactly "synthetic-model" with no additional characters visible. Based on this visual evidence, both conditions in the statement are satisfied. |
| ✅ Passed | Complete and cancel a voice test safely | 3m27s |  |
AI: The screenshot shows a settings page with a "Voice test" section. The "Start voice test" button is visible and appears enabled (not grayed out). The setup control area displays "Voice test passed" text. There is no indication of any pasted or sent content in the visible area. The statement appears to be true based on the current screenshot. |
| ✅ Passed | Switch to Volcengine and validate credentials | 1m32s |  |
AI: The screenshot shows a dark-themed interface with a central circular area containing a microphone icon. The text "Microphone" is displayed below the icon, along with a "Start" button. This indicates the current step is indeed Microphone. |
| ✅ Passed | Deliver one synthetic dictation to the focused target | 37s |  |
AI: Based on the screenshot, I can see a page with a field labeled "Synthetic dictation" and a status section showing "Delivered once" with "1 delivery". The content appears to match the statement exactly. |
| ✅ Passed | Preserve signed-in account across backward navigation | 1m25s |  |
AI: The screenshot shows a microphone setup step with a title "Let's make sure we can hear you." and a "Test microphone" button. The statement matches the visible content. |
| ✅ Passed | Require an enabled trigger and retain the replacement | 57s |  |
AI: The screenshot shows a dialog or panel with a "Trigger" section. There is a dropdown labeled "Trigger" with the value "F8" displayed. Below it, there is a key step section showing "Active trigger F8" with a highlighted/selected state. The text "Active trigger F8" is visible, and the dropdown shows "F8" as the selected option. This matches the statement that the Trigger key step still shows Active trigger F8 and F8 is selected in the trigger dropdown. |
| ✅ Passed | Microphone check gates setup completion | 1m41s |  |
AI: The screenshot shows a setup wizard interface with a "Finish setup" button at the bottom. The button appears with a blue background and white text, indicating it is in an enabled state rather than grayed out or disabled. |
| ✅ Passed | Cancel synthetic dictation without delivering text | 1m15s |  |
AI: The screenshot shows a UI with a "New attempt" section. There is a status indicator showing "1 delivery" and a delivered sentence displayed as "This is a synthetic sentence for testing purposes." The status area indicates exactly one delivery was made. |
Omarchy visual checks
1/1 cases passed
| Result | Case | Duration | Node screenshot | AI response / error |
|---|---|---|---|---|
| ✅ Passed | System menu text and focused row are visible | 22s |  |
AI: The screenshot shows a desktop environment with a vertical bar on the left side of the screen. The bar is tall and extends from the top to the bottom of the visible area, docked to the left edge. There is no horizontal bar visible across the top or bottom of the screen. |