Doubao Say
13/14 cases passed
| Result | Case | Duration | Node screenshot | AI response / error |
|---|---|---|---|---|
| ✅ Passed | Cancel sign-in and retry | 3m19s | ![]() |
AI: The screenshot shows a mobile app interface for "Doubao Say" (豆包·说). The page displays a microphone icon at the top, with a title "Microphone" (麦克风) and a subtitle indicating the current step. Below, there is a selection list with options for "Synthetic microphone one" (合成麦克风一) and "Synthetic microphone two" (合成麦克风二). The "Synthetic microphone one" option appears highlighted or selected, as indicated by a checkmark or highlighted background. The page also shows a "Next" (下一步) button at the bottom. Based on this, the visible page is indeed the Microphone step, and "Synthetic microphone one" is selected. |
| ✅ Passed | Complete Doubao Say onboarding on a real desktop | 8m58s | ![]() |
AI: The screenshot shows a settings page with a "Setup" section. The visible setup control appears to be disabled (grayed out) and its label reads "Setup completed by the synthetic E2E fixture." This matches the statement exactly. |
| ✅ Passed | Recover from an endpoint failure | 2m22s | ![]() |
AI: The screenshot shows a page with a "Synthetic endpoint response" section and a button labeled "Endpoint works". The endpoint result contains the synthetic response, and the button text matches the statement. |
| ✅ Passed | Changing microphone requires another check | 6m00s | ![]() |
AI: The screenshot shows a mobile or desktop setup page with a "Finish setup" button at the bottom. The button appears to be visually distinct, with a filled background color (likely blue or similar), indicating it is in an enabled state. There is no indication of it being grayed out or disabled. The button text is clearly visible and the overall styling suggests it is interactive and ready for use. |
| ✅ Passed | Capture and retain a custom trigger shortcut | 3m42s | ![]() |
AI: The screenshot shows a settings page for a keyboard shortcut or trigger configuration. The page displays a section labeled "Trigger" with a key combination shown as "⌃ + F8". The text indicates this is the currently active trigger, and the row appears highlighted or selected in the list. The statement asks whether the Trigger key page still shows ⌃ plus F8 as both the active and selected trigger. Based on the visible content, the page displays "⌃ + F8" as the trigger, and the row appears to be the selected one in the list. |
| ✅ Passed | Toggle polishing without losing configuration | 1m53s | ![]() |
AI: The screenshot shows a settings panel with a "Voice polishing" toggle switch that is blue and positioned to the right, indicating it is on. Below it, there is a "Model" text field that visibly contains the text "synthetic-model". Both conditions in the statement are satisfied. |
| ✅ Passed | Complete and cancel a voice test safely | 6m26s | ![]() |
AI: The screenshot shows a setup control labeled "Voice test" with a green checkmark and the text "Voice test passed" next to it. The "Start voice test" button appears to be enabled and available again. There is no visible indication of anything pasted or sent in the screenshot. |
| ✅ Passed | Switch to Volcengine and validate credentials | 5m28s | ![]() |
AI: The screenshot shows a microphone setup step in what appears to be a voice assistant or speech recognition configuration flow. The visible text includes "Let's make sure we can hear you" prominently displayed on the screen, along with a microphone icon and a "Continue" button. This matches the statement about the Microphone step showing that exact phrase. |
| ✅ Passed | Switch to Deepgram English recognition | 2m00s | ![]() |
AI: The screenshot shows a page with a "Synthetic Endpoint" section and an "API Key" input field. There is a status indicator or message visible that suggests the API key has been accepted and the speech API is ready. The page appears to be in a state where the connection to the synthetic endpoint is established and the speech API is operational, as indicated by the visual cues in the screenshot. |
| ✅ Passed | Deliver one synthetic dictation to the focused target | 1m42s | ![]() |
AI: The screenshot shows a page with a "Synthetic dictation" section. The target field contains the text "Synthetic dictation delivered exactly once" and the status displays "Delivered once with 1 delivery". The statement matches exactly what is visible in the screenshot. |
| ✅ Passed | Preserve signed-in account across backward navigation | 2m33s | ![]() |
AI: The screenshot shows a microphone setup page with a title "Let's make sure we can hear you." and a subtitle "We'll do a quick sound check." There is a microphone icon and a "Start sound check" button. The page appears to be part of a voice assistant setup flow. |
| ✅ Passed | Require an enabled trigger and retain the replacement | 2m16s | ![]() |
AI: The screenshot shows a dialog or panel with trigger configuration options. There is a "Trigger" section with a dropdown that displays "F8" as the selected value. The text "Active trigger F8" is visible in the interface, indicating that F8 is the active trigger and is selected in the dropdown. |
| ✅ Passed | Microphone check gates setup completion | 5m01s | ![]() |
AI: Based on the screenshot, I can see a "Finish setup" button at the bottom of the page. The button appears to be visually distinct with a blue background and white text, indicating it is in an enabled state. There is no indication of it being grayed out or disabled. |
| ❌ Failed | Cancel synthetic dictation without delivering text | 1m58s | ![]() |
Error: Node "aiWaitFor" failed: waitFor timeout: The screenshot shows a dialog or overlay with a title "Wait for" and a message indicating that the operation was cancelled. The status text reads "Cancelled" and there is a note that no text was delivered. The interface appears to be ready for the user to try again, with a button labeled "Try again" visible. The overlay is present in the screenshot, not gone. |
Omarchy visual checks
1/1 cases passed
| Result | Case | Duration | Node screenshot | AI response / error |
|---|---|---|---|---|
| ✅ Passed | System menu text and focused row are visible | 53s | ![]() |
AI: The screenshot shows a desktop environment with a vertical bar on the left edge. The bar is tall, extending from the top to the bottom of the screen, and is positioned along the left side. It contains icons and appears to be a dock or launcher. There is no horizontal bar visible at the top or bottom of the screen. |














