Doubao Say
14/14 cases passed
| Result | Case | Duration | Node screenshot | AI response / error |
|---|---|---|---|---|
| ✅ Passed | Cancel sign-in and retry | 3m29s | ![]() |
AI: The screenshot shows a mobile app interface for "Doubao Say" (豆包·说). The page displays a microphone icon at the top, with a title "Microphone" (麦克风) and a subtitle indicating "Synthetic microphone one" (合成麦克风一) is selected. The interface appears to be in the microphone selection step, with options for synthetic microphones and a "Start" (开始) button at the bottom. The visible content confirms the page is the Microphone step with "Synthetic microphone one" selected. |
| ✅ Passed | Complete Doubao Say onboarding on a real desktop | 8m19s | ![]() |
AI: The screenshot shows a settings page with a "Setup" section. The visible setup control appears to be disabled (grayed out) and its label reads "Setup completed by the synthetic E2E fixture." This matches the statement exactly. |
| ✅ Passed | Recover from an endpoint failure | 1m34s | ![]() |
AI: The screenshot shows a page with a "Synthetic endpoint response" section. The displayed response includes a JSON object with "status": "ok" and "message": "Hello from the synthetic endpoint!". Below this, there is a button labeled "Endpoint works". The statement asks if the endpoint result contains "Synthetic endpoint response" and the button says "Endpoint works". Both conditions are visible in the screenshot. |
| ✅ Passed | Changing microphone requires another check | 6m27s | ![]() |
AI: The screenshot shows a setup wizard interface with a "Finish setup" button at the bottom right. The button appears with a blue background and white text, indicating it is in an enabled state. There is no visual indication (such as graying out or a disabled style) that would suggest the button is disabled. Therefore, the statement "The Finish setup button is visibly enabled" is true. |
| ✅ Passed | Capture and retain a custom trigger shortcut | 3m03s | ![]() |
AI: The screenshot shows a settings page for a keyboard/mouse trigger configuration. The page displays a "Trigger" section with a key combination shown as "⌃ + F8". The text "⌃ + F8" appears in a highlighted/selected state (with a blue background), indicating it is the currently selected trigger. The page also shows other options like "⌃ + F9", "⌃ + F10", etc., but "⌃ + F8" is clearly marked as active/selected. The page title or header indicates this is the trigger key settings page. |
| ✅ Passed | Toggle polishing without losing configuration | 1m43s | ![]() |
AI: Based on the screenshot, I can see a settings panel with a blue toggle switch labeled "Voice polishing" that appears to be in the "on" position (blue background). Below it, there is a "Model" text field that visibly reads "synthetic-model". |
| ✅ Passed | Complete and cancel a voice test safely | 5m36s | ![]() |
AI: The screenshot shows a settings page with a "Voice test" section. The "Start voice test" button is visible and appears to be enabled (not grayed out). Below it, there is a setup control that displays "Voice test passed" with a green checkmark. The page does not show any pasted content or sent messages in this area. The statement appears to be true based on the visible elements. |
| ✅ Passed | Switch to Volcengine and validate credentials | 4m19s | ![]() |
AI: The screenshot shows a microphone setup page with a title "Let's make sure we can hear you." and a subtitle "We'll do a quick sound check." There is a microphone icon and a "Start" button below. The page appears to be part of a voice assistant or audio setup flow. |
| ✅ Passed | Switch to Deepgram English recognition | 2m20s | ![]() |
AI: The screenshot shows a settings or configuration page for a speech API integration. There is a section labeled "API Key" with an input field containing a value, and a "Test" button. Below that, there is a section for "Synthetic Endpoint" with a URL field and a "Test" button. The page also displays status indicators: one shows "API Key Valid" with a green checkmark, and another shows "Synthetic Endpoint Connected" with a green checkmark. Additionally, there is a "Speech API" section with a status showing "Ready" and a green checkmark. The overall layout indicates that the API key has been accepted by the synthetic endpoint and the speech API is ready for use. |
| ✅ Passed | Deliver one synthetic dictation to the focused target | 1m41s | ![]() |
AI: The screenshot shows a page with a field labeled "Synthetic dictation" containing the value "Synthetic dictation delivered exactly once". Below it, there is a status section showing "Delivered once" with a count of "1 delivery". The information matches the statement exactly. |
| ✅ Passed | Preserve signed-in account across backward navigation | 2m28s | ![]() |
AI: The screenshot shows a microphone setup page with a title "Let's make sure we can hear you." and a subtitle "We'll do a quick sound check." There is a microphone icon and a "Start sound check" button. The page appears to be part of a voice assistant setup flow. |
| ✅ Passed | Require an enabled trigger and retain the replacement | 2m27s | ![]() |
AI: The screenshot shows a dialog or panel with a "Trigger" section. There is a dropdown labeled "Trigger" with the value "F8" displayed. Below it, there is a key step section showing "Active trigger F8" with a highlighted/selected state. The text "Active trigger F8" is visible, and the dropdown shows "F8" as the selected option. This matches the statement that the Trigger key step still shows Active trigger F8 and F8 is selected in the trigger dropdown. |
| ✅ Passed | Microphone check gates setup completion | 3m34s | ![]() |
AI: The screenshot shows a setup wizard interface with a "Finish setup" button at the bottom right. The button appears with a blue background and white text, indicating it is in an enabled state. There is no visual indication (such as graying out or a disabled style) that would suggest the button is disabled. Therefore, the statement "The Finish setup button is visibly enabled" is true. |
| ✅ Passed | Cancel synthetic dictation without delivering text | 1m38s | ![]() |
AI: The screenshot shows a Synthetic dictation delivery target window. The text field contains "Synthetic dictation delivered exactly once." and the status displays "Delivered once · 1 delivery". |
Omarchy visual checks
1/1 cases passed
| Result | Case | Duration | Node screenshot | AI response / error |
|---|---|---|---|---|
| ✅ Passed | System menu text and focused row are visible | 55s | ![]() |
AI: The screenshot shows a desktop environment with a vertical bar on the left edge. The bar appears tall and narrow, extending from the top to the bottom of the screen, consistent with a docked vertical panel. There is no horizontal bar visible across the top or bottom of the desktop. |














