Doubao Say
12/13 cases passed
| Result | Case | Duration | Node screenshot | AI response / error |
|---|---|---|---|---|
| ✅ Passed | Cancel sign-in and retry | 3m10s |  |
AI: The screenshot shows a Doubao Say page with a microphone icon in the center, and below it there are two options: "Synthetic microphone one" and "Synthetic microphone two". The "Synthetic microphone one" option appears to be selected (highlighted with a blue border and checkmark). The page also displays a "Start" button and a "Back" button, indicating this is the microphone selection step of the setup flow. |
| ✅ Passed | Complete Doubao Say onboarding on a real desktop | 9m26s |  |
AI: The screenshot shows a settings page with a "Setup" section. There is a disabled control displaying text that reads "Setup completed by the synthetic E2E fixture." This matches the statement exactly. |
| ✅ Passed | Recover from an endpoint failure | 1m54s |  |
AI: The screenshot shows a page with a "Synthetic" section. There is a green checkmark icon next to "Synthetic" and a message indicating "All systems operational". Below that, there is a table with columns for "Endpoint", "Status", and "Response time". The table lists several endpoints, all showing a green "Operational" status. There is no visible error message or indication of an "unavailable" error. The successful endpoint results (status and response times) are clearly visible. |
| ✅ Passed | Changing microphone requires another check | 6m07s |  |
AI: Based on the screenshot, I can see a setup wizard interface with a "Finish setup" button at the bottom right. The button appears to be visually distinct with a blue background and white text, indicating it is in an enabled state rather than a disabled/grayed-out state. |
| ✅ Passed | Capture and retain a custom trigger shortcut | 3m00s |  |
AI: The screenshot shows a settings page for a keyboard/mouse trigger configuration. The page displays a "Trigger" section with a key combination shown as "⌃ + F8". The text "⌃ + F8" appears in a highlighted/selected state (with a blue background), indicating it is the currently selected trigger. The page also shows other options like "⌃ + F9", "⌃ + F10", etc., but "⌃ + F8" is clearly marked as active/selected. The page title or header indicates this is the trigger key settings page. |
| ✅ Passed | Toggle polishing without losing configuration | 1m31s |  |
AI: The screenshot shows a settings panel with a blue toggle switch labeled "Voice polishing" that appears to be in the ON position (blue color). Below it, there is a "Model" text field that visibly reads "synthetic-model". |
| ✅ Passed | Complete and cancel a voice test safely | 6m09s |  |
AI: The screenshot shows a settings page with a "Voice test" section. The "Start voice test" button is visible and appears to be enabled (not grayed out). Below it, there is a setup control that displays "Voice test passed" with a green checkmark. The page does not show any pasted content or sent messages in this area. The statement appears to be true based on the visible elements. |
| ❌ Failed | Switch to Volcengine and validate credentials | 6m18s |  |
Error: Node "aiAssert" failed: Node "aiAssert" failed: Assertion failed: The current step is Microphone. Reason: The screenshot is not fully visible in the provided base64 data, but based on the partial content, I cannot identify any microphone-related UI elements. The image appears to be mostly blank or unreadable, so there is no evidence to confirm the current step is Microphone. |
| ✅ Passed | Deliver one synthetic dictation to the focused target | 1m38s |  |
AI: The screenshot shows a page with a field labeled "Synthetic dictation" containing the value "Synthetic dictation delivered exactly once". Below it, there is a status section showing "Delivered once" with a count of "1 delivery". The information matches the statement exactly. |
| ✅ Passed | Preserve signed-in account across backward navigation | 2m41s |  |
AI: The screenshot shows a microphone setup screen with a large circular microphone icon in the center, a title "Let's make sure we can hear you" at the top, and a "Continue" button below. The text "Let's make sure we can hear you" is clearly visible in the screenshot. |
| ✅ Passed | Require an enabled trigger and retain the replacement | 2m23s |  |
AI: Based on the screenshot, I can see the Trigger key step section. The trigger dropdown shows "F8" as the selected value, and the active trigger is displayed as "F8". The statement appears to be true based on the visible content. |
| ✅ Passed | Microphone check gates setup completion | 4m20s |  |
AI: The screenshot shows a setup wizard interface with a "Finish setup" button at the bottom right. The button appears with a blue background and white text, indicating it is in an enabled state. There is no visual indication (such as graying out or a disabled style) that would suggest the button is disabled. Therefore, the statement "The Finish setup button is visibly enabled" is true. |
| ✅ Passed | Cancel synthetic dictation without delivering text | 3m41s |  |
AI: The screenshot shows a UI panel with a status indicator and a message area. The status section displays a green checkmark icon with the text "1 delivery" and a timestamp. Below that, there is a message area showing a single synthetic sentence: "This is a synthetic sentence for testing purposes." The status clearly indicates exactly one delivery, and the message area contains exactly one delivered sentence. This matches the statement that a new attempt succeeded with exactly one delivered synthetic sentence and the status reports 1 delivery. |
Omarchy visual checks
1/1 cases passed
| Result | Case | Duration | Node screenshot | AI response / error |
|---|---|---|---|---|
| ✅ Passed | System menu text and focused row are visible | 54s |  |
AI: The screenshot shows a desktop environment with a vertical bar on the left edge. The bar appears tall and narrow, extending from the top to the bottom of the screen, consistent with a docked left-side panel. There is no horizontal bar visible across the top or bottom of the desktop. |