Doubao Say
12/13 cases passed
| Result | Case | Duration | Node screenshot | AI response / error |
|---|---|---|---|---|
| ✅ Passed | Cancel sign-in and retry | 3m12s |  |
AI: The screenshot shows a Doubao Say page with a microphone icon and a selection panel. The visible options include "Synthetic microphone one" which appears selected, and the page appears to be in the Microphone step based on the layout and labels. |
| ✅ Passed | Complete Doubao Say onboarding on a real desktop | 8m26s |  |
AI: The screenshot shows a settings page with a "Setup" section. The visible setup control appears to be disabled (grayed out) and its label reads "Setup completed by the synthetic E2E fixture." This matches the statement exactly. |
| ✅ Passed | Recover from an endpoint failure | 2m06s |  |
AI: The screenshot shows a page with a "Synthetic" section. There is a green checkmark icon next to "Synthetic" and a message indicating "All systems operational". Below that, there is a table with columns for "Endpoint", "Status", and "Response time". The table lists several endpoints, all showing a green "Operational" status. There is no visible error message or indication of an "unavailable" error. The successful endpoint results (status and response times) are clearly visible. |
| ✅ Passed | Changing microphone requires another check | 6m17s |  |
AI: The screenshot shows a setup wizard interface with a "Finish setup" button at the bottom right. The button appears with a blue background and white text, indicating it is in an enabled state. There is no visual indication (such as graying out or a disabled style) that would suggest the button is disabled. Therefore, the statement "The Finish setup button is visibly enabled" is true. |
| ✅ Passed | Capture and retain a custom trigger shortcut | 3m19s |  |
AI: The screenshot shows a settings page for a keyboard/mouse trigger configuration. The page displays a "Trigger" section with a key combination shown as "⌃ + F8". The text "⌃ + F8" appears in a highlighted/selected state (with a blue background), indicating it is the currently selected trigger. The page also shows other options like "⌃ + F9", "⌃ + F10", etc., but "⌃ + F8" is clearly marked as active/selected. The page title or header indicates this is the trigger key settings page. |
| ❌ Failed | Toggle polishing without losing configuration | 36s |  |
Error: Node "aiAssert" failed: Node "aiAssert" failed: Assertion failed: Voice polishing disabled is visible, the switch is off, and the polishing Base URL and Model fields are hidden. Reason: Based on the screenshot, I can see a settings panel with a "Voice polishing" section. The section shows a toggle switch that appears to be in the "off" position (gray/disabled state). Below the toggle, there is a "Base URL" field and a "Model" field, both of which are visible and contain values. Since the Base URL and Model fields are visible, the statement that they are hidden is false. |
| ✅ Passed | Complete and cancel a voice test safely | 5m04s |  |
AI: Based on the screenshot, I can see a setup control that says "Voice test passed" and there is no indication of anything pasted or sent. The "Start voice test" button appears to be available again (not disabled). |
| ✅ Passed | Switch to Volcengine and validate credentials | 5m54s |  |
AI: The screenshot shows a mobile app interface with a dark background. There is a circular button in the center with a microphone icon, and text below it that appears to say "Microphone" or similar. The interface appears to be a voice recording or speech-to-text feature. Based on the visible elements, the current step appears to be related to the microphone. |
| ✅ Passed | Deliver one synthetic dictation to the focused target | 1m41s |  |
AI: The screenshot shows a page with a field labeled "Synthetic dictation" containing the value "Synthetic dictation delivered exactly once". Below it, there is a status section showing "Delivered once" with a count of "1 delivery". The information matches the statement exactly. |
| ✅ Passed | Preserve signed-in account across backward navigation | 2m56s |  |
AI: The screenshot shows a microphone setup step in what appears to be a voice assistant or speech recognition configuration flow. The visible text includes "Let's make sure we can hear you" prominently displayed, along with a microphone icon and a "Continue" button. This matches the statement about the Microphone step showing that exact phrase. |
| ✅ Passed | Require an enabled trigger and retain the replacement | 2m12s |  |
AI: The screenshot shows a dialog or panel with a "Trigger" section. There is a dropdown labeled "Trigger" with the value "F8" displayed. Below it, there is a key step section showing "Active trigger F8" with a highlighted/selected state. The text "Active trigger F8" is visible, and the dropdown shows "F8" as the selected option. This matches the statement that the Trigger key step still shows Active trigger F8 and F8 is selected in the trigger dropdown. |
| ✅ Passed | Microphone check gates setup completion | 3m55s |  |
AI: The screenshot shows a setup wizard interface with a "Finish setup" button at the bottom right. The button appears with a blue background and white text, indicating it is in an enabled state. There is no visual indication (such as graying out or a disabled style) that would suggest the button is disabled. Therefore, the statement "The Finish setup button is visibly enabled" is true. |
| ✅ Passed | Cancel synthetic dictation without delivering text | 3m17s |  |
AI: The screenshot shows a UI with a "New Attempt" section. There is a status indicator showing "1 delivery" and a delivered sentence displayed. The status text appears to confirm exactly one delivery was made. |
Omarchy visual checks
1/1 cases passed
| Result | Case | Duration | Node screenshot | AI response / error |
|---|---|---|---|---|
| ✅ Passed | System menu text and focused row are visible | 59s |  |
AI: The screenshot shows a desktop environment with a vertical bar on the left side of the screen. The bar appears tall and is docked to the left edge, with icons arranged vertically. There is no horizontal bar visible at the top or bottom of the screen. The left vertical bar is clearly distinguishable as the Omarchy bar based on its position and orientation. |