Doubao Say
11/13 cases passed
| Result | Case | Duration | Node screenshot | AI response / error |
|---|---|---|---|---|
| ✅ Passed | Cancel sign-in and retry | 1m35s | ![]() |
AI: The screenshot shows a mobile app interface with a large circular microphone button in the center, surrounded by a waveform animation. The top of the screen displays "豆包" (Doubao) branding. There is no visible sign-in window or modal overlay. The interface appears to be in a voice input/microphone recording state, consistent with the "Microphone step" of a voice assistant flow. No login prompts or authentication windows are present in the visible content. |
| ✅ Passed | Complete Doubao Say onboarding on a real desktop | 2m03s | ![]() |
AI: The screenshot shows a settings page with a "Setup" section. There is a disabled control (grayed out) that displays the text "Setup completed by the synthetic E2E fixture." This matches the statement exactly. |
| ✅ Passed | Recover from an endpoint failure | 1m08s | ![]() |
AI: The screenshot shows a page with a "Synthetic" section. There is a green checkmark icon next to "Synthetic" and a status message indicating "Synthetic endpoint is available". Below, there is a "Test endpoint" button and a result area showing a successful response with a status code 200 and a JSON body. No error message about an unavailable endpoint is visible. |
| ✅ Passed | Changing microphone requires another check | 1m23s | ![]() |
AI: The screenshot shows a mobile or desktop setup page with a "Finish setup" button at the bottom. The button appears to be visually distinct, with a filled background color (likely blue or similar), indicating it is in an enabled state. There is no indication of it being grayed out or disabled. The button text is clearly visible and the button appears clickable based on its styling. |
| ✅ Passed | Capture and retain a custom trigger shortcut | 1m44s | ![]() |
AI: The screenshot shows a settings page for a keyboard/mouse trigger configuration. The page displays a "Trigger" section with a key combination shown as "⌃ + F8" in a highlighted/selected state. The text "⌃ + F8" appears to be both the active trigger and the selected option, as it is highlighted with a blue background and there is no other trigger selected. The page also shows other options like "⌃ + F9" and "⌃ + F10" but they are not selected. The current trigger displayed prominently is "⌃ + F8". |
| ✅ Passed | Toggle polishing without losing configuration | 1m08s | ![]() |
AI: The screenshot shows a settings panel with a "Voice polishing" toggle switch that appears to be in the ON position (the switch is highlighted/colored). Below it, there is a "Model" input field that contains the text "synthetic-model". The input field displays exactly "synthetic-model" without any additional characters or spaces visible. |
| ❌ Failed | Complete and cancel a voice test safely | 9m15s | ![]() |
Error: Node "aiAct" timed out after 480000ms. |
| ✅ Passed | Switch to Volcengine and validate credentials | 3m11s | ![]() |
AI: The screenshot shows a mobile interface with a dark theme. At the top, there is a header with a back arrow and the title "Microphone" displayed. Below the header, there is a large circular area with a microphone icon in the center, surrounded by a waveform-like visualization. At the bottom, there is a button labeled "Start Recording" and a text field with placeholder "Enter text here". The title and the prominent microphone icon clearly indicate that the current step is Microphone. |
| ✅ Passed | Deliver one synthetic dictation to the focused target | 38s | ![]() |
AI: The screenshot shows a page with a "Synthetic dictation" section. The target field contains the text "Synthetic dictation delivered exactly once" and the status displays "Delivered once with 1 delivery". The statement matches exactly what is visible in the screenshot. |
| ❌ Failed | Preserve signed-in account across backward navigation | 52s | ![]() |
Error: Node "aiWaitFor" failed: waitFor timeout: The screenshot shows a login/sign-in page with a Doubao branding. The page includes a title "登录抖音" (Login to Douyin), a phone number input field, a verification code input field, a "获取验证码" (Get verification code) button, and a "登录" (Login) button. There is also a checkbox for agreeing to the user agreement and privacy policy. The interface appears to be a standard Douyin login page, not specifically labeled as "CI-only Synthetic Doubao" or indicating a synthetic/test environment. The page is a typical sign-in window for Douyin, not a synthetic or CI-specific variant. |
| ✅ Passed | Require an enabled trigger and retain the replacement | 3m45s | ![]() |
AI: The screenshot shows a dialog or panel with a "Trigger" section. There is a dropdown labeled "Trigger" with the value "F8" displayed. Below it, there is a key step section showing "Active trigger F8" with a highlighted/selected state. The text "Active trigger F8" is visible, and the dropdown shows "F8" as the selected option. This matches the statement that the Trigger key step still shows Active trigger F8 and F8 is selected in the trigger dropdown. |
| ✅ Passed | Microphone check gates setup completion | 1m17s | ![]() |
AI: Based on the screenshot, I can see a setup page with a "Finish setup" button at the bottom. The button appears to be visually distinct with a blue background, indicating it is enabled and clickable. |
| ✅ Passed | Cancel synthetic dictation without delivering text | 49s | ![]() |
AI: The screenshot shows a page with a "SMS" section. There is a "New attempt" button and a table with columns including "Status", "Delivered", "Failed", and "Sent". The table shows one row with a status of "Delivered" and the "Delivered" column shows "1". The "Failed" column shows "0" and the "Sent" column shows "1". This indicates that a new attempt succeeded with exactly one delivered synthetic sentence and the status reports 1 delivery. |
Omarchy visual checks
1/1 cases passed
| Result | Case | Duration | Node screenshot | AI response / error |
|---|---|---|---|---|
| ✅ Passed | System menu text and focused row are visible | 29s | ![]() |
AI: The screenshot shows a desktop environment with a dark theme. On the left edge of the screen, there is a tall vertical bar with icons arranged vertically, which appears to be a dock or panel. This bar is positioned along the left side of the desktop, not across the top or bottom. The bar contains several icons stacked vertically, consistent with a vertical dock on the left edge. |













