Doubao Say
13/13 cases passed
| Result | Case | Node screenshot | AI response / error |
|---|---|---|---|
| ✅ Passed | Cancel sign-in and retry |  |
AI: The screenshot shows the "Doubao Say" application window is currently active and visible. The content within the window displays a navigation bar with "Microphone" selected as the current step. Below this, there is a section titled "Let's make sure we can hear you," which involves checking the microphone input. Additionally, a status message at the bottom reads "Recognition is ready. Let's check your microphone next." This confirms that the application has moved past the sign-in phase (indicated by "Sign-in saved") and is now on the Microphone verification step. |
| ✅ Passed | Recover from an endpoint failure |  |
AI: Based on the screenshot, I can observe the following: 1. There is a text line that reads "Endpoint works: Synthetic endpoint response". 2. There is a button labeled "Endpoint works ✓", which appears enabled/active. 3. There is no visible error message stating "Synthetic endpoint unavailable". Therefore, all parts of the statement in the DATA_DEMAND are confirmed to be true based on the visual evidence. |
| ✅ Passed | Changing microphone requires another check |  |
AI: The screenshot shows the "Doubao Say" application window. At the bottom of the main content area, there is a blue button labeled "Finish setup". The button has a solid blue background and white text, indicating it is in an active, enabled state (as opposed to being grayed out or disabled). Therefore, the statement that the Finish setup button is visibly enabled is true. |
| ✅ Passed | Capture and retain a custom trigger shortcut |  |
AI: The screenshot displays the "Trigger key" page of the Doubao Say application. Under the section "Choose how to start speaking," there is a line stating "Active trigger: ^ + F8". Additionally, the dropdown menu below this text shows the selected value as "^ + F8". The symbol "^" corresponds to the Control key (often represented as ⌃ on Mac keyboards or Ctrl on Windows), confirming that the custom shortcut involving F8 is indeed the active and selected trigger. |
| ✅ Passed | Complete Doubao Say onboarding on a real desktop |  |
AI: The screenshot shows the "Doubao Say" application on the "Voice test" page. At the bottom of the voice test panel, there is a button-like element that is grayed out (disabled appearance) and contains the text "Setup completed by the synthetic E2E fixture.". This matches the description in the statement regarding the button's status and text. |
| ✅ Passed | Toggle polishing without losing configuration |  |
AI: The screenshot shows the "Doubao Say" application interface. Under the "Voice polishing" section, there is a field labeled "Model". The value entered in this input field is clearly visible as "synthetic-model". This matches the statement in the data demand exactly. |
| ✅ Passed | Complete and cancel a voice test safely |  |
AI: The screenshot shows the "Doubao Say" application interface. At the bottom of the main content area, there is a large blue button that appears enabled (active color). The text on this button reads "Finish setup · Voice test passed · nothing pasted or sent". This matches the statement in the data demand exactly. |
| ✅ Passed | Switch to Volcengine and validate credentials |  |
AI: The screenshot shows the "Doubao Say" application interface. In the navigation bar near the top, the word "Microphone" is clearly visible and appears to be the active step. Below this, there is a prominent heading that reads "Let's make sure we can hear you.". Both conditions specified in the statement are present in the image. |
| ✅ Passed | Deliver one synthetic dictation to the focused target |  |
AI: Based on the screenshot, the large white circular overlay graphic seen in previous states is no longer present (or at least not obscuring the content). The text input field clearly contains the text "Synthetic dictation delivered exactly once." which is highlighted. Below the input field, the status text reads "Delivered once · 1 delivery". All conditions in the statement are met. |
| ✅ Passed | Preserve signed-in account across backward navigation |  |
AI: The screenshot displays the "Doubao Say" application interface. The active tab is labeled "Microphone". The main content area prominently features the heading "Let's make sure we can hear you." Additionally, there is a status message at the top stating "Sign-in saved", and no separate sign-in window or modal is visible on the screen. Therefore, both conditions of the statement are met. |
| ✅ Passed | Require an enabled trigger and retain the replacement |  |
AI: The screenshot displays the "Trigger key" step of the Doubao Say application. Within the content area, there is a line of text that explicitly reads "Active trigger: F8". Additionally, below this text, there is a dropdown menu for selecting a trigger key, and the value currently displayed in this dropdown is "F8". Both conditions mentioned in the statement are visually confirmed. |
| ✅ Passed | Microphone check gates setup completion |  |
AI: The screenshot shows the "Doubao Say" application interface. At the bottom of the main content area, there is a blue button labeled "Finish setup". The button has a solid blue background and white text, which contrasts with the disabled state (typically grayed out) seen in the navigation arrows above it. This visual styling indicates that the button is active and enabled. |
| ✅ Passed | Cancel synthetic dictation without delivering text |  |
AI: The screenshot shows a window titled "Synthetic dictation delivery". Inside, there is a text box containing the sentence "Synthetic dictation delivered exactly once." Below this text box, there is a status line that reads "Delivered once · 1 delivery". This confirms that a synthetic sentence was delivered and the count is exactly one, matching the statement in the data demand. |
Polishing overlay report
1/1 cases passed
| Result | Case | Node screenshot | AI response / error |
|---|---|---|---|
| ✅ Passed | Polishing status stays separate from synthetic transcript |  |
AI: The screenshot shows the "Polishing overlay test controls" window clearly visible in the top-left corner. The background is black with a white Ubuntu logo, and there is no dark transcript overlay text or box visible on the screen. Therefore, the statement that the dark transcript overlay is gone and the test controls window remains visible is accurate. |