Omarchy 4.0.3 × Midscene

Run 35975668439 · 93.0% passed · GitHub Actions · Report history

Each image is the original page screenshot used by that node. Click a case or image to open the exact Midscene step and Agent replay.

Doubao Say

12/13 cases passed

Open native Midscene report 1 → Open native Midscene report 2 → Open native Midscene report 3 → Open native Midscene report 4 →

Result	Case	Duration	Node screenshot	AI response / error
✅ Passed	Cancel sign-in and retry	1m31s		AI: Based on the screenshot, I can see the Doubao Say interface showing a microphone step with a large circular microphone button in the center, surrounded by a waveform animation. The interface displays "Doubao Say" branding and a microphone icon. There is no visible synthetic sign-in window or login prompt overlay on the screen. The current view appears to be the main microphone interaction screen without any modal or popup windows.
✅ Passed	Complete Doubao Say onboarding on a real desktop	3m58s		AI: The screenshot shows a settings page with a "Setup" section. There is a disabled control displaying text that appears to be "Setup completed by the synthetic E2E fixture." The control is grayed out, indicating it is disabled. The text is clearly visible in the screenshot.
✅ Passed	Recover from an endpoint failure	44s		AI: The screenshot shows a page with a "Synthetic" section. There is a green checkmark icon next to "Synthetic" and a message indicating "Synthetic endpoint is available" with a success status. The previous error about the endpoint being unavailable is not visible; instead, a successful result is displayed.
✅ Passed	Changing microphone requires another check	1m26s		AI: Based on the screenshot, I can see a setup wizard interface with a "Finish setup" button at the bottom right. The button appears to be visually distinct with a blue background and white text, indicating it is in an enabled state rather than a disabled/grayed-out state.
✅ Passed	Capture and retain a custom trigger shortcut	1m07s		AI: The screenshot shows a settings page for a keyboard/mouse trigger configuration. The page displays a "Trigger" section with a key combination shown as "⌃ + F8". The text "⌃ + F8" appears in a highlighted/selected state (with a blue background), indicating it is the currently selected trigger. The page also shows other options like "⌃ + F9", "⌃ + F10", etc., but "⌃ + F8" is clearly marked as active/selected. The page title or header indicates this is the trigger key settings page.
✅ Passed	Toggle polishing without losing configuration	33s		AI: The screenshot shows a settings panel with a "Voice polishing" toggle switch that appears to be in the ON position (the switch is highlighted/colored). Below it, there is a "Model" input field that contains the text "synthetic-model". The input field displays exactly "synthetic-model" without any additional characters or spaces visible.
✅ Passed	Complete and cancel a voice test safely	3m52s		AI: The screenshot shows a setup control labeled "Voice test" with a green checkmark and the text "Voice test passed" next to it. The "Start voice test" button appears to be enabled and available again. There is no visible indication of anything pasted or sent in the screenshot.
✅ Passed	Switch to Volcengine and validate credentials	1m19s		AI: The screenshot shows a step indicator with three steps labeled "Microphone", "Speaker", and "Done". The "Microphone" step is highlighted with a blue background and white text, indicating it is the current active step. The other steps appear grayed out. Therefore, the statement "The current step is Microphone" is true.
✅ Passed	Deliver one synthetic dictation to the focused target	34s		AI: The screenshot shows a page with a "Synthetic dictation" section. The target field displays "Synthetic dictation delivered exactly once" and the status shows "Delivered once with 1 delivery". The text in the target field and the status match the statement exactly.
❌ Failed	Preserve signed-in account across backward navigation	1m52s		Error: Node "aiWaitFor" failed: waitFor timeout: The screenshot shows a Google sign-in page with the title "Sign in" and text indicating "Use your Google Account". There is an email input field and a "Next" button. The page appears to be the initial sign-in step where the user is prompted to enter their email, not showing a signed-in account status or options to sign in again or change account.
✅ Passed	Require an enabled trigger and retain the replacement	58s		AI: The screenshot shows a dialog or panel with a "Trigger" section. There is a dropdown labeled "Trigger" with the value "F8" displayed. Below it, there is a key step section showing "Active trigger F8" with a highlighted/selected state. The text "Active trigger F8" is visible, and the dropdown shows "F8" as the selected option. The overall UI indicates that F8 is both the active trigger and the selected value in the dropdown.
✅ Passed	Microphone check gates setup completion	1m12s		AI: The screenshot shows a mobile or desktop setup page with a "Finish setup" button at the bottom. The button appears to be visually distinct, with a filled background color (likely blue or similar), indicating it is in an enabled state. There is no indication of it being grayed out or disabled. The button text is clearly visible and readable, and no overlay or disabled styling is apparent. Based on the visual appearance, the button is enabled and clickable.
✅ Passed	Cancel synthetic dictation without delivering text	1m14s		AI: The screenshot shows a page with a "SMS" section. There is a "New attempt" button and a table listing attempts. The most recent attempt shows a status of "Delivered" with a delivery count of "1". The message content appears to be a single synthetic sentence. The status column indicates "Delivered" and the delivery count is 1, matching the statement's criteria.

Omarchy visual checks

1/1 cases passed

Open native Midscene report →

Result	Case	Duration	Node screenshot	AI response / error
✅ Passed	System menu text and focused row are visible	29s		AI: The screenshot shows a desktop environment with a vertical bar on the left edge. The bar is tall, extending from near the top to the bottom of the screen, and contains icons arranged vertically. This matches the description of a tall vertical bar docked to the left edge, rather than a horizontal bar across the top or bottom.