Feat: Robust Browser Automation with Visual Actions Editor #196
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
betterclever
changed the title
Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>
…me read support Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>
…red types - Created @shipsec/browser-harness for typesafe Playwright automation logic. - Moved browser automation schemas to @shipsec/shared. - Refactored browser.automation component to use compiled harness and shared types. - Fixed lint errors in BrowserPanel frontend component. - Integrated new package into root workspaces. Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>
… to first-class citizens This commit includes: - Promotion of parameters to a top-level property in ComponentDefinition. - Implementation of a visual BrowserActionsEditor with cards-based UI. - Extraction of complex parameter editors to a centralized location in the frontend. - Refactoring of browser.automation to use the new top-level parameters and visual editor. Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>
betterclever
force-pushed
the
feat/browser-automation-visual-editor
branch
from
9778420 to
017eef0
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Overview
This PR introduces the Browser Automation feature in its entirety. It refactors the browser component into a highly robust, type-safe, and user-friendly tool, utilizing a dedicated Playwright harness and a first-of-its-kind visual action builder.
Key Modules & Features
1. Dedicated Playwright Harness (
@shipsec/browser-harness)mcr.microsoft.com/playwrightto ensure a consistent environment (screenshots, console capture, results).2. Parameter System Elevation (SDK Changes)
parametersto the top-level ofComponentDefinition.frontend/src/components/parameter-editors/.3. Visual Browser Actions Builder
4. End-to-End Reliability
@shipsec/shared.Impact
Users can now build complex, multi-step browser workflows (like logging into a portal, taking a screenshot, and extracting data) entirely through a visual sidebar interface with zero JSON editing required.