Add API services that support task queues. #1854
Open
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
SPO API Backend
The SPO API Backend is designed to provide a powerful and flexible interface for integrating prompt optimization capabilities into your own applications. Built on the MetaGPT framework, this backend allows you to efficiently queue multiple tasks and optimize prompts in an automated and scalable way. The API supports the use of task queues to handle large volumes of prompts, making it easy to integrate into any system requiring prompt optimization.
Graphical User Interface (Sample)
A simple Streamlit-based graphical interface has been developed as a sample for interacting with the API. Located in
metagpt/ext/spo_api_backend/frontend_sample/, this interface allows users to easily manage and optimize multiple prompts through a user-friendly GUI. While the main focus is on the API backend, this sample interface serves as an easy-to-use tool for testing and managing prompt optimization tasks.