Adding MakeHub, the smart router for AI coding assistant

[ffp5]

Context

As daily users of Kilocode, my team and I frequently encounter rate limits and performance inconsistencies when using certain AI providers. These limitations hinder our development workflow, especially when leveraging advanced models. We seek a solution that offers:

-consistent performance
-reduced latency
-cost-effective access to various AI models
-A Solution for Developers by Developers.

So, We propose integrating MakeHub.ai as an AI provider within Kilocode. MakeHub.ai offers a high-speed LLM API that performs real-time speed and price arbitrage across multiple providers for close and open source models. Users can define performance parameters such as speed and price, allowing MakeHub to select the most cost-effective provider that meets these requirements. This integration would enable developers to experience consistent performance and pricing across various models, all through a single API key.

Implementation

Some description of HOW you achieved it. Perhaps give a high level description of the program flow. Did you need to refactor something? What tradeoffs did you take? Are there things in here which you’d particularly like people to pay close attention to?

We’ve followed Kilocode’s current pattern for adding providers. Since MakeHub is OpenAI API compatible (including chat/completions/embeddings endpoints), integration required no major refactor. Also, we add MakeHub in the necessary tests.

Screenshots

before	after
Everything stays de same	we added MakeHub as a provider

How to Test

A straightforward scenario of how to test your changes will help reviewers that are not familiar with the part of the code that you are changing but want to see it in action. This section can include a description or step-by-step instructions of how to get to the state of v2 that your change affects.

1. Open the API provider picker in Kilocode.
2. Select MakeHub as your provider.
3. Click Get your API key, you’ll be redirected to MakeHub.ai to log in and retrieve your key.
4. Paste your API key back into Kilocode
5. Choose any model and start building

Get in Touch

We'd love to have a way to chat with you about your changes if necessary. If you're in the Kilo Code Discord, please share your handle here. -->

We’d love to discuss this integration further and hear your feedback.
We’re on the Kilocode Discord:

• @fernando172001
• @hommefeue

[changeset-bot]

⚠️ No Changeset found

Latest commit: 6fc0c84

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

[Copilot]

Pull Request Overview

This PR integrates MakeHub as a new AI provider into Kilocode to deliver consistent performance, reduced latency, and cost-effective access across various models. The changes include the addition of MakeHub-specific configuration options and UI components, updates to model fetching and API handling, and modifications to type definitions and provider schemas.

Reviewed Changes

Copilot reviewed 40 out of 40 changed files in this pull request and generated 1 comment.

Show a summary per file

File	Description
webview-ui/src/components/ui/hooks/useSelectedModel.ts	Added support for MakeHub in model selection logic.
webview-ui/src/components/settings/providers/MakeHub.tsx	Introduced a new settings component for configuring MakeHub.
webview-ui/src/components/settings/ApiOptions.tsx	Included MakeHub in provider switch-case and configuration defaults.
src/shared/api.ts, ProfileValidator.ts, and others	Updated provider lists and type definitions to include MakeHub.
src/api/providers/makehub.ts	New API handler for MakeHub with cost calculation and message streaming.
src/api/providers/fetchers/makehub.ts	New model fetcher for MakeHub integrating API response parsing.
packages/types and evals packages	Updated type definitions and provider schemas for MakeHub.

Comments suppressed due to low confidence (1)

src/api/providers/makehub.ts:1

• The import of 'Anthropic' is unused in this file. Removing it may improve code clarity.

import { Anthropic } from "@anthropic-ai/sdk"

[ffp5]

Hello,

I’ve implemented the needed corrections and pushed the updates.
Please take another look when you have a moment, and let me know if anything else needs adjusting

Best,

[ffp5]

Hi,

I have added Makehub to the necessary test files.

Best

[ffp5]

Hello,

I have update the PR to the lastest commits.

Best,

[ffp5]

I’ve updated the PR with the latest changes and squashed all commits into one for a cleaner history. Let me know if anything else is needed!

[ffp5]

Hello @Juice10,

I’ve updated the PR with the latest changes and squashed all commits into one for a cleaner history. Let me know if anything else is needed.

Best,

[ffp5]

Thank you for the review!

However, I see that all the tests passed except for Chromatic Visual Testing /chromatic (pull_request). It looks like there’s no Chromatic token set on your GitHub repository, which I think needs to be configured on your end. I set up the token in my fork, and Chromatic worked fine there.

Please let me know if there’s anything else you’d like me to do.

Best regards.

[kevinvandijk]

Hi @ffp5!

Thanks for the contribution and apologies for the delay in processing this PR! We added the Chromatic job recently and indeed seems like it doesn't work for community contributed PR's right now but that's fully our problem that we need to fix so don't worry about it. Not your issue at all! There's a couple of merge conflicts right now due to updates. Any chance you could look into those still?

Also, am I right in my assertion that you are working for MakeHub and trying to land support because of this? We're ok with that but would be nice to have some clarity on that topic.

[ffp5]

Hi @kevinvandijk ,

Of course, I’ve just updated the PR to include the latest commits.
And yes, I’m working with MakeHub, and my outreach is indeed in the context of that project. We had several requests to make MakeHub usable within Kilocode, which is why I opened this PR.

Let me know if there’s anything else I can do on my end.

Best,

[ffp5]

Hi @kevinvandijk ,

Of course, I’ve just updated the PR to include the latest commits.
Let me know if there’s anything else I can do on my end.

[ffp5]

Hi @kevinvandijk ,

I’ve just updated the PR to include the latest commits.
Let me know if there’s anything else I can do on my end.

Best,