Expanding Function calling

[ily-R]

Validations

• I believe this is a way to improve. I'll try to join the Continue Discord for questions
• I'm not able to find an open issue that requests the same enhancement

Problem

I wanted to use function calling with claude 3.5 sonnet, but going through another serverless api provider. I defined My model as follows:

  "models": [
    {
      "model": "claude-3-5-sonnet-20240620",
      "title": "Claude 3.5 Sonnet",
      "apiKey": "api-key"
      "provider": "anthropic"
    },
    {
      "title": "My model",
      "provider": "openai",
      "model": "assistant:ContinueModel-claude-3-5-sonnet",
      "apiKey": "api-key",
      "apiBase": "https://api.serverX.ai"
    },

Even though the model I am using under the hood through my api is anthropic.claude-3.5-sonnet-v2 from AWS Bedrock I still don't have the Tools option working because you seem to have a condition that the provider has to be anthropic.

Solution

It will be nice if any Anthropic model message should be passed through Anthropic.ts wether it's coming through the Anthropic api itself or any other providers like Bedrock or openai in my case.

[mmaist]

+1, same issue when using claude-3.5-sonnet through aws