Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Question]: k8sgpt controller is failing with bedrock service request failed. failed while calling AI provider amazonbedrock: ValidationException #600

Open
3 of 4 tasks
kpeer-devops opened this issue Jan 10, 2025 · 1 comment

Comments

@kpeer-devops
Copy link

Checklist

  • I've searched for similar issues and couldn't find anything matching
  • I've included steps to reproduce the behavior

Affected Components

  • K8sGPT (CLI)
  • K8sGPT Operator

K8sGPT Version

v0.2.5

Kubernetes Version

v.1.29

Host OS and its Version

Linux

Steps to reproduce

  1. Install k8s gpt controller
  2. kubectl apply on below file
apiVersion: core.k8sgpt.ai/v1alpha1
kind: K8sGPT
metadata:
  name: k8sgpt-bedrock
  namespace: gpncp
spec:
  ai:
    enabled: true
    # secret:
    #  name: bedrock-sample-secret
    model: anthropic.claude-v2
    #maxTokens: "1000"
    region: us-east-1
    backend: amazonbedrock
  noCache: false
  repository: registry.tools.tsys.aws/coredevops/k8sgpt-ai/k8sgpt
  version: v0.3.41
  1. Logs of k8sgpt controller
amazonbedrock\"  explain:true  anonymize:true  language:\"english\"  max_concurrency:10  output:\"json\"","remote_addr":"10.6.91.255:42456","status_code":2}
I0110 20:08:06.371412       1 request.go:697] Waited for 1.07380089s due to client-side throttling, not priority and fairness, request: GET:https://172.20.0.1:443/api/v1/namespaces/monitoring/events?fieldSelector=involvedObject.name%3Dfbit-mls-tlsg-dldev-use1-fluent-bit-gpn-7b2r6
{"level":"info","ts":1736539706.674506,"caller":"server/log.go:50","msg":"request failed. failed while calling AI provider amazonbedrock: ValidationException: max_tokens_to_sample: range: 1..1,000,000","duration_ms":21512,"method":"/schema.v1.ServerAnalyzerService/Analyze","request":"backend:\"amazonbedrock\"  explain:true  anonymize:true  language:\"english\"  max_concurrency:10  output:\"json\"","remote_addr":"10.6.91.255:56886","status_code":2}

Expected behaviour

It should connect to Bedrock Service

Actual behaviour

No response

Additional Information

No response

@elamaran11
Copy link

I ran in the same issue. I tried to use latest version of Haiku/Sonnet and it was working fine. Titan worked fine too

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants