Support for Moonshot Kimi K2 Thinking model on AWS Bedrock

[KarthiDreamr]

Summary

I would like to propose and have implemented support for the Moonshot Kimi K2 Thinking (moonshot.kimi-k2-thinking) model via the AWS Bedrock endpoint. This model is now available in several AWS regions (like ap-northeast-1) and offers significant reasoning capabilities with a large context window.

Why this is useful

Kimi K2 Thinking is a powerful reasoning model that competes with Claude 3.5/3.7 Sonnet and OpenAI's o1/o3 series.

• Large Context: 256K tokens.
• Deep Reasoning: Ideal for complex coding and logic tasks.
• Bedrock Integration: Allows users already on AWS to access high-quality reasoning models without needing external API keys for Moonshot AI directly.

Implementation Details

I have already submitted a Pull Request for this: PR #11288

The implementation includes:

• Adding Moonshot as a recognized Bedrock provider.
• Configuring optimal default parameters (max_tokens: 16384) to allow for full reasoning chains.
• Ensuring anthropic_beta headers are only sent to Anthropic models to prevent API errors with Kimi.

References

• AWS Bedrock Supported Models
• Moonshot Kimi K2 API Documentation

I'd love to hear the community's thoughts on this addition!

PS:
I would also love to update the model list, add more providers etc too if you want