Skip to content

Support for Chain of Thought tokens #257104

@karthiknadig

Description

@karthiknadig

Implementation

  • Plumb the cot feature through the various layers in core and extension
    • Store data in chat history (summary, id, metadata)
    • Add cot data to chat debug logs
    • Get cot data by tool_call when constructing the request messages
    • BYOK
      • Use thinking data when provider does not use LM APIs (E.g Anthropic)
      • Use model specific endpoints to adjust messages

Chat UI Implementation 🎨

  • Design UX for displaying thinking data in chat UI
  • Implement LM API to stream cot information to core
  • Develop Chat UI API for accessing thinking data

Ref: microsoft/vscode-copilot-release#11758

Metadata

Metadata

Labels

feature-requestRequest for new features or functionality

Type

No type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions