Skip to content

Add missing plugin configuration schema for LanguageModelFailurePlugin #1321

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Jul 11, 2025

Conversation

Copilot
Copy link
Contributor

@Copilot Copilot AI commented Jul 11, 2025

The LanguageModelFailurePlugin was added in PR #1314 but was missing its configuration schema. This PR adds the JSON schema file to ensure proper extensibility and documentation for plugin configuration.

Changes

  • Added schemas/v1.0.0/languagemodelfailureplugin.schema.json with proper JSON Schema Draft 2020-12 format
  • Schema includes the failures property as an optional array of strings matching the LanguageModelFailureConfiguration.Failures property
  • Comprehensive description documents all 15 default failure types available in the plugin
  • Follows established schema patterns in the repository with additionalProperties: false validation

Schema Properties

  • failures: Optional array of failure type strings to simulate in language model responses
  • Default behavior: When not specified, uses built-in failure types including AmbiguityVagueness, BiasStereotyping, CircularReasoning, ContradictoryInformation, FailureDisclaimHedge, FailureFollowInstructions, Hallucination, IncorrectFormatStyle, Misinterpretation, OutdatedInformation, OverSpecification, OverconfidenceUncertainty, Overgeneralization, OverreliancePriorConversation, and PlausibleIncorrect

Example Configuration

{
  "$schema": "https://github.com/raw/dotnet/dev-proxy/main/schemas/v1.0.0/languagemodelfailureplugin.schema.json",
  "failures": [
    "Hallucination",
    "BiasStereotyping", 
    "Misinterpretation"
  ]
}

Fixes #1320.


💡 You can make Copilot smarter by setting up custom instructions, customizing its development environment and configuring Model Context Protocol (MCP) servers. Learn more Copilot coding agent tips in the docs.

@Copilot Copilot AI changed the title [WIP] Add missing plugin configuration schema for LanguageModelFailurePlugin Add missing plugin configuration schema for LanguageModelFailurePlugin Jul 11, 2025
@Copilot Copilot AI requested a review from waldekmastykarz July 11, 2025 06:28
Copilot finished work on behalf of waldekmastykarz July 11, 2025 06:28
@waldekmastykarz waldekmastykarz marked this pull request as ready for review July 11, 2025 06:37
@waldekmastykarz waldekmastykarz requested a review from a team as a code owner July 11, 2025 06:37
@waldekmastykarz waldekmastykarz merged commit 73640d9 into main Jul 11, 2025
6 checks passed
@waldekmastykarz waldekmastykarz deleted the copilot/fix-1320 branch July 11, 2025 06:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add missing plugin configuration schema for LanguageModelFailurePlugin
2 participants