Skip to content

Update aoai graders sample #41126

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 48 commits into
base: main
Choose a base branch
from

Conversation

singankit
Copy link
Contributor

Description

Please add an informative description that covers that changes made by the pull request and link all relevant issues.

If an SDK is being regenerated based on a new swagger spec, a link to the pull request containing these swagger spec changes has been included above.

All SDK Contribution checklist:

  • The pull request does not introduce [breaking changes]
  • CHANGELOG is updated for new features, bug fixes or other significant changes.
  • I have read the contribution guidelines.

General Guidelines and Best Practices

  • Title of the pull request is clear and informative.
  • There are a small number of commits, each of which have an informative message. This means that previously merged commits do not appear in the history of the PR. For more information on cleaning up the commits in your PR, see this page.

Testing Guidelines

  • Pull request includes test coverage for the included changes.

dargilco and others added 30 commits April 25, 2025 06:14
* Updaing Evaluator Id list

* Updating evaluator list
* Re-emitted SDK

* Fixed patched code following auto-gen code changes
* Evaluation Review Feedback

* Fixing samples

* Fixing sample
* Adding sample for agent evaluation

* Review comments
* Updating Agent Evlaution Sample

* Update sample_agent_evaluations.py
* Re-emit

* Fix Sphinx

* Fix async get_azure_openai_client. Fixes in samples test
dargilco and others added 18 commits May 7, 2025 06:11
* Evaluation Sample Update

* Fixing agent evaluation sample

* Updating evaluation samples

* Review Comment

* Udpdating sample with evaluator ids

* Spell check
…models (#41040)

* Use /models instead of /api/models route for inference

* Remove lazy import of azure-ai-agents, not that it was published

* Fix quality gates
* Take inference credential scopes from AIProjectClient

* Run tool 'black'

* Attempt to suppress verifytypes in auto-emitted code

* Suppress verifytypes after talking to Krista

* Update shared_requirements.txt to fix `Analyze dependencies` job
Support either returning an AOAI client on the parent AI Services resource, or on a connected AOAI service. We are still debating which api_version to show in the sample code.
* Update readme, changelog

* Fix quality gates
…1112)

TypeSpec defined a namespace  Azure.AI.Projects.ServicePatterns that contains a TypeSpec template for common operations used by Datasets and Indexes. This results in an unused property service_patterns on AIProjectClient that does nothing, and emitted ServicePattern classes that do nothing. I'm trying to update the TypeSpec namespace so that will not happen, but running into some issues. So for the time being, I'm manually editing the Python emitted code to unblock release so anything to do with service patter does not appear in the public API surface.
* Updating smaples and README

* Update Changelog file

* Review comments

* Fixing pyright issues
Copy link

API Change Check

APIView identified API level changes in this PR and created the following API reviews

azure-ai-projects

Base automatically changed from feature/azure-ai-projects-beta11 to main May 15, 2025 23:21
@annatisch annatisch requested review from msyyc and lmazuel as code owners May 15, 2025 23:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants