-
Notifications
You must be signed in to change notification settings - Fork 3k
Update aoai graders sample #41126
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Open
singankit
wants to merge
48
commits into
main
Choose a base branch
from
users/singankit/agent_eval_sample_update
base: main
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
Update aoai graders sample #41126
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* Updaing Evaluator Id list * Updating evaluator list
* Re-emitted SDK * Fixed patched code following auto-gen code changes
* Evaluation Review Feedback * Fixing samples * Fixing sample
* Adding sample for agent evaluation * Review comments
* Updating Agent Evlaution Sample * Update sample_agent_evaluations.py
* Re-emit * Fix Sphinx * Fix async get_azure_openai_client. Fixes in samples test
* Evaluation Sample Update * Fixing agent evaluation sample * Updating evaluation samples * Review Comment * Udpdating sample with evaluator ids * Spell check
…models (#41040) * Use /models instead of /api/models route for inference * Remove lazy import of azure-ai-agents, not that it was published * Fix quality gates
* Take inference credential scopes from AIProjectClient * Run tool 'black' * Attempt to suppress verifytypes in auto-emitted code * Suppress verifytypes after talking to Krista * Update shared_requirements.txt to fix `Analyze dependencies` job
Support either returning an AOAI client on the parent AI Services resource, or on a connected AOAI service. We are still debating which api_version to show in the sample code.
* Update readme, changelog * Fix quality gates
…1112) TypeSpec defined a namespace Azure.AI.Projects.ServicePatterns that contains a TypeSpec template for common operations used by Datasets and Indexes. This results in an unused property service_patterns on AIProjectClient that does nothing, and emitted ServicePattern classes that do nothing. I'm trying to update the TypeSpec namespace so that will not happen, but running into some issues. So for the time being, I'm manually editing the Python emitted code to unblock release so anything to do with service patter does not appear in the public API surface.
* Updating smaples and README * Update Changelog file * Review comments * Fixing pyright issues
API Change CheckAPIView identified API level changes in this PR and created the following API reviews |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
Please add an informative description that covers that changes made by the pull request and link all relevant issues.
If an SDK is being regenerated based on a new swagger spec, a link to the pull request containing these swagger spec changes has been included above.
All SDK Contribution checklist:
General Guidelines and Best Practices
Testing Guidelines