Skip to content

Certification tests for Azure Event Hubs binding #960

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
artursouza opened this issue Jun 17, 2021 · 5 comments · Fixed by #1716
Closed

Certification tests for Azure Event Hubs binding #960

artursouza opened this issue Jun 17, 2021 · 5 comments · Fixed by #1716
Assignees
Milestone

Comments

@artursouza
Copy link
Contributor

Describe the feature

Certify Azure Event Hubs as GA in input/output binding

Release Note

RELEASE NOTE:

@tanvigour
Copy link
Contributor

/assign

@tanvigour
Copy link
Contributor

tanvigour commented Oct 13, 2021

Test Plan Draft

Proposed tests (Certification)

  • Test sending /receiving data between single partition

    • Start an app with 1 sender and 1 receiver
    • Provide multiple partitions but store data in one partition
    • Receiver should only receive message from one partition
    • Sends 100+ unique messages
    • Simulates periodic errors
    • Confirm that all expected messages were received
    • Confirm that receiver does not receive messages from other than one partition
  • Test sending /receiving data multiple partitions/sender and receivers

    • Start an app with 1 sender and 1 receiver
    • Send data from 2 partitions
    • Sends 100+ unique messages
    • Simulates periodic errors
    • Confirm that all expected messages were received
    • Confirm messages were received from all partitions
  • Test reconnection

    • Start an app with 1 senders and 1 receivers
    • Send 100+ unique messages from 1 sender
    • Interrupt the connection
    • Confirm that all expected messages were received by respective receiver
  • IoT hub testing

    • Move existing IoT test from integration to conformance test
  • Auth testing

    • Test connection string based authentication mechanism
    • Test service principal based authentication mechanism

@artursouza artursouza modified the milestones: v1.5, v1.6 Nov 2, 2021
@artursouza
Copy link
Contributor Author

The IoT hub from "integration test" needs to move to conformance test because the "integration tests" are not officially supported in a GitHub pipelines and it overlaps in objective with our certification tests.

Instead of retry, let's validate reconnection. Add a scenario where the connection to EvenHubs is stopped for a few seconds and validate that publish and subscribe continues to work after connection is recovered.

For AAD authentication, validate one of the authentication options is fine but verify that the code is using the "shared" code for Azure auth.

@artursouza artursouza changed the title Certify Azure Event Hubs as GA in input/output binding Certification tests for Azure Event Hubs binding Jan 11, 2022
@artursouza artursouza modified the milestones: v1.6, v1.7 Jan 11, 2022
@artursouza artursouza modified the milestones: v1.7, v1.8 Mar 3, 2022
@tanvigour
Copy link
Contributor

@artursouza Added a scenario covering reconnection, auth testing and IoT migration from integration. Does this look good?

@berndverst
Copy link
Member

@artursouza FYI -- this component cannot be certified until pending open issues are resolved, especially #1598

It would be very helpful to have a certification test that verifies this very situation. There may be required updates to this component as a result.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Development

Successfully merging a pull request may close this issue.

3 participants