Skip to content

Conversation

devamanv
Copy link
Contributor

@devamanv devamanv commented Jul 30, 2025

Proposed commit message

If the azure.properties field in a log event is a string (instead of a structured object), the pipeline renames it to azure.properties.raw. This prevents Elasticsearch from rejecting the document due to a type conflict, allowing the event to be successfully indexed while preserving the original data for further processing or inspection.

Something similar was done for Azure Platform Logs, PR here

Note: We do not want to decide how to manage the invalid JSON that comes from Azure services.
With this approach, users have an option to decide how they want to process data in the .raw field using a custom pipeline.

Checklist

  • I have reviewed tips for building integrations and this pull request is aligned with them.
  • I have verified that all data streams collect metrics or logs.
  • I have added an entry to my package's changelog.yml file.
  • I have verified that Kibana version constraints are current according to guidelines.
  • I have verified that any added dashboard complies with Kibana's Dashboard good practices

Author's Checklist

  • [ ]

How to test this PR locally

Related issues

Screenshots

@devamanv devamanv self-assigned this Jul 30, 2025
@devamanv devamanv added enhancement New feature or request Team:Obs-InfraObs Observability Infrastructure Monitoring team [elastic/obs-infraobs-integrations] Integration:azure_functions Azure Functions labels Jul 30, 2025
@elastic-vault-github-plugin-prod

🚀 Benchmarks report

To see the full report comment with /test benchmark fullreport

Copy link

Quality Gate failed Quality Gate failed

Failed conditions
77.3% Coverage on New Code (required ≥ 80%)

See analysis details on SonarQube

@elasticmachine
Copy link

💚 Build Succeeded

cc @devamanv

@andrewkroh andrewkroh added the documentation Improvements or additions to documentation. Applied to PRs that modify *.md files. label Jul 30, 2025
@devamanv
Copy link
Contributor Author

Closing this PR as we have decided to replace single quotes with double whenever there's an invalid JSON embedded in the properties field.

@devamanv devamanv closed this Aug 26, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation. Applied to PRs that modify *.md files. enhancement New feature or request Integration:azure_functions Azure Functions Team:Obs-InfraObs Observability Infrastructure Monitoring team [elastic/obs-infraobs-integrations]

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants