[azure_functions] Rename properties
field to properties.raw
when it contains invalid JSON
#14754
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Proposed commit message
If the azure.properties field in a log event is a string (instead of a structured object), the pipeline renames it to azure.properties.raw. This prevents Elasticsearch from rejecting the document due to a type conflict, allowing the event to be successfully indexed while preserving the original data for further processing or inspection.
Something similar was done for Azure Platform Logs, PR here
Note: We do not want to decide how to manage the invalid JSON that comes from Azure services.
With this approach, users have an option to decide how they want to process data in the
.raw
field using a custom pipeline.Checklist
changelog.yml
file.Author's Checklist
How to test this PR locally
Related issues
Screenshots