Skip to content

NIFI-14331 Allow for removing all undefined elements (not only top level keys) from the JSON when using JsonTreeReader and JsonRecordSetWriter. #9781

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

dan-s1
Copy link
Contributor

@dan-s1 dan-s1 commented Mar 6, 2025

Summary

NIFI-14331

Tracking

Please complete the following tracking steps prior to pull request creation.

Issue Tracking

Pull Request Tracking

  • Pull Request title starts with Apache NiFi Jira issue number, such as NIFI-00000
  • Pull Request commit message starts with Apache NiFi Jira issue number, as such NIFI-00000

Pull Request Formatting

  • Pull Request based on current revision of the main branch
  • Pull Request refers to a feature branch with one commit containing changes

Verification

Please indicate the verification steps performed prior to pull request creation.

Build

  • Build completed using mvn clean install -P contrib-check
    • JDK 21

Licensing

  • New dependencies are compatible with the Apache License 2.0 according to the License Policy
  • New dependencies are documented in applicable LICENSE and NOTICE files

Documentation

  • Documentation formatting appears as expected in rendered files

@dan-s1 dan-s1 requested a review from exceptionfactory March 6, 2025 18:05
@dan-s1 dan-s1 changed the title NIFI-14331 Allow for removing all undefined elements (not only top level keys) from the JSON. NIFI-14331 Allow for removing all undefined elements (not only top level keys) from the JSON when using JsonTreeReader and JsonRecordSetWriter. Mar 6, 2025
@dan-s1
Copy link
Contributor Author

dan-s1 commented Mar 13, 2025

@pvillard31 When you have a chance can you please review? Thanks!

@dan-s1 dan-s1 force-pushed the NIFI-14331 branch 2 times, most recently from 56bcefa to 6ee0bf3 Compare March 24, 2025 14:45
@dan-s1
Copy link
Contributor Author

dan-s1 commented Mar 28, 2025

@exceptionfactory Can you please take a look at this PR? My team has a flow which is experiencing this bug and it would be great to have this fix. Thank you!

assertFalse(flowFile.getContent().contains("fieldThatShouldBeRemoved"));
final List<String> undefinedTopLevelKeys = List.of("undefinedKey", "undefinedObjectArray", "undefinedObject", "undefinedScalarArray");

undefinedTopLevelKeys.forEach(undefinedTopLevelKey -> assertFalse(flowFile.getContent().contains(undefinedTopLevelKey)));
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could this be simplified to a single assert that the string "undefined" is not in the result? Perhaps you could add a comment stating this covers all of the cases "undefinedKey", "undefinedObjectArray", "undefinedObject", "undefinedScalarArray", "undefinedKeyInObject"

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants