Add support for Kafka 4.1.1

[scholzj]

Type of change

• Enhancement / new feature

Description

This PR adds support Kafka 4.1.1 that brings various bugfixes.

This is currently a draft based on RC2.

Checklist

• Make sure all tests pass
• Update documentation
• Try your changes from Pod inside your Kubernetes and OpenShift cluster, not just locally
• Update CHANGELOG.md

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 74.82%. Comparing base (ed16f5b) to head (944b697).
⚠️ Report is 10 commits behind head on main.

Additional details and impacted files

@@             Coverage Diff              @@
##               main   #12079      +/-   ##
============================================
+ Coverage     74.78%   74.82%   +0.04%     
- Complexity     6625     6626       +1     
============================================
  Files           377      377              
  Lines         25359    25359              
  Branches       3396     3396              
============================================
+ Hits          18964    18975      +11     
+ Misses         5007     4997      -10     
+ Partials       1388     1387       -1     

see 5 files with indirect coverage changes

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[scholzj]

/gha run pipeline=regression kubeVersion=latest

[github-actions]

⏳ System test verification started: link

The following 6 job(s) will be executed:

• regression-brokers-and-security-amd64 (oracle-vm-8cpu-32gb-x86-64)
• regression-operators-amd64 (oracle-vm-8cpu-32gb-x86-64)
• regression-operands-amd64 (oracle-vm-8cpu-32gb-x86-64)
• regression-brokers-and-security-arm64 (oracle-vm-8cpu-32gb-arm64)
• regression-operators-arm64 (oracle-vm-8cpu-32gb-arm64)
• regression-operands-arm64 (oracle-vm-8cpu-32gb-arm64)

Tests will start after successful build completion.

[scholzj]

/azp run upgrade

[azure-pipelines]

Azure Pipelines successfully started running 1 pipeline(s).

[scholzj]

/azp run regression

[azure-pipelines]

Azure Pipelines successfully started running 1 pipeline(s).

[github-actions]

❌ System test verification failed: link

[github-actions]

❌ System test verification failed: link

[github-actions]

❌ System test verification failed: link

[asoldo11]

Hi, sorry for the interruption, I have question regarding the 0.49.0 version - is there a approximate date when it will be released?

[ppatierno]

Commenting on a PR is not the right place for asking (totally unrelated) questions. You have several ways like Slack, mailing list or GitHub discussions.

[scholzj]

/gha run pipeline=regression,upgrade

[github-actions]

⏳ System test verification started: link

The following 10 job(s) will be executed:

• regression-brokers-and-security-amd64 (oracle-vm-8cpu-32gb-x86-64)
• regression-operators-amd64 (oracle-vm-8cpu-32gb-x86-64)
• regression-operands-amd64 (oracle-vm-8cpu-32gb-x86-64)
• regression-brokers-and-security-arm64 (oracle-vm-8cpu-32gb-arm64)
• regression-operators-arm64 (oracle-vm-8cpu-32gb-arm64)
• regression-operands-arm64 (oracle-vm-8cpu-32gb-arm64)
• upgrade-azp_kraft_upgrade-amd64 (oracle-vm-4cpu-16gb-x86-64)
• upgrade-azp_kafka_upgrade-amd64 (oracle-vm-4cpu-16gb-x86-64)
• upgrade-azp_kraft_upgrade-arm64 (oracle-vm-4cpu-16gb-arm64)
• upgrade-azp_kafka_upgrade-arm64 (oracle-vm-4cpu-16gb-arm64)

Tests will start after successful build completion.

[github-actions]

❌ System test verification failed: link

[github-actions]

❌ System test verification failed: link

[scholzj]

/azp run upgrade

[azure-pipelines]

Azure Pipelines successfully started running 1 pipeline(s).

[github-actions]

❌ System test verification failed: link

[github-actions]

🎉 System test verification passed: link

[scholzj]

/azp run upgrade

[azure-pipelines]

Azure Pipelines successfully started running 1 pipeline(s).

[scholzj]

/gha run pipeline=upgrade

[github-actions]

⏳ System test verification started: link

The following 4 job(s) will be executed:

• upgrade-azp_kraft_upgrade-amd64 (oracle-vm-4cpu-16gb-x86-64)
• upgrade-azp_kafka_upgrade-amd64 (oracle-vm-4cpu-16gb-x86-64)
• upgrade-azp_kraft_upgrade-arm64 (oracle-vm-4cpu-16gb-arm64)
• upgrade-azp_kafka_upgrade-arm64 (oracle-vm-4cpu-16gb-arm64)

Tests will start after successful build completion.

[github-actions]

🎉 System test verification passed: link