Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[CI] ClassificationHousePricingIT testFeatureImportanceValues failing #124341

Open
elasticsearchmachine opened this issue Mar 7, 2025 · 2 comments
Open

[CI] ClassificationHousePricingIT testFeatureImportanceValues failing #124341

elasticsearchmachine opened this issue Mar 7, 2025 · 2 comments
Labels
low-risk An open issue or test failure that is a low risk to future releases :ml Machine learning Team:ML Meta label for the ML team >test-failure Triaged test failures from CI

Comments

@elasticsearchmachine
Copy link
Collaborator

elasticsearchmachine commented Mar 7, 2025 •
edited
Loading

Build Scans:

Reproduction Line:

./gradlew ":x-pack:plugin:ml:qa:native-multi-node-tests:javaRestTest" --tests "org.elasticsearch.xpack.ml.integration.ClassificationHousePricingIT.testFeatureImportanceValues" -Dtests.seed=E73078D9B5FAC98D -Dtests.locale=so-ET -Dtests.timezone=America/Jujuy -Druntime.java=23

Applicable branches:
8.16

Reproduces locally?:
N/A

Failure History:
See dashboard

Failure Message:

java.lang.AssertionError: Failure: failed for inferenceEntityId classification_house_pricing_test_feature_importance_values-1741619742625 numberTrees 1
Ndownsample_factor: 0.24841837447538762
alpha: 11.814254749498005
lambda: 1.0526982012270447
gamma: 8.04725557701897
soft_tree_depth_limit: 5.311817345479914
soft_tree_depth_tolerance: 0.15
eta: 0.6217679005474379
eta_growth_rate_per_tree: 1.3108839502737188
max_trees: 2.0
feature_bag_fraction: 0.11764705882352941
{"trained_model":{"ensemble":{"trained_models":[{"tree":{"feature_names":[],"tree_structure":[{"decision_type":"lte","node_index":0,"leaf_value":[-2.643250207875294],"default_left":false,"number_samples":510}],"target_type":"classification"}}],"aggregate_output":{"logistic_regression":{"weights":[1.0]}},"target_type":"classification","classification_labels":["Y","N"],"classification_weights":[0.010554271156279646,1.0]}},"preprocessors":[{"frequency_encoding":{"field":"Electrical","feature_name":"Electrical_frequency","frequenc
[truncated]

Issue Reasons:

  • [8.16] 3 failures in test testFeatureImportanceValues (0.5% fail rate in 600 executions)
  • [8.16] 2 failures in pipeline elasticsearch-periodic-platform-support (10.5% fail rate in 19 executions)

Note:
This issue was created using new test triage automation. Please report issues or feedback to es-delivery.
@elasticsearchmachine elasticsearchmachine added :ml Machine learning >test-failure Triaged test failures from CI Team:ML Meta label for the ML team needs:risk Requires assignment of a risk label (low, medium, blocker) labels Mar 7, 2025
@elasticsearchmachine
Copy link
Collaborator Author

Pinging @elastic/ml-core (Team:ML)

@davidkyle davidkyle added low-risk An open issue or test failure that is a low risk to future releases and removed needs:risk Requires assignment of a risk label (low, medium, blocker) labels Mar 21, 2025
@davidkyle
Copy link
Member

Slow test

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
low-risk An open issue or test failure that is a low risk to future releases :ml Machine learning Team:ML Meta label for the ML team >test-failure Triaged test failures from CI
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@davidkyle @elasticsearchmachine