Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[CI] DocsClientYamlTestSuiteIT test {yaml=reference/snapshot-restore/apis/get-snapshot-api/line_357} failing #121287

Closed
elasticsearchmachine opened this issue Jan 30, 2025 · 2 comments · Fixed by #124684
Closed

[CI] DocsClientYamlTestSuiteIT test {yaml=reference/snapshot-restore/apis/get-snapshot-api/line_357} failing #121287

elasticsearchmachine opened this issue Jan 30, 2025 · 2 comments · Fixed by #124684
Assignees
@slobodanadamovic
Labels
:Delivery/Build Build or test infrastructure low-risk An open issue or test failure that is a low risk to future releases Team:Delivery Meta label for Delivery team >test-failure Triaged test failures from CI

Comments

@elasticsearchmachine
Copy link
Collaborator

Build Scans:

Reproduction Line:

./gradlew ":docs:yamlRestTest" --tests "org.elasticsearch.smoketest.DocsClientYamlTestSuiteIT.test {yaml=reference/snapshot-restore/apis/get-snapshot-api/line_357}" -Dtests.seed=A00CBB485E84139B -Dtests.locale=luo-KE -Dtests.timezone=Africa/Ndjamena -Druntime.java=23

Applicable branches:
main

Reproduces locally?:
N/A

Failure History:
See dashboard

Failure Message:

java.lang.AssertionError: Failure at [reference/snapshot-restore/apis/get-snapshot-api:78]: Expected a map containing
       snapshots: a list containing
                 0: a map containing
            failures: an empty list
include_global_state: <true>
            end_time: "2025-01-30T13:15:40.728Z"
  duration_in_millis: <0>
          version_id: <9008000>
          repository: "my_repository"
                uuid: "EjOW137vT4m3kQn2M_UdoQ"
             version: "9.0.0"
          start_time: "2025-01-30T13:15:40.728Z"
              shards: a map containing
                 total: expected <0> but was <1>
                failed: <0>
            successful: expected <0> but was <1>
             indices: an empty list
                     0: <unexpected> but was ".security-7"
      feature_states: an empty list
                     0: <unexpected> but was <{feature_name=security, indices=[.security-7]}>
start_time_in_millis: <1738242940728L>
        data_streams: an empty list
        
[truncated]

Issue Reasons:

  • [main] 3 failures in test test {yaml=reference/snapshot-restore/apis/get-snapshot-api/line_357} (0.4% fail rate in 801 executions)
  • [main] 2 failures in step part-1 (0.6% fail rate in 352 executions)
  • [main] 2 failures in pipeline elasticsearch-pull-request (0.5% fail rate in 384 executions)

Note:
This issue was created using new test triage automation. Please report issues or feedback to es-delivery.
@elasticsearchmachine elasticsearchmachine added :Delivery/Build Build or test infrastructure >test-failure Triaged test failures from CI labels Jan 30, 2025
@elasticsearchmachine
Copy link
Collaborator Author

This has been muted on branch main

Mute Reasons:

  • [main] 3 failures in test test {yaml=reference/snapshot-restore/apis/get-snapshot-api/line_357} (0.4% fail rate in 801 executions)
  • [main] 2 failures in step part-1 (0.6% fail rate in 352 executions)
  • [main] 2 failures in pipeline elasticsearch-pull-request (0.5% fail rate in 384 executions)

Build Scans:

elasticsearchmachine added a commit that referenced this issue Jan 30, 2025
@elasticsearchmachine
Mute org.elasticsearch.smoketest.DocsClientYamlTestSuiteIT test {yaml…
d98ee4e 
…=reference/snapshot-restore/apis/get-snapshot-api/line_357} #121287
@elasticsearchmachine elasticsearchmachine added the Team:Delivery Meta label for Delivery team label Jan 30, 2025
@elasticsearchmachine
Copy link
Collaborator Author

Pinging @elastic/es-delivery (Team:Delivery)

@elasticsearchmachine elasticsearchmachine added the needs:risk Requires assignment of a risk label (low, medium, blocker) label Jan 30, 2025
@slobodanadamovic slobodanadamovic self-assigned this Feb 3, 2025
@slobodanadamovic slobodanadamovic added low-risk An open issue or test failure that is a low risk to future releases and removed needs:risk Requires assignment of a risk label (low, medium, blocker) labels Feb 3, 2025
@slobodanadamovic slobodanadamovic mentioned this issue Mar 12, 2025
Merged
jfreden pushed a commit to jfreden/elasticsearch that referenced this issue Mar 13, 2025
@slobodanadamovic @jfreden
Disable queryable built-in feature in docs YAML tests (elastic#124684)
15e94ee 
The .security index is created asynchronously on a cluster startup. This
affects some of the docs YAML tests in a way that they need to account
for the existence of the .security index or wait for the index to be
created and green. This PR disables the feature for docs YAML tests.
Disabling the feature in docs YAML tests will solve the flakiness
without affecting the coverage.

Resolves elastic#122343 Resolves
elastic#121748 Resolves
elastic#121611 Resolves
elastic#121345 Resolves
elastic#121338 Resolves
elastic#121337 Resolves
elastic#121288 Resolves
elastic#121287 Resolves
elastic#121867 Resolves
elastic#122335 Resolves
elastic#122681 Resolves
elastic#121976 Resolves
elastic#123094 Resolves
elastic#123192 Resolves
elastic#122983 Resolves
elastic#124671 Resolves
elastic#124103
slobodanadamovic added a commit to slobodanadamovic/elasticsearch that referenced this issue Mar 13, 2025
@slobodanadamovic
Disable queryable built-in feature in docs YAML tests (elastic#124684)
9da2670 
The .security index is created asynchronously on a cluster startup. This
affects some of the docs YAML tests in a way that they need to account
for the existence of the .security index or wait for the index to be
created and green. This PR disables the feature for docs YAML tests.
Disabling the feature in docs YAML tests will solve the flakiness
without affecting the coverage.

Resolves elastic#122343 Resolves
elastic#121748 Resolves
elastic#121611 Resolves
elastic#121345 Resolves
elastic#121338 Resolves
elastic#121337 Resolves
elastic#121288 Resolves
elastic#121287 Resolves
elastic#121867 Resolves
elastic#122335 Resolves
elastic#122681 Resolves
elastic#121976 Resolves
elastic#123094 Resolves
elastic#123192 Resolves
elastic#122983 Resolves
elastic#124671 Resolves
elastic#124103

(cherry picked from commit cac356a)

# Conflicts:
#	muted-tests.yml
slobodanadamovic added a commit to slobodanadamovic/elasticsearch that referenced this issue Mar 13, 2025
@slobodanadamovic
Disable queryable built-in feature in docs YAML tests (elastic#124684)
42b3122 
The .security index is created asynchronously on a cluster startup. This
affects some of the docs YAML tests in a way that they need to account
for the existence of the .security index or wait for the index to be
created and green. This PR disables the feature for docs YAML tests.
Disabling the feature in docs YAML tests will solve the flakiness
without affecting the coverage.

Resolves elastic#122343 Resolves
elastic#121748 Resolves
elastic#121611 Resolves
elastic#121345 Resolves
elastic#121338 Resolves
elastic#121337 Resolves
elastic#121288 Resolves
elastic#121287 Resolves
elastic#121867 Resolves
elastic#122335 Resolves
elastic#122681 Resolves
elastic#121976 Resolves
elastic#123094 Resolves
elastic#123192 Resolves
elastic#122983 Resolves
elastic#124671 Resolves
elastic#124103

(cherry picked from commit cac356a)

# Conflicts:
#	muted-tests.yml
slobodanadamovic added a commit to slobodanadamovic/elasticsearch that referenced this issue Mar 13, 2025
@slobodanadamovic
Disable queryable built-in feature in docs YAML tests (elastic#124684)
8bee2ee 
The .security index is created asynchronously on a cluster startup. This
affects some of the docs YAML tests in a way that they need to account
for the existence of the .security index or wait for the index to be
created and green. This PR disables the feature for docs YAML tests.
Disabling the feature in docs YAML tests will solve the flakiness
without affecting the coverage.

Resolves elastic#122343 Resolves
elastic#121748 Resolves
elastic#121611 Resolves
elastic#121345 Resolves
elastic#121338 Resolves
elastic#121337 Resolves
elastic#121288 Resolves
elastic#121287 Resolves
elastic#121867 Resolves
elastic#122335 Resolves
elastic#122681 Resolves
elastic#121976 Resolves
elastic#123094 Resolves
elastic#123192 Resolves
elastic#122983 Resolves
elastic#124671 Resolves
elastic#124103

(cherry picked from commit cac356a)

# Conflicts:
#	muted-tests.yml
elasticsearchmachine pushed a commit that referenced this issue Mar 13, 2025
@slobodanadamovic
Disable queryable built-in feature in docs YAML tests (#124684) (#124819
192297f 
)

The .security index is created asynchronously on a cluster startup. This
affects some of the docs YAML tests in a way that they need to account
for the existence of the .security index or wait for the index to be
created and green. This PR disables the feature for docs YAML tests.
Disabling the feature in docs YAML tests will solve the flakiness
without affecting the coverage.

Resolves #122343 Resolves
#121748 Resolves
#121611 Resolves
#121345 Resolves
#121338 Resolves
#121337 Resolves
#121288 Resolves
#121287 Resolves
#121867 Resolves
#122335 Resolves
#122681 Resolves
#121976 Resolves
#123094 Resolves
#123192 Resolves
#122983 Resolves
#124671 Resolves
#124103

(cherry picked from commit cac356a)

# Conflicts:
#	muted-tests.yml
elasticsearchmachine pushed a commit that referenced this issue Mar 13, 2025
@slobodanadamovic
Disable queryable built-in feature in docs YAML tests (#124684) (#124822
f536f3f 
)

The .security index is created asynchronously on a cluster startup. This
affects some of the docs YAML tests in a way that they need to account
for the existence of the .security index or wait for the index to be
created and green. This PR disables the feature for docs YAML tests.
Disabling the feature in docs YAML tests will solve the flakiness
without affecting the coverage.

Resolves #122343 Resolves
#121748 Resolves
#121611 Resolves
#121345 Resolves
#121338 Resolves
#121337 Resolves
#121288 Resolves
#121287 Resolves
#121867 Resolves
#122335 Resolves
#122681 Resolves
#121976 Resolves
#123094 Resolves
#123192 Resolves
#122983 Resolves
#124671 Resolves
#124103

(cherry picked from commit cac356a)

# Conflicts:
#	muted-tests.yml
elasticsearchmachine pushed a commit that referenced this issue Mar 13, 2025
@slobodanadamovic
Disable queryable built-in feature in docs YAML tests (#124684) (#124817
ee80f76 
)

The .security index is created asynchronously on a cluster startup. This
affects some of the docs YAML tests in a way that they need to account
for the existence of the .security index or wait for the index to be
created and green. This PR disables the feature for docs YAML tests.
Disabling the feature in docs YAML tests will solve the flakiness
without affecting the coverage.

Resolves #122343 Resolves
#121748 Resolves
#121611 Resolves
#121345 Resolves
#121338 Resolves
#121337 Resolves
#121288 Resolves
#121287 Resolves
#121867 Resolves
#122335 Resolves
#122681 Resolves
#121976 Resolves
#123094 Resolves
#123192 Resolves
#122983 Resolves
#124671 Resolves
#124103

(cherry picked from commit cac356a)

# Conflicts:
#	muted-tests.yml
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@slobodanadamovic slobodanadamovic

Labels
:Delivery/Build Build or test infrastructure low-risk An open issue or test failure that is a low risk to future releases Team:Delivery Meta label for Delivery team >test-failure Triaged test failures from CI
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Disable queryable built-in feature in docs YAML tests slobodanadamovic/elasticsearch
2 participants
@slobodanadamovic @elasticsearchmachine