Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failing test: Entity Analytics - Risk Engine Integration Tests - Serverless Env - Complete Tier.x-pack/test/security_solution_api_integration/test_suites/entity_analytics/risk_engine/trial_license_complete_tier/telemetry_usage·ts - Entity Analytics - Risk Engine @ess @serverless telemetry Risk engine enabled should return riskEngineMetrics with expected values #182881

Closed
kibanamachine opened this issue May 7, 2024 · 1 comment · Fixed by #183915
Closed

Failing test: Entity Analytics - Risk Engine Integration Tests - Serverless Env - Complete Tier.x-pack/test/security_solution_api_integration/test_suites/entity_analytics/risk_engine/trial_license_complete_tier/telemetry_usage·ts - Entity Analytics - Risk Engine @ess @serverless telemetry Risk engine enabled should return riskEngineMetrics with expected values #182881

kibanamachine opened this issue May 7, 2024 · 1 comment · Fixed by #183915
Assignees
@hop-dev
Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Entity Analytics Security Entity Analytics Team

Comments

@kibanamachine
Copy link
Contributor

A test failed on a tracked branch

Error: retry.try reached timeout 120000 ms
Error: expected { unique_user_risk_score_total: 10,
  unique_host_risk_score_total: 10,
  unique_user_risk_score_day: 10,
  unique_host_risk_score_day: 10,
  all_user_risk_scores_total: 450,
  all_host_risk_scores_total: 450,
  all_user_risk_scores_total_day: 450,
  all_host_risk_scores_total_day: 450 } to sort of equal { unique_host_risk_score_total: 0,
  unique_user_risk_score_total: 0,
  unique_user_risk_score_day: 0,
  unique_host_risk_score_day: 0,
  all_user_risk_scores_total: 10,
  all_host_risk_scores_total: 10,
  all_user_risk_scores_total_day: 10,
  all_host_risk_scores_total_day: 10 }
    at Assertion.assert (expect.js:100:11)
    at Assertion.eql (expect.js:244:8)
    at telemetry_usage.ts:124:33
    at processTicksAndRejections (node:internal/process/task_queues:95:5)
    at runAttempt (retry_for_success.ts:29:15)
    at retryForSuccess (retry_for_success.ts:98:21)
    at RetryService.try (retry.ts:51:12)
    at Context.<anonymous> (telemetry_usage.ts:108:9)
    at Object.apply (wrap_function.js:73:16)
    at onFailure (retry_for_success.ts:17:9)
    at retryForSuccess (retry_for_success.ts:84:7)
    at RetryService.try (retry.ts:51:12)
    at Context.<anonymous> (telemetry_usage.ts:108:9)
    at Object.apply (wrap_function.js:73:16)

First failure: kibana-on-merge - 8.14
@kibanamachine kibanamachine added the failed-test A test failure on a tracked branch, potentially flaky-test label May 7, 2024
@botelastic botelastic bot added the needs-team Issues missing a team label label May 7, 2024
@kibanamachine kibanamachine added the Team:Entity Analytics Security Entity Analytics Team label May 7, 2024
@elasticmachine
Copy link
Contributor

Pinging @elastic/security-entity-analytics (Team:Entity Analytics)

@botelastic botelastic bot removed the needs-team Issues missing a team label label May 7, 2024
@hop-dev hop-dev self-assigned this May 20, 2024
@hop-dev hop-dev mentioned this issue May 21, 2024
Merged
hop-dev added a commit that referenced this issue May 23, 2024
@hop-dev @kibanamachine
[Entity Analytics] Simplify telemetry tests, add empty index check an…
b6e0f87 
…d logging (#183915)

## Summary

Closes #182881 

Not sure what went wrong with this test btu I did find the structure
slightly more complicated than needed, I have moved the beforeEach data
loading into the test body and removed the describe blocks.

I have also removed the afterEach, we really shouldnt need to delete the
data twice 😓

I have done [a 200 flaky test
run](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/6059#018f9b55-2231-4655-ab35-c6f26aa49720)
🟠 173 succeeded and 2 failed due to a bootstrap issue which caused the
others not to run.

---------

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
rshen91 pushed a commit to rshen91/kibana that referenced this issue May 30, 2024
@hop-dev @kibanamachine @rshen91
[Entity Analytics] Simplify telemetry tests, add empty index check an…
6d33fbd 
…d logging (elastic#183915)

## Summary

Closes elastic#182881 

Not sure what went wrong with this test btu I did find the structure
slightly more complicated than needed, I have moved the beforeEach data
loading into the test body and removed the describe blocks.

I have also removed the afterEach, we really shouldnt need to delete the
data twice 😓

I have done [a 200 flaky test
run](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/6059#018f9b55-2231-4655-ab35-c6f26aa49720)
🟠 173 succeeded and 2 failed due to a bootstrap issue which caused the
others not to run.

---------

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@hop-dev hop-dev

Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Entity Analytics Security Entity Analytics Team
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[Entity Analytics] Simplify telemetry tests, add empty index check and logging hop-dev/kibana
3 participants
@hop-dev @elasticmachine @kibanamachine