Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Blink layout tests are flaky on multivm branch #17855

Closed
whesse opened this issue Mar 27, 2014 · 0 comments
Closed

Blink layout tests are flaky on multivm branch #17855

whesse opened this issue Mar 27, 2014 · 0 comments
Labels
P2 A bug or feature request we're likely to work on type-bug Incorrect behavior (everything from a crash to more subtle misbehavior)

Comments

@whesse
Copy link
Member

whesse commented Mar 27, 2014

The multivm builder and perf bot is sometimes passing the webkit tests now.

There are a small number of tests that are flaky, and perhaps we should add them to the status file on our branch, so we stay green. On linux, a typical webkit tests result is:

Unexpected flakiness: text-only failures (3)
  http/tests/security/isolatedWorld/events.html [ Failure Pass ]
  http/tests/security/redirect-BLOCKED-to-localURL.html [ Failure Pass ]
  svg/dom/SVGScriptElement/script-set-href.svg [ Failure Pass ]

Unexpected flakiness: crashes (1)
  media/audio-delete-while-slider-thumb-clicked.html [ Crash Pass ]

Unexpected flakiness: timeouts (4)
  fast/workers/storage/interrupt-database.html [ Timeout Pass ]
  storage/indexeddb/key-generator.html [ Timeout Pass ]
  storage/indexeddb/odd-strings.html [ Timeout Pass ]
  storage/indexeddb/structured-clone.html [ Timeout Pass ]

Regressions: Unexpected text-only failures (1)
  compositing/iframes/scrolling-iframe.html [ Failure ]

So only the scrolling-iframe.html failure is turning the bot red. I'll also send a candidate CL to put this in the status file.

The windows bot is also almost green - only 2 timeouts turning it red. I'll put those in the CL. But macos has thousands of image mismatches - something needs to be fixed on the setup of the machine, I guess.

So do we want to keep running the webkit tests on these bots, and do we want the results to turn the bots red? There is also some flaky redness in sunspider and a couple other perf tests.

@kevmoo kevmoo added P2 A bug or feature request we're likely to work on type-bug Incorrect behavior (everything from a crash to more subtle misbehavior) and removed triaged labels Mar 1, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
P2 A bug or feature request we're likely to work on type-bug Incorrect behavior (everything from a crash to more subtle misbehavior)
Projects
None yet
Development

No branches or pull requests

3 participants