My favorites | Sign in
Project Home Downloads Wiki Issues Code Search
New issue   Search
for
  Advanced search   Search tips   Subscriptions
Issue 187993: Autotest client terminated unexpectedly DUT rebooted during the test run
2 people starred this issue and may be notified of changes. Back to list
Status:  Duplicate
Merged:  issue 217750
Owner:  d...@chromium.org
Closed:  Apr 2013


Sign in to add a comment
 
Project Member Reported by i...@chromium.org, Mar 12, 2013
OS: stout-release/R27-3814.0.0

We have seen two failures so far, the first happening R27-3814. The error message is: 

experimental_desktopui_VideoSanity                                                 ABORT: Autotest client terminated unexpectedly 
    DUT rebooted during the test run

The logs from the second failure can be found here
http://cautotest/tko/retrieve_logs.cgi?job=/results/2186825-chromeos-test/chromeos1-rack7-host2/debug/

I can't find evidence of a reboot in the log files though.
Mar 18, 2013
#2 tbroch@chromium.org
Another instance of this failing @:
http://chromegw/i/chromeos/builders/stout%20canary/builds/1079
Mar 18, 2013
#3 scottz@chromium.org
Routing to Dan to look at the run_suite error code. 

We should be ignoring all failures, regardless of the stage when the failure happens, if the test is experimental. 



Status: Assigned
Owner: d...@chromium.org
Mar 18, 2013
#4 scottz@chromium.org
Dan, please help ihf diagnose what is going on here and as a second part, look in to stopping run_suite.py from erroring when any experimental tests fail.
Mar 18, 2013
#5 d...@chromium.org
It seems that there were crashes during the test:

http://atlantis4.mtv.corp.google.com/results/2186825-chromeos-test/chromeos1-rack7-host2/crashinfo.chromeos1-rack7-host2/
in file kernel.20130312.130047.0.kcrash:
<2>[ 2633.015612] kernel BUG at /mnt/host/source/src/third_party/kernel/files/drivers/gpu/drm/drm_irq.c:930!

Same thing fir the occurrence in the first post:
http://atlantis4.mtv.corp.google.com/results/2247380-chromeos-test/chromeos1-rack7-host2/crashinfo.chromeos1-rack7-host2/

Note that the same crash happened in the same DUT, could that be some hardware failure?


Apr 3, 2013
#6 dgr...@chromium.org
http://atlantis2.mtv.corp.google.com/results/2425186-chromeos-test/hostless/

Now also on ZGB
Summary: [stout/zgb] experimental_desktopui_VideoSanity - Autotest client terminated unexpectedly DUT rebooted during the test run (was: [stout] experimental_desktopui_VideoSanity - Autotest client terminated unexpectedly DUT rebooted during the test run)
Apr 3, 2013
#7 rohi...@chromium.org
ZGB HW has some media issue. On Stout, this should be fixed as per crosbug.com/p/18231. I will looks into this.
Labels: -Cr-Content-Video Cr-OS-Kernel-Video
Apr 3, 2013
#8 bugdro...@chromium.org
Project: chromiumos/third_party/autotest
Branch : master
Author : Dylan Reid <dgreid@chromium.org>
Commit : 4f269c0fafa59d6fe80bc3a5898e1a80ed5a88b6

Code Review +2: Elly Jones
Verified    +1: Dylan Reid
Change-Id     : I0d4fc0d7989af384f4cd653b87def7bed1cc3bab
Reviewed-at   : https://gerrit.chromium.org/gerrit/47242

autotest: Disable desktop_VideoSanity in BVT

Re land this change as the test is still failing, now on more boards
than just stout.

see gerrit change 46138:

This test fails with a kernel crash on Stout, which in turn causes
Autotest to fail the Canary build rather than ignoring the result
because of the experimental label.  There is a already a tracking high
priority bug to fix this error, and the TPMs are fine with releasing
canaries with this bug on Stout.

BUG=chromium:187993
TEST=none, this removes a test.

Commit-Queue: Dylan Reid <dgreid@chromium.org>

D  client/site_tests/desktopui_VideoSanity/control.bvt
Apr 3, 2013
#9 rohi...@chromium.org
The video played fine when I ran it on the lab Stout devices. I don't see any kernel crash. 

Adding video and kernel team for investigation.
Cc: posciak@chromium.org marcheu@chromium.org tay...@chromium.org
Labels: -Pri-2 -M-27 Pri-1 M-28
Apr 10, 2013
#10 rohi...@chromium.org
Didn't find any issue while running the test on two Stout machines. 
We are tracking the ZGB issue in  Issue 219647 .

https://gerrit.chromium.org/gerrit/#/c/47776/
Status: Fixed
Apr 10, 2013
#11 d...@chromium.org
I'd like to re-open this to follow up on following comment from scottz:

"...look at the run_suite error code. 

We should be ignoring all failures, regardless of the stage when the failure happens, if the test is experimental. "
Apr 10, 2013
#12 rohi...@chromium.org
Since this is a test infra side fix, removing video/kernel team.
Summary: Autotest client terminated unexpectedly DUT rebooted during the test run (was: [stout/zgb] experimental_desktopui_VideoSanity - Autotest client terminated unexpectedly DUT rebooted during the test run)
Status: Assigned
Cc: -charliem...@chromium.org -posciak@chromium.org -marcheu@chromium.org -tay...@chromium.org
Labels: -Cr-OS-Kernel-Video Test-Support
Apr 10, 2013
#13 be...@chromium.org
Just so I don't end up duping something thats a real issue, the unexpected reboot looks like a bug. #10 seems to indicate that it doesn't repro anymore. 

@#1: The line "DUT rebooted during the test run" is only printed out when the bootid changes, you will rarely find logged evidence of an unexpected reboot elsewhere ..unless it was a crash; #5 seems to indicate there were crashes. 

@#11: The issue of an experimental test closing the tree is tracked in 217750.
Apr 11, 2013
#14 d...@chromium.org
(No comment was entered for this change.)
Status: Duplicate
Mergedinto: 217750
Sign in to add a comment

Powered by Google Project Hosting