My favorites | Sign in
Project Home Downloads Wiki Issues Code Search
New issue   Search
for
  Advanced search   Search tips   Subscriptions
Issue 204987: Failure to generate update due to cache clean failure
2 people starred this issue and may be notified of changes. Back to list
Status:  Verified
Moved from:  issue chromium-os:21945
Owner:  davidjames@chromium.org
Closed:  Oct 2011


Sign in to add a comment
 
Project Member Reported by rochb...@chromium.org, Oct 21, 2011
http://chromeos-botmaster.mtv.corp.google.com:8026/builders/x86-alex-binary/builds/1686/steps/cbuildbot/logs/stdio/text is the whole log

The relevant part is below.  My guess: it seems like the devserver is clearing its cache while some other process is clearing the cache, and it's erroring out while it loses the race.   

011/10/21 04:30:14 - cros_generate_test_payloads.py - INFO    : Generating an unsigned full payload to /b/cbuild/x86-alex-private-bin/src/build/images/x86-alex/latest-cbuildbot/chromiumos_test_image.bin
2011/10/21 04:34:47 - cros_generate_test_payloads.py - ERROR   : [21/Oct/2011:11:15:19] DEVSERVER Using cache directory /var/lib/devserver/static/cache
rm: cannot remove directory `bda1c6e94518363415a84d294fd0fa22': No such file or directory

[21/Oct/2011:11:15:22] DEVSERVER Failed to clean up old delta cache files with cd /var/lib/devserver/static/cache; ls -tr | head --lines=-12 | xargs rm -rf
Running ['/b/cbuild/x86-alex-private-bin/src/scripts/sdk_lib/enter_chroot.sh', '--chroot', '/b/cbuild/x86-alex-private-bin/chroot', '--', 'sudo', 'start_devserver', '--pregenerate_update', '--exit', '--image=/home/chrome-bot/trunk/src/build/images/x86-alex/latest-cbuildbot/chromiumos_test_image.bin', '--src_image=/home/chrome-bot/trunk/src/build/images/x86-alex/latest-cbuildbot/chromiumos_qemu_image.bin', '--for_vm'] failed!

Oct 21, 2011
#1 rochb...@chromium.org
Assigning to davidjames for triage
Owner: davidjames@chromium.org
Oct 21, 2011
#2 davidjames@google.com
Yes, rochberg is right: "The devserver is clearing its cache while some other process is clearing the cache, and it's erroring out while it loses the race." Sosa can you investigate?

Status: Assigned
Owner: sosa@chromium.org
Oct 21, 2011
#3 dianders@chromium.org
Continues to hit.  x86-zgb-binary 1559, x86-alex-binary 1687
Oct 21, 2011
#4 davidjames@google.com
sosa@ asked me to take this on, so taking a look...
Owner: davidjames@chromium.org
Oct 21, 2011
#5 dianders@chromium.org
Just a note that x86-alex-binary 1688 passed, but x86-zbg-binary 1560 still failed with the same issue.
Oct 21, 2011
#6 bugdroid1@chromium.org
Commit: 7b26922b1cd2d6a485399afcfc1c955e762e80e8
 Email: davidjames@chromium.org

Always wipe payload cache prior to running tests.

Right now, if payloads are left over from previous runs of ctest,
we'll hit the devserver limit on the number of payloads. In this
case, multiple processes will try to wipe the cache at once, causing
build failures.

BUG=chromium-os:21945
TEST=Trybot run of x86-alex-private-bin

Change-Id: I8edbcd61c3c3057dddb9051660b415d86bea5b1a
Reviewed-on: http://gerrit.chromium.org/gerrit/10502
Reviewed-by: Don Garrett <dgarrett@chromium.org>
Commit-Ready: David James <davidjames@chromium.org>
Tested-by: David James <davidjames@chromium.org>

M	generate_test_payloads/cros_generate_test_payloads.py
Nov 14, 2011
#7 nsand...@chromium.org
This is marked as a TreeCloser. Please confirm that it should be a TreeCloser or remove the label. Please reassign as necessary.
Labels: Pri-0
Nov 14, 2011
#8 davidjames@google.com
Pri-2 is more accurate for this bug
Labels: Pri-2
Nov 21, 2011
#9 sosa@chromium.org
(No comment was entered for this change.)
Status: Fixed
Nov 29, 2011
#10 kr...@chromium.org
(No comment was entered for this change.)
Status: Verified
Jan 9, 2012
#11 chromeos...@chromium.org
(No comment was entered for this change.)
Labels: FixedIn-1211.0.0
Jan 20, 2012
#12 chromeos...@chromium.org
(No comment was entered for this change.)
Labels: FixedInIndex-29
Mar 6, 2013
#13 lafo...@google.com
(No comment was entered for this change.)
Labels: OS-Chrome
Mar 9, 2013
#14 bugdroid1@chromium.org
(No comment was entered for this change.)
Labels: -Area-Build -TreeCloser Build Hotlist-TreeCloser
Sign in to add a comment

Powered by Google Project Hosting