My favorites ▼ | Sign in
Project Home Downloads Wiki Issues Code Search
New issue   Search
for
  Advanced search   Search tips   Subscriptions
Issue 202381: tar: file changed as we read it in ArchiveRegularImages
1 person starred this issue and may be notified of changes. Back to list
Status:  Verified
Moved from:  issue chromium-os:19280
Owner:  davidjames@chromium.org
Closed:  Aug 2011


Sign in to add a comment
 
Project Member Reported by jamescook@chromium.org, Aug 17, 2011 
Saw this failure in the Archive step of x86-generic-full:


INFO: RunCommand: ['/b/scripts/slave/gsutil', 'setacl', '/home/chrome-bot/slave_archive_acl', 'gs://chromeos-image-archive/x86-generic-full/0.15.911.0-a1-b141/factory_image.zip']
Setting ACL on gs://chromeos-image-archive/x86-generic-full/0.15.911.0-a1-b141/factory_image.zip...

INFO: RunCommand: ['tar', 'cf', '/b/cbuild/src/build/images/x86-generic/latest-cbuildbot/autotest.tar.bz2', '--checkpoint=10000', '--use-compress-program=/b/cbuild/chroot/usr/bin/pbzip2', 'autotest'] in /b/cbuild/chroot/build/x86-generic/usr/local
tar: autotest/server/site_tests: file changed as we read it
tar: Write checkpoint 10000
tar: Write checkpoint 20000
tar: Write checkpoint 30000
tar: Write checkpoint 40000
tar: Write checkpoint 50000
tar: Write checkpoint 60000
tar: Write checkpoint 70000
tar: Write checkpoint 80000
tar: Write checkpoint 90000
tar: Write checkpoint 100000
Traceback (most recent call last):
  File "/b/build/slave/x86-generic-full/build/chromite/buildbot/cbuildbot_background.py", line 95, in run
    step()
  File "/b/build/slave/x86-generic-full/build/chromite/buildbot/cbuildbot_stages.py", line 899, in ArchiveRegularImages
    filename = commands.BuildAutotestTarball(buildroot, board, image_dir)
  File "/b/build/slave/x86-generic-full/build/chromite/buildbot/cbuildbot_commands.py", line 828, in BuildAutotestTarball
    cros_lib.RunCommand(cmd, cwd=cwd)
  File "/b/build/slave/x86-generic-full/build/chromite/lib/cros_build_lib.py", line 164, in RunCommand
    raise RunCommandError(msg, cmd, proc.returncode)
RunCommandError: ('Command "[\'tar\', \'cf\', \'/b/cbuild/src/build/images/x86-generic/latest-cbuildbot/autotest.tar.bz2\', \'--checkpoint=10000\', \'--use-compress-program=/b/cbuild/chroot/usr/bin/pbzip2\', \'autotest\']" with extra env None\n', ['tar', 'cf', '/b/cbuild/src/build/images/x86-generic/latest-cbuildbot/autotest.tar.bz2', '--checkpoint=10000', '--use-compress-program=/b/cbuild/chroot/usr/bin/pbzip2', 'autotest'], 1)
Traceback (most recent call last):
  File "/b/build/slave/x86-generic-full/build/chromite/buildbot/cbuildbot_background.py", line 95, in run
    step()
  File "/b/build/slave/x86-generic-full/build/chromite/buildbot/cbuildbot_stages.py", line 928, in BuildAndArchiveAllImages
    ArchiveRegularImages])
  File "/b/build/slave/x86-generic-full/build/chromite/buildbot/cbuildbot_background.py", line 133, in RunParallelSteps
    raise BackgroundException('\n' + ''.join(tracebacks))
BackgroundException: 
Traceback (most recent call last):
  File "/b/build/slave/x86-generic-full/build/chromite/buildbot/cbuildbot_background.py", line 95, in run
    step()
  File "/b/build/slave/x86-generic-full/build/chromite/buildbot/cbuildbot_stages.py", line 899, in ArchiveRegularImages
    filename = commands.BuildAutotestTarball(buildroot, board, image_dir)
  File "/b/build/slave/x86-generic-full/build/chromite/buildbot/cbuildbot_commands.py", line 828, in BuildAutotestTarball
    cros_lib.RunCommand(cmd, cwd=cwd)
  File "/b/build/slave/x86-generic-full/build/chromite/lib/cros_build_lib.py", line 164, in RunCommand
    raise RunCommandError(msg, cmd, proc.returncode)
RunCommandError: ('Command "[\'tar\', \'cf\', \'/b/cbuild/src/build/images/x86-generic/latest-cbuildbot/autotest.tar.bz2\', \'--checkpoint=10000\', \'--use-compress-program=/b/cbuild/chroot/usr/bin/pbzip2\', \'autotest\']" with extra env None\n', ['tar', 'cf', '/b/cbuild/src/build/images/x86-generic/latest-cbuildbot/autotest.tar.bz2', '--checkpoint=10000', '--use-compress-program=/b/cbuild/chroot/usr/bin/pbzip2', 'autotest'], 1)
Aug 18, 2011
#1 bugdroid1@chromium.org 
Commit: 0c2e89c8f6500281b900f2ba3bcbda62f4abec56
 Email: davidjames@chromium.org

Create autotest tarball before running tests.

When tests are running, they may modify the autotest directory. This can
cause the tar command to fail.

To fix this, I've moved the tar command to occur before running tests. To
compensate for any delay added by this change, I've moved the unit tests to
run in parallel with VM tests instead.

BUG=chromium-os:19280
TEST=Run x86-mario-release and x86-generic-pre-flight-queue
     buildbots.

Change-Id: Ia3d3402d79912a47ccd8e5d67e2ac1a467351406
Reviewed-on: http://gerrit.chromium.org/gerrit/6208
Reviewed-by: David James <davidjames@chromium.org>
Tested-by: David James <davidjames@chromium.org>

M	buildbot/cbuildbot.py
M	buildbot/cbuildbot_stages.py
M	buildbot/cbuildbot_stages_unittest.py
Aug 18, 2011
#2 davidjames@chromium.org 
FIXED
Status: Fixed
Sep 13, 2011
#3 chromeos...@chromium.org 
(No comment was entered for this change.)
Labels: FixedIn-0.15-918.0
Sep 13, 2011
#4 chromeos...@chromium.org 
(No comment was entered for this change.)
Labels: -FixedIn-0.15-918.0
Sep 20, 2011
#5 kr...@chromium.org 
(No comment was entered for this change.)
Status: Verified
Sep 20, 2011
#6 chromeos...@chromium.org 
(No comment was entered for this change.)
Labels: FixedIn-0.15-918.0
Oct 25, 2011
#7 chromeos...@chromium.org 
(No comment was entered for this change.)
Labels: -FixedIn-0.15-918.0 FixedIn-918.0.0
Jan 20, 2012
#8 chromeos...@chromium.org 
(No comment was entered for this change.)
Labels: FixedInIndex-1f
Mar 6, 2013
#9 lafo...@google.com 
(No comment was entered for this change.)
Labels: OS-Chrome
Mar 9, 2013
#10 bugdroid1@chromium.org 
(No comment was entered for this change.)
Labels: -Area-Build -TreeCloser Build Hotlist-TreeCloser
► Sign in to add a comment

Powered by Google Project Hosting