Multi-threaded compilation of 'syntax-parameterize' forms crashes

OpenSubmitted by Joshua Sierles.
Details
3 participants
  • Joshua Sierles
  • Leo Famulari
  • Ludovic Courtès
Owner
unassigned
Severity
serious
Merged with
J
J
Joshua Sierles wrote on 11 Jul 2017 18:04
guix pull --url fails to build - guix pull works
(address . bug-guix@gnu.org)
1499789087.1788738.1037461752.1AAA7941@webmail.messagingengine.com
I tried 'guix pull' and it worked fine. Then, tried using a git commitfrom master's tip, which should be the same contents. This link containsthe outputs for both attempts.
https://gist.github.com/jsierles/0177424733612947d61af8533084841e
-- Joshua Sierles joshua@joshua.si
L
L
Leo Famulari wrote on 11 Jul 2017 18:35
(name . Joshua Sierles)(address . joshua@joshua.si)(address . 27652@debbugs.gnu.org)
20170711163503.GB32069@jasmine.lan
On Tue, Jul 11, 2017 at 06:04:47PM +0200, Joshua Sierles wrote:
Toggle quote (6 lines)> I tried 'guix pull' and it worked fine. Then, tried using a git commit> from master's tip, which should be the same contents. This link contains> the outputs for both attempts.> > https://gist.github.com/jsierles/0177424733612947d61af8533084841e
For everyone's reference, the failing command was:
$ guix pull --url=https://git.savannah.gnu.org/cgit/guix.git/snapshot/d5ff67f411a6a91f2cfa589d185fbc025046f1db.tar.gz
It failed like this:
------loading... 25.4% of 607 filesrandom seed for tests: 1499787464loading... 99.8% of 607 filescompiling... 88.8% of 607 filescompiling... 89.3% of 607 filesice-9/threads.scm:289:22: In procedure loop:ice-9/threads.scm:289:22: Syntax error:guix/scripts.scm:116:4: >>=: >>= (bind) used outside of 'with-monad' in form (>>= (package->derivation package #:graft? (and (not dry-run?) grafting?)) (lambda (t-24216c5d7b7f7de-597) (mlet* %store-monad () (let ((derivation t-24216c5d7b7f7de-597)) (mbegin %store-monad (maybe-build (list derivation) #:use-substitutes? use-substitutes? #:dry-run? dry-run?) (return (show-derivation-outputs derivation)))))))------
-----BEGIN PGP SIGNATURE-----
iQIzBAABCAAdFiEEsFFZSPHn08G5gDigJkb6MLrKfwgFAllk/jcACgkQJkb6MLrKfwh3JBAAjEkijpgPRjmTVTJoNyRIvCr+3p+rbEtO9YtpC5nyuN9DQiJm1mT/qX6WvT8mmU4xQ0CCwBkUGnuTIzGPv5fsFWkBvzqoCR3Vms/ZWPynIcJjLVrso4WIGvTGLoNNnx5YysaX+Vbvys+vUVe6kKNgENX0VuAI2LeW7E334hvz8aVPqbPLNUxwbwa8LHAEd15KMCMmRl53khDCcbB9QjvLrbseg8FR9tlrQvjLY5nz2N2U1XukE6tpvCZ4j6ENnJK3oQY5RSNYaprIjXA+b/yWrdBBnvFzfO6CWtL/ufos8vcciDlF+v7X4GeQJibJH+EfCArbeBMcnuOk1uZJuUI7LTxRAkq1UDqrfOGU1jZJITPWbqzUPnDCwpDMwfUNHKvlNWlFebUUMJFvXJT+EdKBcMT1RdG0z0wqnk0CqYc9fPUJoiUPl7i/kcHuzYoLy7B8E3D1AO28KZ4RkJl/2gCu1TUP9N/GNUU1xFdD4Pb+o/1XxHEzoO/ZCHN5C8UY3s2c/V1Jw33Y5qIRApW9OLRD6Oc01R5STsa0Gkk5r6EFW7l80Jps7bicTn4VVPXSOy34v603O9WobA6q/ezxvi9LSf6ueHIFlPniI/0Vk9Tl/z8IUejvOYWSJOQQFkmw1xhMMVo+kv/Zop7mlbdX/f7wrHSrybdwqoLSXb/HRfYCByU==HyCb-----END PGP SIGNATURE-----

J
J
Joshua Sierles wrote on 11 Jul 2017 18:48
multi-core server could be the cause
(address . 27652@debbugs.gnu.org)
1499791721.1797352.1037513128.408DA69D@webmail.messagingengine.com
As Ludo mentioned on IRC, this issue could be caused by parallelcompilation on our 64-core server. At first it seemed related to usingthe '--url' option, but I just was able to reproduce this problem usingonly 'guix pull'. I'll look into how I can reduce the number of coresused for compilation and report back.
If this is the case, would this still be considered a bug?
-- Joshua Sierles joshua@joshua.si
L
L
Ludovic Courtès wrote on 26 Aug 2017 12:00
(name . Joshua Sierles)(address . joshua@joshua.si)(address . 27652@debbugs.gnu.org)
87k21qbqdo.fsf@gnu.org
Joshua Sierles <joshua@joshua.si> skribis:
Toggle quote (8 lines)> As Ludo mentioned on IRC, this issue could be caused by parallel> compilation on our 64-core server. At first it seemed related to using> the '--url' option, but I just was able to reproduce this problem using> only 'guix pull'. I'll look into how I can reduce the number of cores> used for compilation and report back.>> If this is the case, would this still be considered a bug?
Marius reported a similar issue, which suggests it may indeed have to dowith parallel compilation on many-core machines:
https://lists.gnu.org/archive/html/guix-devel/2017-08/msg00206.html
(That’s a bug, of course.)
Ludo’.
L
L
Ludovic Courtès wrote on 26 Aug 2017 12:00
control message for bug #27652
(address . control@debbugs.gnu.org)
87inhabqda.fsf@gnu.org
severity 27652 important
L
L
Ludovic Courtès wrote on 26 Aug 2017 12:02
(address . control@debbugs.gnu.org)
87h8wubqao.fsf@gnu.org
retitle 27652 Compilation with 'guix pull' crashes non-deterministically on many-core machines
L
L
Ludovic Courtès wrote on 26 Aug 2017 16:14
control message for bug #27476
(address . control@debbugs.gnu.org)
874lsua01r.fsf@gnu.org
merge 27476 27652
L
L
Ludovic Courtès wrote on 30 Apr 2018 23:40
(address . control@debbugs.gnu.org)
8736zctltr.fsf@gnu.org
retitle 27476 Multi-threaded compilation of 'syntax-parameterize' forms crashes
L
L
Ludovic Courtès wrote on 30 Apr 2018 23:40
(address . control@debbugs.gnu.org)
871sewtltl.fsf@gnu.org
severity 27476 serious
L
L
Ludovic Courtès wrote on 7 Jun 2018 18:19
(address . control@debbugs.gnu.org)
87tvqea7s0.fsf@gnu.org
merge 27476 31740
L
L
Ludovic Courtès wrote on 22 Jan 2019 21:58
(address . control@debbugs.gnu.org)
87h8e0l88o.fsf@gnu.org
merge 27476 34112
L
L
Ludovic Courtès wrote on 6 Feb 2019 14:20
(address . control@debbugs.gnu.org)
875ztxawag.fsf@gnu.org
merge 27476 34319
L
L
Ludovic Courtès wrote on 6 Feb 2019 21:57
(address . control@debbugs.gnu.org)
87h8dg8wjq.fsf@gnu.org
merge 27476 28144
L
L
Ludovic Courtès wrote on 9 Feb 2019 23:11
(address . control@debbugs.gnu.org)
87sgwwpq85.fsf@gnu.org
reassign 27476 guile
?