From debbugs-submit-bounces@debbugs.gnu.org Sun Apr 26 11:49:30 2020 Received: (at 39258) by debbugs.gnu.org; 26 Apr 2020 15:49:30 +0000 Received: from localhost ([127.0.0.1]:33960 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1jSjX7-00030f-Q8 for submit@debbugs.gnu.org; Sun, 26 Apr 2020 11:49:30 -0400 Received: from eggs.gnu.org ([209.51.188.92]:36370) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1jSjX6-00030T-2V for 39258@debbugs.gnu.org; Sun, 26 Apr 2020 11:49:28 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]:44907) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jSjWz-0002xl-3h; Sun, 26 Apr 2020 11:49:21 -0400 Received: from [2a01:e0a:1d:7270:af76:b9b:ca24:c465] (port=49140 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1jSjWn-0002cf-9X; Sun, 26 Apr 2020 11:49:18 -0400 From: =?utf-8?Q?Ludovic_Court=C3=A8s?= To: zimoun Subject: Re: benchmark search: default vs v2 vs v3 References: X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 8 =?utf-8?Q?Flor=C3=A9al?= an 228 de la =?utf-8?Q?R?= =?utf-8?Q?=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Sun, 26 Apr 2020 17:49:06 +0200 In-Reply-To: (zimoun's message of "Sun, 26 Apr 2020 05:54:21 +0200") Message-ID: <87lfmi2qod.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.3 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 39258 Cc: Arun Isaac , Pierre Neidhardt , 39258@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Hi, zimoun skribis: > 1) around 25 seconds added to "guix pull"... but I am more than often > waiting around 10 minutes when pulling. > 2) the speedup is clear: more than 2x. Nice! It does seem like Arun=E2=80=99s v3 (or maybe even v2) would work nicely. > The question is the tradeoff between: the slowdown of pull vs the > speedup of search. What is acceptable? That=E2=80=99s only one criterion among others. I hear the argument that 2= 5s is =E2=80=9Cnothing=E2=80=9D compared to the rest, but it=E2=80=99s really a t= radeoff. Like, if I spent a day optimizing =E2=80=98guix pull=E2=80=99 and managed to save 25s,= I would find it nice. :-) > $ time guix pull -C ~/.config/guix/default-channels.scm It also depends on what=E2=80=99s in that file, of course. > Then, if I pull back from 8cf6d15 to '--commit=3Da357849f5b' then it take= s: > > real 2m13.693s > user 1m37.418s > sys 0m0.666s For me: --8<---------------cut here---------------start------------->8--- $ guix describe Generacio 139 Apr 13 2020 21:50:08 (nuna) guix bad368b repository URL: https://git.savannah.gnu.org/git/guix.git branch: master commit: bad368b0d794689f3a8a11b58f1ea4987938682e $ time guix pull -p /tmp/test --commit=3Dbad368b0d794689f3a8a11b58f1ea49879= 38682e Updating channel 'guix' from Git repository at 'https://git.savannah.gnu.or= g/git/guix.git'... Building from this channel: guix https://git.savannah.gnu.org/git/guix.git bad368b [...] real 0m57.916s user 1m1.017s sys 0m0.609s --8<---------------cut here---------------end--------------->8--- (On a 2.6=C2=A0GHz i7 though.) > Well, let remove the profiles and garbage collect the index files: > > rm /tmp/default /tmp/v{2,3}* > guix gc -D \ > /gnu/store/g5c08vqsv31nkn2r0hr32dbrkhf3cvd8-guix-package-cache \ > /gnu/store/8xbzhn81hmshagbgazmnr7xfps1cdsa3-guix-package-search-index \ > /gnu/store/8j78b5c4ddic21gcx7wpbq2akjn7x7mr-guix-package-metadata-cache Could you do, for v2 and v3: time guix build /gnu/store/=E2=80=A6-package-metadata-cache.drv --check ? That we=E2=80=99ll give us the exact cost of that part. It=E2=80=99ll be i= nteresting especially in the Xapian case, which we expected to be higher. Thanks for the insightful benchmarks! Ludo=E2=80=99.