'ssh-daemon' fails to start

  • Done
  • quality assurance status badge
Details
8 participants
  • Martin Castillo
  • Clément Lassieur
  • Christopher Lemmer Webber
  • Taegil Bae
  • Leo Famulari
  • Ludovic Courtès
  • Brant Gardner
  • maxim.cournoyer
Owner
unassigned
Submitted by
Leo Famulari
Severity
important
Merged with
L
L
Leo Famulari wrote on 29 Mar 2018 22:08
OpenSSH sshd killed by Shepherd 0.4.0
(address . bug-guix@gnu.org)
20180329200803.GA15842@jasmine.lan
Since the update to Shepherd 0.4.0, I've found that OpenSSH's sshd is
killed almost immediately after it starts with signal 15. I confirmed
the issue started with the Shepherd upgrade by bisecting our Git
history.

I can reproduce the issue from commit
b6beda1d6b9093a8493b5c3cde33ed522242c451 (gnu: Add botan.).

One interesting tidbit is that the PID file '/var/run/sshd.pid' is not
created anymore. And if I create an empty PID file by hand, it is
removed after trying to start the ssh-daemon service. Also, the sshd
user's home '/var/run/sshd' does not exist, and is similarly removed if
it does exist.

I ran the OpenSSH system test `make check-system TESTS=openssh` and it
failed when it could not find the PID file. It passed on another
non-GuixSD machine. The failing machine is relatively slow and lacks
KVM: a ThinkPad x200s.

After boot, trying to start the service again with `herd start
ssh-daemon` gives the same result.

I modified the sshd invocation to print some debug output ('-d -E
/tmp/sshd.log') and this is what it shows:

------
debug1: sshd version OpenSSH_7.6, OpenSSL 1.0.2o 27 Mar 2018
debug1: private host key #0: ssh-rsa SHA256:REDACTED
debug1: private host key #1: ssh-dss SHA256:REDACTED
debug1: private host key #2: ecdsa-sha2-nistp256 SHA256:REDACTED
debug1: private host key #3: ssh-ed25519 SHA256:REDACTED
debug1: rexec_argv[0]='/gnu/store/az7vib8gk16fybhshh5xpkljmgxyrs4k-openssh-7.6p1/sbin/sshd'
debug1: rexec_argv[1]='-D'
debug1: rexec_argv[2]='-d'
debug1: rexec_argv[3]='-E'
debug1: rexec_argv[4]='/tmp/sshd.log'
debug1: rexec_argv[5]='-f'
debug1: rexec_argv[6]='/gnu/store/miy7xg5j4fg3mn04mcl27awmcl6s97ss-sshd_config'
debug1: Set /proc/self/oom_score_adj from 0 to -1000
debug1: Bind to port 22 on 0.0.0.0.
Server listening on 0.0.0.0 port 22.
debug1: Bind to port 22 on ::.
Server listening on :: port 22.
Received signal 15; terminating.
------

My system configuration file, the shepherd log messages, and the OpenSSH
system test logs are attached. Any ideas?
Mar 29 15:47:32 localhost shepherd[1]: Service syslogd has been started.
Mar 29 15:47:33 localhost shepherd[1]: Service loopback has been started.
Mar 29 15:47:34 localhost shepherd[1]: Service virtual-terminal has been started.
Mar 29 15:47:35 localhost shepherd[1]: Service term-tty6 has been started.
Mar 29 15:47:35 localhost shepherd[1]: Service term-tty5 has been started.
Mar 29 15:47:36 localhost shepherd[1]: Service term-tty4 has been started.
Mar 29 15:47:38 localhost shepherd[1]: Service term-tty3 has been started.
Mar 29 15:47:39 localhost shepherd[1]: Service term-tty2 has been started.
Mar 29 15:47:41 localhost shepherd[1]: Service term-tty1 has been started.
Mar 29 15:47:43 localhost shepherd[1]: Service term-auto could not be started.
Mar 29 15:47:44 localhost shepherd[1]: Service console-font-tty1 has been started.
Mar 29 15:47:46 localhost shepherd[1]: Service console-font-tty2 has been started.
Mar 29 15:47:48 localhost shepherd[1]: Service console-font-tty3 has been started.
Mar 29 15:47:49 localhost shepherd[1]: Service console-font-tty4 has been started.
Mar 29 15:47:50 localhost shepherd[1]: Service console-font-tty5 has been started.
Mar 29 15:47:50 localhost shepherd[1]: Service console-font-tty6 has been started.
Mar 29 15:47:51 localhost shepherd[1]: Service dbus-system has been started.
Mar 29 15:47:51 localhost shepherd[1]: Service networking has been started.
Mar 29 15:47:52 localhost shepherd[1]: Service ntpd has been started.
Mar 29 15:47:56 localhost shepherd[1]: Service ssh-daemon could not be started.
Mar 29 15:47:59 localhost shepherd[1]: Service gpm has been started.
Mar 29 15:48:29 localhost vmunix: [ 5.486795] shepherd[1]: Service root has been started.
Mar 29 15:48:29 localhost vmunix: [ 7.379651] shepherd[1]: starting services...
Mar 29 15:48:29 localhost vmunix: [ 7.381562] shepherd[1]: Service root-file-system has been started.
Mar 29 15:48:29 localhost vmunix: [ 7.383337] shepherd[1]: Service user-file-systems has been started.
Mar 29 15:48:29 localhost vmunix: [ 7.625406] shepherd[1]: Service file-system-/home has been started.
Mar 29 15:48:29 localhost vmunix: [ 7.627645] shepherd[1]: Service file-system-/dev/pts has been started.
Mar 29 15:48:29 localhost vmunix: [ 7.629909] shepherd[1]: Service file-system-/dev/shm has been started.
Mar 29 15:48:29 localhost vmunix: [ 7.632089] shepherd[1]: Service file-system-/gnu/store has been started.
Mar 29 15:48:29 localhost vmunix: [ 7.633924] shepherd[1]: Service file-systems has been started.
Mar 29 15:48:29 localhost vmunix: [ 7.731477] shepherd[1]: waiting for udevd...
Mar 29 15:48:29 localhost vmunix: [ 8.331344] shepherd[1]: Service udev has been started.
Mar 29 15:48:30 localhost vmunix: [ 8.446599] shepherd[1]: Service urandom-seed has been started.
Mar 29 15:48:30 localhost vmunix: [ 8.448462] shepherd[1]: Service user-processes has been started.
Mar 29 15:48:30 localhost vmunix: [ 8.450424] shepherd[1]: Service host-name has been started.
Mar 29 15:48:30 localhost vmunix: [ 8.546746] shepherd[1]: Service user-homes could not be started.
Mar 29 15:48:30 localhost vmunix: [ 9.554051] shepherd[1]: Service nscd has been started.
Mar 29 15:48:30 localhost vmunix: [ 9.606182] shepherd[1]: Service guix-daemon has been started.
Mar 29 15:49:21 localhost shepherd[1]: Respawning term-tty2.
Mar 29 15:49:21 localhost shepherd[1]: Service term-tty2 has been started.
Mar 29 15:49:28 localhost shepherd[1]: Respawning term-tty1.
Mar 29 15:49:28 localhost shepherd[1]: Service term-tty1 has been started.
;; This is an operating system configuration template ;; for a "bare bones" setup, with no X11 display server. (use-modules (gnu)) (use-service-modules networking dbus ssh sysctl) (use-package-modules certs curl ssh rsync tmux version-control vim) (operating-system (host-name "computer") (timezone "America/New_York") (locale "en_US.UTF-8") (kernel-arguments '(;; Console resolution "gfxpayload=1440x900x16,1440x900" ;; console cursor. stops the blinking but the colors are bad "vt.cur.default=0x520032" "consoleblank=120" "quiet")) ;; Assuming /dev/sdX is the target hard disk, and "my-root" is ;; the label of the target root file system. (bootloader (grub-configuration (target "/dev/sda") (terminal-outputs '(console)))) (file-systems (cons* (file-system (device "my-root") (title 'label) (mount-point "/") (type "ext4")) (file-system (device "home") (title 'label) (mount-point "/home") (type "ext4")) %base-file-systems)) ;; This is where user accounts are specified. The "root" ;; account is implicit, and is initially created with the ;; empty password. (users (cons (user-account (name "leo") (comment "") (group "users") ;; Adding the account to the "wheel" group ;; makes it a sudoer. Adding it to "audio" ;; and "video" allows the user to play sound ;; and access the webcam. (supplementary-groups '("wheel" "netdev" "audio")) (home-directory (string-append "/home/" name))) %base-user-accounts)) ;; Globally-installed packages. (packages (cons* curl git openssh mosh nss-certs rsync tmux vim %base-packages)) (services (cons* (dbus-service) (gpm-service) (service openssh-service-type (openssh-configuration (password-authentication? #f))) (ntp-service) (wicd-service) (modify-services %base-services (guix-service-type config => (guix-configuration (inherit config) (substitute-urls '("https://berlin.guixsd.org https://mirror.hydra.gnu.org"))))))))
Attachment: check.log
-----BEGIN PGP SIGNATURE-----

iQIzBAABCAAdFiEEsFFZSPHn08G5gDigJkb6MLrKfwgFAlq9R6AACgkQJkb6MLrK
fwjYhxAAspQ8Xkb3/m2SOEAQM9jRw1OwhshfiH8o0fwNywt4wEFV/xTTVwIG1PS0
/GoOPp7P9Yaf82mOX3BuuykFmAE+DLtP4Ee2rwLFA/vM7rMAkLaGjId7h/e/L+M4
7XBVT2esgCkKwD2hM5zWiMUWF+7YsoV4jRh9u0YZ28B8mmAxqTgArSsgl94Z+Y4l
Fh6WPt1ztTyRgn0P3GiWwdqNeHMNXeLwX2/jA7XtpGv0jin/dSkIX//dzC4cXqVB
3jB05GlgOdlYvMMijx/bGPf2RBhUtWya48fbPaCI+GCZHAZr/fR9weUF5lTFyjQ8
lpo3rehm1ED3D264ocnoTxMMktlJdNPmXoX2W9Lz3cQU6KuUNTSWTV6mmCxTbCaS
nQosqZvc8kLxdlY6lEO6Xs2E6y2v7qLTkuA+BZEv5zsOzSTMzGIN6XYODmdoFcv9
E9z5oFxHaUn+BnpfrfM0hCLIH8XbjVhRkmlJU2J4pkFLC7yiw0OglG+FwIq9vYgb
IOwxF2M2hcnSAuUgJjLh/vlGun2yXvb2SwcjGX7+a2Q8XL4Vp8rTTRXTYO0EwlR1
GMJl5TgJBq8iExTLJLtBybcKhO1cReIQq1YlXWjrao9ckqzZeyo/lacpyQibrcdU
0okRQAPdL1NnRyBoyu/9cqLdR6DrPExJxL/AEvMtaMWYlL4Jios=
=t4kS
-----END PGP SIGNATURE-----


L
L
Ludovic Courtès wrote on 6 Apr 2018 10:21
(name . Leo Famulari)(address . leo@famulari.name)(address . 30993@debbugs.gnu.org)
877epk3fuy.fsf@gnu.org
Hi Leo,

Leo Famulari <leo@famulari.name> skribis:

Toggle quote (14 lines)
> Since the update to Shepherd 0.4.0, I've found that OpenSSH's sshd is
> killed almost immediately after it starts with signal 15. I confirmed
> the issue started with the Shepherd upgrade by bisecting our Git
> history.
>
> I can reproduce the issue from commit
> b6beda1d6b9093a8493b5c3cde33ed522242c451 (gnu: Add botan.).
>
> One interesting tidbit is that the PID file '/var/run/sshd.pid' is not
> created anymore. And if I create an empty PID file by hand, it is
> removed after trying to start the ssh-daemon service. Also, the sshd
> user's home '/var/run/sshd' does not exist, and is similarly removed if
> it does exist.

Weird. On my laptop /var/run/sshd.pid exists and contains the right
PID. /var/run/sshd does not exist, though.

When I run the config you posted in ‘guix system vm’, ‘ssh-daemon’ is
correctly started and I see a correct ssh.pid and /var/run/sshd exists
as well.

Toggle quote (5 lines)
> I ran the OpenSSH system test `make check-system TESTS=openssh` and it
> failed when it could not find the PID file. It passed on another
> non-GuixSD machine. The failing machine is relatively slow and lacks
> KVM: a ThinkPad x200s.

FWIW on my x86_64 laptop, I’ve run it several times in a row (using
“guix build /gnu/store/…-openssh.drv --check”), and it always succeeds.

Toggle quote (24 lines)
> I modified the sshd invocation to print some debug output ('-d -E
> /tmp/sshd.log') and this is what it shows:
>
> ------
> debug1: sshd version OpenSSH_7.6, OpenSSL 1.0.2o 27 Mar 2018
> debug1: private host key #0: ssh-rsa SHA256:REDACTED
> debug1: private host key #1: ssh-dss SHA256:REDACTED
> debug1: private host key #2: ecdsa-sha2-nistp256 SHA256:REDACTED
> debug1: private host key #3: ssh-ed25519 SHA256:REDACTED
> debug1: rexec_argv[0]='/gnu/store/az7vib8gk16fybhshh5xpkljmgxyrs4k-openssh-7.6p1/sbin/sshd'
> debug1: rexec_argv[1]='-D'
> debug1: rexec_argv[2]='-d'
> debug1: rexec_argv[3]='-E'
> debug1: rexec_argv[4]='/tmp/sshd.log'
> debug1: rexec_argv[5]='-f'
> debug1: rexec_argv[6]='/gnu/store/miy7xg5j4fg3mn04mcl27awmcl6s97ss-sshd_config'
> debug1: Set /proc/self/oom_score_adj from 0 to -1000
> debug1: Bind to port 22 on 0.0.0.0.
> Server listening on 0.0.0.0 port 22.
> debug1: Bind to port 22 on ::.
> Server listening on :: port 22.
> Received signal 15; terminating.
> ------

Hmm, where could that SIGTERM come from? ‘make-kill-destructor’ uses it
when a service is stopped, and otherwise it’s sent when we’re shutting
the system down. But here?…

Thanks,
Ludo’.
L
L
Leo Famulari wrote on 6 Apr 2018 14:41
(name . Ludovic Courtès)(address . ludo@gnu.org)(address . 30993@debbugs.gnu.org)
20180406124101.GB1883@jasmine.lan
On Fri, Apr 06, 2018 at 10:21:09AM +0200, Ludovic Courtès wrote:
[...]
Toggle quote (10 lines)
> > Server listening on 0.0.0.0 port 22.
> > debug1: Bind to port 22 on ::.
> > Server listening on :: port 22.
> > Received signal 15; terminating.
> > ------
>
> Hmm, where could that SIGTERM come from? ‘make-kill-destructor’ uses it
> when a service is stopped, and otherwise it’s sent when we’re shutting
> the system down. But here?…

Indeed, that is the question. Does anyone have advice for debugging?

I still have this issue and so I'm continuing to use Shepherd 0.3.2.
-----BEGIN PGP SIGNATURE-----

iQIzBAABCAAdFiEEsFFZSPHn08G5gDigJkb6MLrKfwgFAlrHat0ACgkQJkb6MLrK
fwgNFg//X+diB7+Bg11URGH73/vda9Xpt9FSFqz6lo9fbnAj/Seli28MGZdYYaYt
GalvF62goVye0IT8UET7MAenHTatffaJt6wv5ejen5AdxbsH0tjFPJT+GqU5nNXo
09uAniGJOykbMZTejoGuC7Zr05zKubwH4R3mnctpEMs8i4Y2YrEasBJlUAkUZciu
mzqGLIIhcvSPrKujqLV9RgJeCi2zMwpEBV0KNSdUy0gmEODlDl/1ObcFrKY7Ykzh
6JiMygz52NKEoQtIre9VX2e+0LuVKMppWnrTI2NPhU56T8E+sJGm88Wo0Ntm2cWU
LZNPrT0EeFa91yYhuCLIlp5L0HtdCno8J3aJ1UqF8te5a3BswLE6FehdAJCEmTOt
rrNlEXPed8+aSYfuXxdxYKaP2IRrTEQB8d6bLzkvT6Lca0PvbqD9G1nCkBeXh8P4
I4eDpgLLHQ4lpZC/ivQFew8nEUQC1Rvtjzk+9RjRqvGy321FWplI7QsLOSY5grR+
DAz1+kouOCuGU0m6aA636+lsFf703FTRzP0mq3G6j9u2S48q9MX+mFWfltfGCEKe
mfl9HfWiT7PIDBJMjly7ILC1UkwPrBrISOQ93fdVS1IMifLuzKK3yIZ0zaltFQM5
vDZXSD3OcC4pF+LMGH+LKEhGZckOWYGH8WPXvcs0qka2NUf6Apo=
=b2IG
-----END PGP SIGNATURE-----


L
L
Ludovic Courtès wrote on 6 Apr 2018 16:32
control message for bug #30993
(address . control@debbugs.gnu.org)
87r2nsz9pi.fsf@gnu.org
severity 30993 important
L
L
Ludovic Courtès wrote on 6 Apr 2018 16:37
Re: bug#30993: OpenSSH sshd killed by Shepherd 0.4.0
(name . Leo Famulari)(address . leo@famulari.name)(address . 30993@debbugs.gnu.org)
87po3cz9i3.fsf@gnu.org
Leo Famulari <leo@famulari.name> skribis:

Toggle quote (16 lines)
> On Fri, Apr 06, 2018 at 10:21:09AM +0200, Ludovic Courtès wrote:
> [...]
>> > Server listening on 0.0.0.0 port 22.
>> > debug1: Bind to port 22 on ::.
>> > Server listening on :: port 22.
>> > Received signal 15; terminating.
>> > ------
>>
>> Hmm, where could that SIGTERM come from? ‘make-kill-destructor’ uses it
>> when a service is stopped, and otherwise it’s sent when we’re shutting
>> the system down. But here?…
>
> Indeed, that is the question. Does anyone have advice for debugging?
>
> I still have this issue and so I'm continuing to use Shepherd 0.3.2.

For you the bug is 100% reproducible with 0.4.0 and never happens with
0.3.2? Even in a ‘guix system vm’?

Ludo’.
M
M
Martin Castillo wrote on 1 May 2018 15:13
(address . bug-guix@gnu.org)
a61fd87e-8f57-bae7-7747-e4be02161a4d@uni-bremen.de
(resending because I forgot to CC the list)

On 06.04.2018 14:41, Leo Famulari wrote:
Toggle quote (9 lines)
>> Hmm, where could that SIGTERM come from? ‘make-kill-destructor’ uses it
>> when a service is stopped, and otherwise it’s sent when we’re shutting
>> the system down. But here?…
>
> Indeed, that is the question. Does anyone have advice for debugging?
>
> I still have this issue and so I'm continuing to use Shepherd 0.3.2.
>

Maybe one could somehow strace herd, or change the make-kill-destructor
to log every time it is being executed?

I'm not that fluent in guile so maybe someone else could do that?
L
L
Ludovic Courtès wrote on 1 May 2018 22:43
(name . Martin Castillo)(address . castilma@uni-bremen.de)(address . 30993@debbugs.gnu.org)
87r2mvnm29.fsf@gnu.org
Martin Castillo <castilma@uni-bremen.de> skribis:

Toggle quote (15 lines)
> (resending because I forgot to CC the list)
>
> On 06.04.2018 14:41, Leo Famulari wrote:
>>> Hmm, where could that SIGTERM come from? ‘make-kill-destructor’ uses it
>>> when a service is stopped, and otherwise it’s sent when we’re shutting
>>> the system down. But here?…
>>
>> Indeed, that is the question. Does anyone have advice for debugging?
>>
>> I still have this issue and so I'm continuing to use Shepherd 0.3.2.
>>
>
> Maybe one could somehow strace herd, or change the make-kill-destructor
> to log every time it is being executed?

‘herd status sshd’ displays the last time sshd was respawned, but the
info ‘herd’ receives actually includes the dates of all the respawns,
not just the last one. Is that what you’re asking for?

Thanks,
Ludo’.
M
M
Martin Castillo wrote on 3 May 2018 17:16
(name . Ludovic Courtès)(address . ludo@gnu.org)(address . 30993@debbugs.gnu.org)
b1b51eb6-77f1-0b53-4f18-3a83fe7ef24c@uni-bremen.de
On 01.05.2018 22:43, Ludovic Courtès wrote:
Toggle quote (8 lines)
>> Maybe one could somehow strace herd, or change the make-kill-destructor
>> to log every time it is being executed?
>
> ‘herd status sshd’ displays the last time sshd was respawned, but the
> info ‘herd’ receives actually includes the dates of all the respawns,
> not just the last one. Is that what you’re asking for?
>

My idea was that maybe make-kill-destructor is being called from
somewhere else. If this is being
logged, one could rule that out.

Another wild idea would be sshd killing itself for some reason. stracing
sshd would tell us, if that's the case. How would one do that? Does
shepherd provide some debugging functions?

Or does linux provide a way to log all sent signals so one could find
the sending process?

Martin

--
GPG: 7FDE 7190 2F73 2C50 236E 403D CC13 48F1 E644 08EC
L
L
Leo Famulari wrote on 3 May 2018 18:38
(name . Martin Castillo)(address . castilma@uni-bremen.de)
20180503163808.GA1019@jasmine.lan
On Thu, May 03, 2018 at 05:16:32PM +0200, Martin Castillo wrote:
Toggle quote (22 lines)
>
>
> On 01.05.2018 22:43, Ludovic Courtès wrote:
> >> Maybe one could somehow strace herd, or change the make-kill-destructor
> >> to log every time it is being executed?
> >
> > ‘herd status sshd’ displays the last time sshd was respawned, but the
> > info ‘herd’ receives actually includes the dates of all the respawns,
> > not just the last one. Is that what you’re asking for?
> >
>
> My idea was that maybe make-kill-destructor is being called from
> somewhere else. If this is being
> logged, one could rule that out.
>
> Another wild idea would be sshd killing itself for some reason. stracing
> sshd would tell us, if that's the case. How would one do that? Does
> shepherd provide some debugging functions?
>
> Or does linux provide a way to log all sent signals so one could find
> the sending process?

I haven't had time to debug this yet, and Shepherd 0.3 still works.

Since nobody else can reproduce the bug, and since I expect OpenSSH to
be commonly used, I suspect some non-deterministic Guile mis-compilation
or filesystem corruption — the system in question is using ext4.
-----BEGIN PGP SIGNATURE-----

iQIzBAABCAAdFiEEsFFZSPHn08G5gDigJkb6MLrKfwgFAlrrOu0ACgkQJkb6MLrK
fwjwEw/9GWU0ObLtXCmd3jJ/JXagYqRmUnVaKvTlfohnlucPrliNzQ6z5Dx6E3He
ETjXbEQZ6U9ZGebIrSHunCNHialLW4gQ6cijnoAASIkGNb0gtA4rOr0pQHuxk9Do
c3x3IdW3kO8mzL1JQVo+ZBidYw50bccq0HcNMGIkLRDClZxkrK19AnMS5O9Jx3MI
4N0Vz5a0FZE3MwEDxycR6LA0X5DVVAv9QbiHPpzopFiTwfQLUDfnD8zbQhvIWmJX
nap6HPk5sg3Nyo5pOb9rbZUmEvwUwA5YFFqfmRS5g2ZZ6RdrE3zlC9zEEEO05UDv
wlAyRfalmpGw69XWarULwUn7DMnZ4/cO8TpAiEajOb/+rsP71oJ+8Qa1QQTyNCOG
G5FTUb2xodiw/kfY2x2HSf0Ct/IMbq4Qhnx6GfawxB7C1c8OFh3hiWN7j2hWR+Po
rnMZ7btY7E+dRh7iTo/+A5a+/vaRSPYoCS9aPUZzsxSTscrD6yzCaDA/mu9yIL/X
Dv2vC+V439PaqI8YSH3la6aWvlTWr4VqG5ADYtNtswUv9jJgPRYiagau6ZBYrlw2
sz2TT/GJUozWyIl1RcJTTqa8nNBeYgsx+DK9dG3K7qtODDgD/W+iOptkPug+8t0f
+RlvKTWqB2urmxpXes/Kb6fYaybL75JGhqEpdSD9BzSRrj1N0tE=
=/ead
-----END PGP SIGNATURE-----


M
M
Martin Castillo wrote on 4 May 2018 04:01
(name . Leo Famulari)(address . leo@famulari.name)
FB84BAEB-5F14-45C2-9BD6-8FF8CFA5BAD5@uni-bremen.de
Sorry, I forgot to mention that I have the same problem. But I had it already with shepherd 0.3.
L
L
Leo Famulari wrote on 6 May 2018 21:50
(name . Martin Castillo)(address . castilma@uni-bremen.de)
20180506195050.GD8038@jasmine.lan
On Fri, May 04, 2018 at 04:01:52AM +0200, Martin Castillo wrote:
Toggle quote (2 lines)
> Sorry, I forgot to mention that I have the same problem. But I had it already with shepherd 0.3.

Interesting. Did it ever work for you on that system?
-----BEGIN PGP SIGNATURE-----

iQIzBAABCAAdFiEEsFFZSPHn08G5gDigJkb6MLrKfwgFAlrvXJoACgkQJkb6MLrK
fwgTHg//SEB3jG8sKLmpiY4D+vUhlZpQFOg5fZI7QDq749/N2WgM/yg1ZIz9AptQ
gxixuZPTAyBGzOQTkB+BwGHwvhDBcMRuyqJ2bUDWstGcmvq2cBnvBOGLppG2wXsf
lcHnDo+5aCaZ5iFFkyuhOIfBb9dM7oMP6irpgGd1MCS5Yur/Tv8Wkd/l7CRV3SIX
cQrVKrsLtTI4BIiMoazDSiEzQ50k0L6d7KWsO7Reu8/4Qd/4bbeJeKcRkuL+MVRJ
6ccYLx81CurgDQcUGWV9Un9dIIkYTq2tuyO5PwoFIMpds6yQRLn2cx61FBggZdq/
ujL/Xs4cjN/H8+0eA6ZfjfLccVKUoeQqPyQkqow6ahvywyYlebBLiE6byNrsL9rh
0S1FErw2C4XheLJ+zvGowRGTrsNYBBsmAzu/ZXMOMYSbV6IRi4pRHfneQzjNs+tH
7UWihSW3yWoY1sf+4jIiFqzXvcGcxrwY5C5iAgb7FCMmUuvjn1D2Soomb2PBMmUa
+ksTAM0bmY+6QXGwNw+ql1F8hnR8Zl3ISntsRADBLAf87aqcY7//KAvHiqJZ4gYc
MaedC0px3tW8giQRbWxMnO66TUQq6S3SkdYRa2g+WNyqBXZDVH4DZe+i/LN2GodA
lzhYRQsTVKRyhph/kqt9mHZTE77sFyUw+A9OGppvpF9/UVd3sXs=
=SHOl
-----END PGP SIGNATURE-----


M
M
Martin Castillo wrote on 7 May 2018 21:10
bug#30993: OpenSSH sshd killed by Shepherd 0.4.0
(name . Leo Famulari)(address . leo@famulari.name)
fb962e2b-2b18-7adc-ff6d-5fbb0a56c8b4@uni-bremen.de
On 06.05.2018 21:50, Leo Famulari wrote:
Toggle quote (6 lines)
> On Fri, May 04, 2018 at 04:01:52AM +0200, Martin Castillo wrote:
>> Sorry, I forgot to mention that I have the same problem. But I had it already with shepherd 0.3.
>
> Interesting. Did it ever work for you on that system?
>
> that system?
Do you mean shepherd 0.3? Yes. And once(or so) with shepherd 0.4.

I reported that here [0]. Some of the mentioned files needed small
changes for the current guix, but ssh works with all of them, strangely.

I attached my current configuration, where I need to start the daemon
manually (herd start ssh-daemon) after each boot.

Martin



Attachment: cur.scm
L
L
Ludovic Courtès wrote on 15 Jun 2018 11:07
control message for bug #30993
(address . control@debbugs.gnu.org)
87602kwh7e.fsf@gnu.org
tags 30993 unreproducible
L
L
Leo Famulari wrote on 18 Jul 2018 20:29
(no subject)
(address . control@debbugs.gnu.org)
20180718182910.GA23198@jasmine.lan
merge 32197 30993
-----BEGIN PGP SIGNATURE-----

iQIzBAABCAAdFiEEsFFZSPHn08G5gDigJkb6MLrKfwgFAltPhvYACgkQJkb6MLrK
fwjngw/8DIbj1gfhhtCZ9YsFe7hLJjYqSZyXF0FmCVhMiHW25bu/UxmuYsiFGe50
zTewIlZbzPKmACmU99y3w/NRWip7+P3qTemBw64ddHVCytZ9md9gjQhhQVg0oGzR
nyjNE/qtKFJnEegMhD/6wilgozp6D3SibETPnBB5qjfTxdZ9x2KdmPru5TT/NQpZ
+vTHESM0mUgWaSmrI56gGuiDZLL2h8wqkkEfdknl2t7Zuxq15Vshk7nMhwSZAxJ8
RSrvAXBEMU5Fa8MIox+gpO6xrLKHG+Ew2CvZKeTf6puJSNQwEN08UCc2ElZfPf3E
gbtHLKaISzlVb8iz+qChZ+b2YMaTkmgKY1M6Q4KvsSnomkhCw6NkC2U6E6wMes6t
cdAHakAnDdavOvNxYs8xeSowDVDE9pIhx7xBUp3DG6c3lK5IFgk0gDYnHVOoIgkG
n4YEgNXUNmKpnvKfdy9Tu/RSPqMNixejqGtapwNDkL7ysXdyBBzMKHizCjls7lxP
1xA+BaYgw5l0QrpvYmL9uUCyeJlJe3p2uNtZe1v/KuEuO4Un8XfnvPWbus4ba0Px
Ts8pgQZMbHKm4eCaokvxLEoqj4CB8mcT2MMQFOUcGx8yzn+JrD7ZR1jHKt69a3DX
5hUsACh7UEKU4O/tE3lK691sHcP1sYGnZ5adSIk5wpXBbk0UkJQ=
=Oq18
-----END PGP SIGNATURE-----


C
C
Clément Lassieur wrote on 19 Jul 2018 15:15
Re: bug#30993: OpenSSH sshd killed by Shepherd 0.4.0
87sh4f5ptn.fsf@lassieur.org
Heya,

Martin Castillo <castilma@uni-bremen.de> writes:

Toggle quote (15 lines)
> On 06.05.2018 21:50, Leo Famulari wrote:
>> On Fri, May 04, 2018 at 04:01:52AM +0200, Martin Castillo wrote:
>>> Sorry, I forgot to mention that I have the same problem. But I had it already with shepherd 0.3.
>>
>> Interesting. Did it ever work for you on that system?
>>
>> that system?
> Do you mean shepherd 0.3? Yes. And once(or so) with shepherd 0.4.
>
> I reported that here [0]. Some of the mentioned files needed small
> changes for the current guix, but ssh works with all of them, strangely.
>
> I attached my current configuration, where I need to start the daemon
> manually (herd start ssh-daemon) after each boot.

I don't think you're having the same bug. Martin can manually start the
daemon, whereas Leo can't. So Martin seems to have
has been pushed by Julien.

Martin, could you please test it? (You just need to 'guix pull' and try
again.) Leo, if you confirm my analysis, could you please unmerge the
bugs?

Thanks,
Clément
C
C
Clément Lassieur wrote on 19 Jul 2018 16:24
control message for bug #30993
(address . control@debbugs.gnu.org)
87pnzj5mms.fsf@lassieur.org
unmerge 30993
C
C
Clément Lassieur wrote on 19 Jul 2018 16:26
Re: bug#30993: OpenSSH sshd killed by Shepherd 0.4.0
87muun5mj0.fsf@lassieur.org
Clément Lassieur <clement@lassieur.org> writes:

Toggle quote (2 lines)
> Leo, if you confirm my analysis, could you please unmerge the bugs?

I did it, because Eric confirmed the fix.
Clément
L
L
Leo Famulari wrote on 19 Jul 2018 18:57
(name . Clément Lassieur)(address . clement@lassieur.org)
20180719165730.GA8867@jasmine.lan
On Thu, Jul 19, 2018 at 04:26:59PM +0200, Clément Lassieur wrote:
Toggle quote (6 lines)
> Clément Lassieur <clement@lassieur.org> writes:
>
> > Leo, if you confirm my analysis, could you please unmerge the bugs?
>
> I did it, because Eric confirmed the fix.

Thanks, sorry for the confusion!
-----BEGIN PGP SIGNATURE-----

iQIzBAABCAAdFiEEsFFZSPHn08G5gDigJkb6MLrKfwgFAltQwvcACgkQJkb6MLrK
fwhBexAAgwyIwR6u2bFrxqggaqEu4E+PV5yNkEnLYynx9Nh0rROvQNeDoqZQ+Oix
YKwOoPYPkY9eTHYbdvqEL1r8gGjUrSn/tBAlmGiuXTf9xVxkEmsBs1qYnKbAnTJ9
aWbCn3DtYxYkOi0hjCALb8FmPFiOcM0/7uFxfLNzwcTWq+R27AiTKAsUe3nf6zXW
+32yEm/7F3gcC73HaA3+EkqzmUYTAETqxqnkNz3ODMYMk7iBUmBpZ3LyHc6nWda0
L1SZF/uV8herR7xxo1q/sHyxwsAN51CBOprIyiKinafyZDohzqcKkjffnk9rm0TZ
h1IlwAWlseqZUJzIS3fCNRsmvQf1AklgZ6UafyWXxyjL6TIu0QDyV62MGwyIY69k
l9YSPb+n+7X/I28hDsLLzGIFoVoJzv6vLaeRECyCTG6gQ54V61yO6v1F4O2VEkBC
F2A4NN1bXQYhZnj7rPwjxmEkHNNrZRLbAoDBHE9hV9yvBA1RniTkXONupI9IV2O/
bkZitsF8N7A6jfoiqyEfCnMwegz743OAFuPc/bx1DvBFyJfwbjZ6VZexEcrbLf5T
AJ/aXUmiAyve0fM6zn1ykVNwlhvK6iTBv8QkjlNb9omtJ0X+6JINUBau/7WBm/7P
QVafNZpGuUyTObf1CLqiidQwu9/2VhuHaZhTLXYQRIVRX+JpnRw=
=OssZ
-----END PGP SIGNATURE-----


M
M
Martin Castillo wrote on 23 Jul 2018 19:08
a5d68301-2219-4e4a-0350-a906e4d4a379@uni-bremen.de
On 19.07.2018 15:15, Clément Lassieur wrote:
Toggle quote (9 lines)
> [...]
> Martin, could you please test it? (You just need to 'guix pull' and try
> again.) Leo, if you confirm my analysis, could you please unmerge the
> bugs?
>
> Thanks,
> Clément
>

It still does not work for me.

Attached are my guix version, dmesg|grep shepherd output, config.scm and
my qemu invocation (metal).

I run that system in qemu, but it is installed directly on my harddrive.

Martin

--
GPG: 7FDE 7190 2F73 2C50 236E 403D CC13 48F1 E644 08EC
Attachment: config.scm
[ 11.764507] shepherd[1]: Service root has been started.
[ 14.719803] shepherd[1]: starting services...
[ 14.722728] shepherd[1]: Service root-file-system has been started.
[ 14.725482] shepherd[1]: Service user-file-systems has been started.
[ 14.729274] shepherd[1]: Service file-system-/dev/pts has been started.
[ 14.732863] shepherd[1]: Service file-system-/dev/shm has been started.
[ 14.736110] shepherd[1]: Service file-system-/gnu/store has been started.
[ 14.750763] shepherd[1]: Service file-system-/run/systemd has been started.
[ 14.757029] shepherd[1]: Service file-system-/run/user has been started.
[ 14.760723] shepherd[1]: Service file-system-/sys/fs/cgroup has been started.
[ 14.765708] shepherd[1]: Service file-system-/sys/fs/cgroup/elogind has been started.
[ 14.776834] shepherd[1]: Service file-system-/sys/fs/cgroup/cpuset has been started.
[ 14.790800] shepherd[1]: Service file-system-/sys/fs/cgroup/cpu has been started.
[ 14.795139] shepherd[1]: Service file-system-/sys/fs/cgroup/cpuacct has been started.
[ 14.810192] shepherd[1]: Service file-system-/sys/fs/cgroup/memory has been started.
[ 14.814319] shepherd[1]: Service file-system-/sys/fs/cgroup/devices has been started.
[ 14.827923] shepherd[1]: Service file-system-/sys/fs/cgroup/freezer has been started.
[ 14.834046] shepherd[1]: Service file-system-/sys/fs/cgroup/blkio has been started.
[ 14.838283] shepherd[1]: Service file-system-/sys/fs/cgroup/perf_event has been started.
[ 14.841524] shepherd[1]: Service file-systems has been started.
[ 14.966786] shepherd[1]: waiting for udevd...
[ 15.627793] shepherd[1]: Service udev has been started.
[ 15.679916] shepherd[1]: Service urandom-seed has been started.
[ 15.684068] shepherd[1]: Service user-processes has been started.
[ 15.688369] shepherd[1]: Service host-name has been started.
[ 15.719811] shepherd[1]: Service user-homes could not be started.
[ 16.737051] shepherd[1]: Service nscd has been started.
[ 16.780356] shepherd[1]: Service guix-daemon has been started.
guix (GNU Guix) 264967c883d32606c18b378f717c303e7490c942
Copyright (C) 2018 the Guix authors
License GPLv3+: GNU GPL version 3 or later http://gnu.org/licenses/gpl.html
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
# runs qemu as mcd but with read and write access to sda

mount |egrep -q 'sd(a|b)3' && echo guix-root is maybe mounted. Aborting. && exit

set -v
sudo sh -c 'exec sudo -u mcd -C 6 sh -c "
exec qemu-system-x86_64 -m 1800 -smp 2 -enable-kvm \
-net nic,model=virtio \
-net user,hostfwd=tcp::5560-:2222,hostfwd=tcp::5559-:22 \
-add-fd fd=5,set=2,opaque=rdwr:$(readlink -f /dev/disk/by-id/ata-Hitachi_HDT721010SLA360_STF6L7MS20ALEK) \
-drive file=/dev/fdset/2,index=0,media=disk" \
5<>/dev/disk/by-id/ata-Hitachi_HDT721010SLA360_STF6L7MS20ALEK '
Attachment: signature.asc
L
L
Ludovic Courtès wrote on 28 Aug 2018 11:47
(name . Leo Famulari)(address . leo@famulari.name)(address . 30993@debbugs.gnu.org)
874lfen7q7.fsf@gnu.org
Hi Leo,

Leo Famulari <leo@famulari.name> skribis:

Toggle quote (8 lines)
> Since the update to Shepherd 0.4.0, I've found that OpenSSH's sshd is
> killed almost immediately after it starts with signal 15. I confirmed
> the issue started with the Shepherd upgrade by bisecting our Git
> history.
>
> I can reproduce the issue from commit
> b6beda1d6b9093a8493b5c3cde33ed522242c451 (gnu: Add botan.).

I’m “happy” to say that I experienced this on a server—not having ssh
access to a remote server is fairly annoying, I definitely sympathize…

What I see is this:

Toggle snippet (15 lines)
Aug 6 07:56:40 localhost shepherd[1]: Service loopback has been started.

[...]

Aug 6 07:56:51 localhost sshd[606]: Server listening on 0.0.0.0 port 22.

[...]

Aug 6 07:57:05 localhost shepherd[1]: Service ssh-daemon could not be started.

[...]

Aug 6 07:57:46 localhost vmunix: [ 10.049791] random: ssh-keygen: uninitialized urandom read (32 bytes read)

(Note that the last message was pulled from /dev/kmsg by syslogd, but
it’s about an event that actually occurred before the first message.)

It waited for ~15 seconds, although ‘%pid-file-timeout’ in (shepherd
service) is only 5 seconds.

The SIGTERM you were seeing very likely comes from this bit:

Toggle snippet (9 lines)
(match (read-pid-file pid-file
#:max-delay pid-file-timeout)
(#f
(catch-system-error (kill pid SIGTERM))
#f)
((? integer? pid)
pid))

On another machine:

Toggle snippet (8 lines)
Aug 28 09:10:49 localhost sshd[435]: Server listening on 0.0.0.0 port 22.
Aug 28 09:10:49 localhost sshd[435]: Server listening on :: port 22.

[...]

Aug 28 09:10:50 localhost shepherd[1]: Service ssh-daemon has been started.

I wonder if this has to do with IPv6 (the failing case lacks the “Server
listening on ::” line), or if it’s just sshd occasionally taking a long
time to start.

Is it easily reproducible for you? Did you eventually gather more
details?

Thanks,
Ludo’.
L
L
Ludovic Courtès wrote on 7 Nov 2018 22:34
control message for bug #30993
(address . control@debbugs.gnu.org)
87r2fwshbc.fsf@gnu.org
merge 30993 33299
L
L
Ludovic Courtès wrote on 7 Nov 2018 22:36
Re: bug#33299: shepherd: Service ssh-daemon could not be started.
(name . swedebugia)(address . swedebugia@riseup.net)
87muqksh7i.fsf@gnu.org
Hello,

swedebugia <swedebugia@riseup.net> skribis:

Toggle quote (5 lines)
> This morning I started my GuixSD VM as usual.
>
> Openssh server was not running even though it was enabled and should
> have been respawned. Hmm.

This seems to be the same issue as described in
https://issues.guix.info/issue/30993 (I’ve now merged both).

It’s a serious problem…

Thanks for reporting it,
Ludo’.
T
T
Taegil Bae wrote on 17 Nov 2018 10:46
issue: ssh-daemon could not be started
(address . 30993@debbugs.gnu.org)
CA+k_ch+bxxA5Gm1_ZThn117quO31MfsQxU=UACXjbZOoLUDvvg@mail.gmail.com
Hi,

I have experienced this issue on a slow machine (Thinkpad T60). By
placing avahi-daemon after ssh-daemon, I fixed this issue. I added
ssh-daemon into the requirement of avahi-shepherd-service, and
reconfigured the system.

On the machine, openssh and dropbear both had this issue. I checked
that this trick works for the two ssh server. On another machine(Qemu
VM, faster), openssh only had the trouble. Through several
reconfiguring the system, it was fixed with the original
configuration. I think that it was because the reconfigurations
reordered the services.

Taegil
L
L
Ludovic Courtès wrote on 19 Nov 2018 22:22
(name . Taegil Bae)(address . esrevinu@gmail.com)(address . 30993@debbugs.gnu.org)
87efbgvk3o.fsf@gnu.org
Hello,

Taegil Bae <esrevinu@gmail.com> skribis:

Toggle quote (5 lines)
> I have experienced this issue on a slow machine (Thinkpad T60). By
> placing avahi-daemon after ssh-daemon, I fixed this issue. I added
> ssh-daemon into the requirement of avahi-shepherd-service, and
> reconfigured the system.

This is very surprising. Are you sure this is fully reproducible?
How would you explain this?

Thank you,
Ludo’.
T
T
Taegil Bae wrote on 20 Nov 2018 02:33
(name . Ludovic Courtès)(address . ludo@gnu.org)(address . 30993@debbugs.gnu.org)
abf5965c-8cf9-fade-5539-30e054fc6c3d@gmail.com
Hello,

On 11/20/18 6:22 AM, Ludovic Courtès wrote:
Toggle quote (9 lines)
> Taegil Bae <esrevinu@gmail.com> skribis:
>
>> I have experienced this issue on a slow machine (Thinkpad T60). By
>> placing avahi-daemon after ssh-daemon, I fixed this issue. I added
>> ssh-daemon into the requirement of avahi-shepherd-service, and
>> reconfigured the system.
> This is very surprising. Are you sure this is fully reproducible?
> How would you explain this?

At least in my machine it seems reproducible. I just reproduced that:
reconfigured the system without my modification of avahi-daemon, checked
ssh-daemon not started, reconfigured the system again with the
modification, and then checked ssh-daemon started.

I am not a professional. But I guess that avahi-daemon manipulates
network things such as the host name, and ssh-daemon waits for that to
be completed. Look at this failing case:

Nov 20 09:37:57 localhost avahi-daemon[344]: Found user 'avahi' (UID
985) and group 'avahi' (GID 973).
Nov 20 09:37:59 localhost avahi-daemon[344]: Successfully dropped root
privileges.
Nov 20 09:38:00 localhost avahi-daemon[344]: avahi-daemon 0.7 starting up.
Nov 20 09:38:18 localhost shepherd[1]: Service avahi-daemon has been
started.
Nov 20 09:38:01 localhost avahi-daemon[344]: WARNING: No NSS support for
mDNS detected, consider installing nss-mdns!
Nov 20 09:38:05 localhost avahi-daemon[344]: Successfully called chroot().
Nov 20 09:38:12 localhost avahi-daemon[344]: Successfully dropped
remaining capabilities.
Nov 20 09:38:32 localhost shepherd[1]: Service ssh-daemon could not be
started.
Nov 20 09:38:15 localhost avahi-daemon[344]: Loading service file
/services/sftp-ssh.service.
Nov 20 09:38:17 localhost avahi-daemon[344]: Loading service file
/services/ssh.service.
Nov 20 09:38:19 localhost avahi-daemon[344]: Network interface
enumeration completed.
Nov 20 09:38:22 localhost avahi-daemon[344]: Server startup complete.
Host name is gravity.local. Local service cookie is 4157419020.
Nov 20 09:38:29 localhost avahi-daemon[344]: Service "gravity"
(/services/ssh.service) successfully established.
Nov 20 09:38:32 localhost avahi-daemon[344]: Service "gravity"
(/services/sftp-ssh.service) successfully established.
Nov 20 09:38:36 localhost avahi-daemon[344]: write() failed while
writing return value to pipe: Broken pipe
Nov 20 09:39:12 localhost avahi-daemon[344]: Joining mDNS multicast
group on interface wls3.IPv6 with address fe80::4c7d:9233:7845:eb88.
Nov 20 09:39:12 localhost avahi-daemon[344]: New relevant interface
wls3.IPv6 for mDNS.
Nov 20 09:39:12 localhost avahi-daemon[344]: Registering new address
record for fe80::4c7d:9233:7845:eb88 on wls3.*.
Nov 20 09:39:12 localhost avahi-daemon[344]: Joining mDNS multicast
group on interface wls3.IPv4 with address 192.168.42.242.
Nov 20 09:39:12 localhost avahi-daemon[344]: New relevant interface
wls3.IPv4 for mDNS.
Nov 20 09:39:12 localhost avahi-daemon[344]: Registering new address
record for 192.168.42.242 on wls3.IPv4.

Regards,

Taegil
L
L
Ludovic Courtès wrote on 9 Mar 2019 19:35
control message for bug #30993
(address . control@debbugs.gnu.org)
87tvgb520i.fsf@gnu.org
merge 30993 34580
L
L
Ludovic Courtès wrote on 14 May 2019 15:33
Re: bug#30993: OpenSSH sshd killed by Shepherd 0.4.0
(name . Leo Famulari)(address . leo@famulari.name)(address . 30993@debbugs.gnu.org)
878sv9yxbs.fsf@gnu.org
Hi Leo,

Leo Famulari <leo@famulari.name> skribis:

Toggle quote (6 lines)
> One interesting tidbit is that the PID file '/var/run/sshd.pid' is not
> created anymore. And if I create an empty PID file by hand, it is
> removed after trying to start the ssh-daemon service. Also, the sshd
> user's home '/var/run/sshd' does not exist, and is similarly removed if
> it does exist.

There are reasons to believe that this issue is fixed by the Shepherd 0.6.1:


Could you check somehow if the bug shows up again?

Thanks,
Ludo’.
L
L
Leo Famulari wrote on 14 May 2019 20:21
(name . Ludovic Courtès)(address . ludo@gnu.org)(address . 30993-done@debbugs.gnu.org)
20190514182106.GA1446@jasmine.lan
On Tue, May 14, 2019 at 03:33:59PM +0200, Ludovic Courtès wrote:
Toggle quote (6 lines)
> There are reasons to believe that this issue is fixed by the Shepherd 0.6.1:
>
> https://issues.guix.info/issue/35550
>
> Could you check somehow if the bug shows up again?

The bug disappeared for me a couple of reboots after reinstalling the
Guix System on my affected machine. That reinstallation provided
Shepherd 0.5, although 0.5 was also tested unsuccessfully before
reinstalling.

The issue does not manifest for me with Shepherd 0.6, 0.6.1 or Guix 1.0.

So... I think the bug was probably some kind of race condition or TOCTOU
problem that went away with a less fragmented or full filesystem (I was
really pushing the limits in that regard).

It's great that Shepherd 0.6.1 improved the PID file handling, assuming
that was the culprit.

I am closing this bug, but we can reopen it later if necessary.
-----BEGIN PGP SIGNATURE-----

iQIzBAABCAAdFiEEsFFZSPHn08G5gDigJkb6MLrKfwgFAlzbBw8ACgkQJkb6MLrK
fwh/ZA//fOH/6fpiWBWCtFFv8lUD0lOdJqnndPGaFfrYIihuW2XnHpLT8q/bKgv5
fJlUPkhzKWyWw3zOeXBagrUE9yG0mjWlez0lf+ygV1Bhk0BckbfQonKHW+B6LK3w
Pz3C/N6dLifofdmUpXD7JD4JiqoERtjf47LMImm3SF1b0VrcHjPVJVmVnb0GlJXA
kWJw84FW48cysxFhyHtuU54QNUdzfJKIvFA8YN/DizDJMcS/gGcftujNy7xNQW5e
RnAA2p0PiTpAFL7NWutoT4GRlhUttqVjgDEpiP8vSsVN56ttAnkGHj/91gDJ1HcR
NWl8HneDXeIuidw16JocYmCWxdPTuLBKAnfCz29Jzf3h192NQDsKU1BZHPSi1Q3w
84Clq/aHd0qXexb0nkB2IJSg5KHhPI0UMmteLMmSI8vk9680a8hcEpI6o7QQrpWB
TzU0JKmDXgk7EfpDSuR4zaAme8xEoR0+kEvUQvN29nTMK6Ix5BWSezxIumZZd4EG
8GAqktLwbnnRo3CqYMdNaLHFhu+FZ1tXs0Biqse0c8STkS2GmZ+3PrS/G0rdsw3y
HimdJgcLaXJlbIipf19h2jMfNIn6VTohoWkbyaGXIGvIF0w9KQUZvdRSviagQeEE
LilZATvUuhtZUBccYpAzH/cpzeAzNJivp52+xG3Y7qBULN1hMi4=
=2YjU
-----END PGP SIGNATURE-----


Closed
B
B
Brant Gardner wrote on 20 Sep 2019 18:19
Archived problem report bug#34580 (Service ssh-daemon could no t be started)
(address . control@debbugs.gnu.org)
1ee347ea-f340-4d61-8bfb-53a58139aa2d@www.fastmail.com
unarchive 34580

--
Brant Gardner
Attachment: file
L
L
Ludovic Courtès wrote on 26 Sep 2019 22:28
control message for bug #30993
(address . control@debbugs.gnu.org)
87r242ls3n.fsf@gnu.org
merge 30993 37309
quit
L
L
Ludovic Courtès wrote on 26 Sep 2019 22:29
(address . control@debbugs.gnu.org)
87pnjmls36.fsf@gnu.org
retitle 30993 'ssh-daemon' fails to start
quit
M
M
maxim.cournoyer wrote on 18 Aug 2020 06:08
(address . control@debbugs.gnu.org)
87wo1wppdk.fsf@hurd.i-did-not-set--mail-host-address--so-tickle-me
tags 30993 fixed
close 30993
quit
C
C
Christopher Lemmer Webber wrote on 27 Nov 2020 23:57
unarchive 37309
(address . control@debbugs.gnu.org)
87y2imjtm0.fsf@dustycloud.org
unarchive 37309
?