[gentoo-user] help with the dreaded mount: RPC: Program not registered

[gentoo-user] help with the dreaded mount: RPC: Program not registered

[John Blinka]

[-- Attachment #1: Type: text/plain, Size: 1546 bytes --]

Hi, all,

I have 2 gentoo machines, lotus and tobey.   tobey is an nfs server to
lotus.
Today I upgraded tobey, and now nfs doesn't work.  Previously, it worked for
years.  The symptoms are:

1)  mount -v /mnt/tobey on lotus returns
     mount: RPC: Program not registered

2)  /etc/init.d/nfs start on tobey produces no output, no running
    nfsd daemons, and exit code 1.

3) There is nothing particularly informative (to me)
    in the system logs.  There is one instance of

    tobey rc-scripts: ERROR:  cannot start nfs as rpc.statd could not start

    after the reboot following today's upgrade.

    I've started rpc.statd by hand and then attempted to start nfs,
    but nfs still does not start.  There is no information in the system
    log explaining why.

4) I've done the usual google search, and followed the advice of
    other people who have had this problem, and I have read the
    available Gentoo Wiki documents that discuss this problem
    and followed the advice there.  The result:  nfs still does not
    start.

5) tobey is a machine which doesn't like to start various daemons
    when it boots despite their being managed by rc-update.  I have
    no idea why - this situation started a few months ago after an
    upgrade.  I start them by hand after reboots.

6) I always do revdep-rebuild and always follow the post installation
    instructions mailed by portage's elog facility.

So, any brilliant ideas about why I can't start nfs or how to debug the
problem?

As always, thanks for your help!

John Blinka

[-- Attachment #2: Type: text/html, Size: 2029 bytes --]

Re: [gentoo-user] help with the dreaded mount: RPC: Program not registered

[Emil Beinroth]

[-- Attachment #1: Type: text/plain, Size: 505 bytes --]

Hi,
what version of portmap, nfs-utils and baselayout are you running? Have
you tried reinstalling those 3 to make sure the config files and init
scripts are up to date?

Please post the output of `rc-status -a` and `rpcinfo -p tobey`. They
might be helpful for diagnosing the problem.

And I guess you are using nfs3?

Cheers, Emil

-- 
Emil Beinroth
83059 Kolbermoor | Germany

"I saw `cout' being shifted "Hello world" times to the left and stopped right there."
    -- Steve Gonedes

[-- Attachment #2: Type: application/pgp-signature, Size: 189 bytes --]

Re: [gentoo-user] help with the dreaded mount: RPC: Program not registered

[Dan Farrell]

On Fri, 21 Sep 2007 19:45:47 -0400
"John Blinka" <john.blinka@gmail.com> wrote:

> Hi, all,
> 
> I have 2 gentoo machines, lotus and tobey.   tobey is an nfs server to
> lotus.
> Today I upgraded tobey, and now nfs doesn't work.  Previously, it
> worked for years.  The symptoms are:
> 
> 1)  mount -v /mnt/tobey on lotus returns
>      mount: RPC: Program not registered
> 
> 2)  /etc/init.d/nfs start on tobey produces no output, no running
>     nfsd daemons, and exit code 1.

that should be /etc/init.d/nfsmount start.  /etc/init.d/nfs is for nfs
server.  

you can run "portmap" and "rpc.statd" and then just mount your nfs
shares; you don't need to start the service at all. 

Additionally make sure the box is not  firewalling access to 'lo',
because it will need said access to use rpc.statd.
-- 
gentoo-user@gentoo.org mailing list

Re: [gentoo-user] help with the dreaded mount: RPC: Program not registered

[John Blinka]

[-- Attachment #1: Type: text/plain, Size: 2437 bytes --]

On 9/22/07, Emil Beinroth <emilbeinroth@gmx.net> wrote:
>
> Hi,
> what version of portmap, nfs-utils and baselayout are you running? Have
> you tried reinstalling those 3 to make sure the config files and init
> scripts are up to date?
>
> Please post the output of `rc-status -a` and `rpcinfo -p tobey`. They
> might be helpful for diagnosing the problem.



 -> rpcinfo -p tobey
   program vers proto   port
    100000    2   tcp    111  portmapper
    100000    2   udp    111  portmapper
    100024    1   udp   1028  status
    100024    1   tcp   4656  status
> rc-status -a
Runlevel: boot
 alsasound
[ started  ]
 bootmisc
[ started  ]
 checkfs
[ started  ]
 checkroot
[ started  ]
 clock
[ started  ]
 consolefont
[ started  ]
 hostname
[ started  ]
 keymaps
[ started  ]
 localmount
[ started  ]
 modules
[ started  ]
 net.lo
[ started  ]
 rmnologin
[ started  ]
 svscan
[ started  ]
 urandom
[ started  ]
Runlevel: default
 courier-imapd
[ started  ]
 cupsd
[ started  ]
 dbus
[ started  ]
 dhcpd
[ stopped  ]
 distccd
[ started  ]
 fcron
[ started  ]
 fetchmail
[ stopped  ]
 local
[ stopped  ]
 net.eth0
[ started  ]
 netmount
[ started  ]
 nfs
[ stopped  ]
 ntp-client
[ stopped  ]
 ntpd
[ started  ]
 portmap
[ started  ]
 postfix
[ started  ]
 rsyncd
[ started  ]
 samba
[ started  ]
 slapd
[ stopped  ]
 sshd
[ started  ]
 syslog-ng
[ started  ]
 xdm
[ started  ]
 xinetd
[ started  ]
Runlevel: nonetwork
 local
[ stopped  ]
Runlevel: single
Runlevel: UNASSIGNED
 acpid
[ stopped  ]
 apache2
[ stopped  ]
 atd
[ stopped  ]
 bttrack
[ stopped  ]
 consolekit
[ stopped  ]
 courier-authlib
[ started  ]
 courier-imapd-ssl
[ stopped  ]
 courier-pop3d
[ stopped  ]
 courier-pop3d-ssl
[ stopped  ]
 crypto-loop
[ stopped  ]
 device-mapper
[ stopped  ]
 dhcrelay
[ stopped  ]
 dnsextd
[ stopped  ]
 gpm
[ stopped  ]
 hald
[ stopped  ]
 hdparm
[ stopped  ]
 hotplug
[ stopped  ]
 hplip
[ stopped  ]
 mDNSResponderPosix
[ stopped  ]
 mdnsd
[ stopped  ]
 nfsmount
[ stopped  ]
 nscd
[ stopped  ]
 numlock
[ stopped  ]
 pwcheck
[ stopped  ]
 rpc.idmapd
[ stopped  ]
 rpc.statd
[ started  ]
 saslauthd
[ stopped  ]
 slurpd
[ stopped  ]
 smartd
[ stopped  ]
 svnserve
[ stopped  ]
 udev-postmount
[ started  ]
 xprint
[ stopped  ]


net-fs/nfs-utils-1.1.0-r1
net-nds/portmap-6.0
sys-apps/baselayout-1.12.9-r2



And I guess you are using nfs3?



I really don't know.  Where would I look to determine whether I'm using 3 or
4?


John

[-- Attachment #2: Type: text/html, Size: 46590 bytes --]

Re: [gentoo-user] help with the dreaded mount: RPC: Program not registered

[John Blinka]

[-- Attachment #1: Type: text/plain, Size: 258 bytes --]

>
>
> that should be /etc/init.d/nfsmount start.  /etc/init.d/nfs is for nfs
> server.


I''m confused by your answer, because tobey is the server, and
/etc/init.d/nfs
fails on tobey.  Perhaps I don't understand something - wouldn't be the
first
time!

John

[-- Attachment #2: Type: text/html, Size: 487 bytes --]

Re: [gentoo-user] help with the dreaded mount: RPC: Program not registered

[Emil Beinroth]

[-- Attachment #1: Type: text/plain, Size: 937 bytes --]

On Sat, Sep 22, 2007 at 04:58:45PM -0400, John Blinka wrote:
> And I guess you are using nfs3?
> 
> I really don't know.  Where would I look to determine whether I'm using 3 or
> 4?

If you don't know, then you are certainly running nfs3. nfs4 uses 'nfs4'
as fs_type in fstab, as opposed to nfs3 which is using 'nfs'.

> 2)  /etc/init.d/nfs start on tobey produces no output, no running
>     nfsd daemons, and exit code 1.

Try `/etc/init.d/nfs --debug start`, that ought to give us some output
to work on.

This may be a stupid question, but do you have the nfs-stuff in your
kernel enabled?


Cheers, Emil

-- 
Emil Beinroth
83059 Kolbermoor | Germany
 
Bounty hunter: You're wanted, Wales.
Josey Wales:   Reckon I'm right popular. You a bounty hunter?
Bounty hunter: A man's got to do something for a living these days.
Josey Wales:   Dyin' ain't much of a living, boy. 
 
   -- The Outlaw Josey Wales

[-- Attachment #2: Type: application/pgp-signature, Size: 189 bytes --]

Re: [gentoo-user] help with the dreaded mount: RPC: Program not registered

[John Blinka]

[-- Attachment #1.1: Type: text/plain, Size: 706 bytes --]

>
> Try `/etc/init.d/nfs --debug start`, that ought to give us some output
> to work on.



The output is rather long - 1830 lines, so it's in the attached file.


This may be a stupid question, but do you have the nfs-stuff in your
> kernel enabled?



Not a stupid question - I've been known to overlook the obvious.  But I've
been running the same kernel for quite some time, and nfs has worked
before on that kernel.  However, on tobey:


CONFIG_NFS_FS=m
CONFIG_NFS_V3=y
# CONFIG_NFS_V3_ACL is not set
CONFIG_NFS_V4=y
# CONFIG_NFS_DIRECTIO is not set
CONFIG_NFSD=m
CONFIG_NFSD_V3=y
# CONFIG_NFSD_V3_ACL is not set
CONFIG_NFSD_V4=y
CONFIG_NFSD_TCP=y
CONFIG_NFS_COMMON=y
# CONFIG_NCPFS_NFS_NS is not set

[-- Attachment #1.2: Type: text/html, Size: 1145 bytes --]

[-- Attachment #2: nfs_start_debug --]
[-- Type: application/octet-stream, Size: 81980 bytes --]

Re: [gentoo-user] help with the dreaded mount: RPC: Program not registered

[Emil Beinroth]

[-- Attachment #1: Type: text/plain, Size: 1184 bytes --]

On Sun, Sep 23, 2007 at 08:24:42AM -0400, John Blinka wrote:
> >
> > Try `/etc/init.d/nfs --debug start`, that ought to give us some output
> > to work on.
> 
> The output is rather long - 1830 lines, so it's in the attached file.

Ok, there are some funny things in there. Please also post the output of
the following commands.

 find /var/lib/init.d/ -name nfs | xargs ls -lh
 ls -lA /var/lib/init.d/
 cat /etc/runlevels/*/.critical

> Not a stupid question - I've been known to overlook the obvious.  But I've
> been running the same kernel for quite some time, and nfs has worked
> before on that kernel.  However, on tobey:
> 
> 
> CONFIG_NFS_FS=m
> CONFIG_NFS_V3=y
> # CONFIG_NFS_V3_ACL is not set
> CONFIG_NFS_V4=y
> # CONFIG_NFS_DIRECTIO is not set
> CONFIG_NFSD=m
> CONFIG_NFSD_V3=y
> # CONFIG_NFSD_V3_ACL is not set
> CONFIG_NFSD_V4=y
> CONFIG_NFSD_TCP=y
> CONFIG_NFS_COMMON=y
> # CONFIG_NCPFS_NFS_NS is not set

That looks fine.


Cheers, Emil

-- 
Emil Beinroth
83059 Kolbermoor | Germany
 
<Mercury> emacs sucks, literally, not a insult, just a comment that its large
          enough to have a noticeable gravitational pull...

[-- Attachment #2: Type: application/pgp-signature, Size: 189 bytes --]

Re: [gentoo-user] help with the dreaded mount: RPC: Program not registered

[John Blinka]

[-- Attachment #1: Type: text/plain, Size: 1620 bytes --]

> Ok, there are some funny things in there. Please also post the output of
> the following commands.
>
> -> find /var/lib/init.d/ -name nfs | xargs ls -lh
lrwxrwxrwx 1 root root 15 Sep 21 13:20 /var/lib/init.d/failed/nfs ->
/etc/init.d/nfs
lrwxrwxrwx 1 root root 15 Sep 21 13:16 /var/lib/init.d/softscripts/nfs ->
/etc/init.d/nfs

 -> ls -lA /var/lib/init.d/
total 148
drwxr-xr-x 2 root root  4096 Sep 21 13:16 coldplugged
drwxr-xr-x 2 root root  4096 Sep 21 17:30 daemons
-rw-r--r-- 1 root root 52178 Sep 22 17:00 depcache
-rw-r--r-- 1 root root 20730 Sep 22 17:00 deptree
drwxr-xr-x 2 root root  4096 Sep 21 15:11 exclusive
drwxr-xr-x 2 root root  4096 Sep 21 13:21 exitcodes
drwxr-xr-x 2 root root  4096 Sep 21 13:20 failed
drwxr-xr-x 2 root root  4096 Sep 21 13:16 inactive
-rw-r--r-- 1 root root     3 Sep 21 13:16 interactive
drwxr-xr-x 3 root root  4096 Sep 21 13:17 options
drwxr-xr-x 2 root root  4096 Sep 21 13:16 scheduled
drwxr-xr-x 2 root root  4096 Sep 23 08:17 snapshot
-rw-r--r-- 1 root root     8 Sep 21 13:16 softlevel
drwxr-xr-x 2 root root  4096 Sep 21 13:16 softscripts
drwxr-xr-x 2 root root  4096 Sep 21 13:16 softscripts.old
drwxr-xr-x 2 root root  4096 Sep 22 17:00 started
drwxr-xr-x 2 root root  4096 Sep 22 17:00 starting
drwxr-xr-x 2 root root  4096 Sep 21 17:30 stopping
drwxr-xr-x 2 root root  4096 Sep 21 13:16 wasinactive


 --> cat /etc/runlevels/*/.critical
cat: /etc/runlevels/*/.critical: No such file or directory


<Mercury> emacs sucks, literally, not a insult, just a comment that its
> large
>           enough to have a noticeable gravitational pull...



That was good!

John

[-- Attachment #2: Type: text/html, Size: 2272 bytes --]

Re: [gentoo-user] help with the dreaded mount: RPC: Program not registered

[Emil Beinroth]

[-- Attachment #1: Type: text/plain, Size: 634 bytes --]

On Sun, Sep 23, 2007 at 03:37:36PM -0400, John Blinka wrote:
>  -> ls -lA /var/lib/init.d/
[snip]
> drwxr-xr-x 2 root root  4096 Sep 21 13:16 softscripts.old

That shouldn't be there. Normally, that directory is created and later
removed by /sbin/rc - which is run numerous times at boot. So this seems
really wrong.

I would suggest a clean cut by running `rm -fr /var/lib/init.d/`
and doing a reboot. Services won't be stopped, but your filesystems will
be remouted ro, so they should be fine. I've tested this on my box and
didn't have any problems.


Cheers, Emil

-- 
Emil Beinroth
83059 Kolbermoor | Germany

[-- Attachment #2: Type: application/pgp-signature, Size: 189 bytes --]

Re: [gentoo-user] help with the dreaded mount: RPC: Program not registered

[Alex Schuster]

John Blinka writes:

> Not a stupid question - I've been known to overlook the obvious.  But
> I've been running the same kernel for quite some time, and nfs has worked
> before on that kernel.  However, on tobey:

I had a similar problem recently after an update. Some of the shares did 
still work, most did not, and I was not able to find a cause. After I also 
upgraded my kernel from 2.6.14-hardened-r7 to something more recent like 
2.6.20, all was fine again.

	Alex
-- 
gentoo-user@gentoo.org mailing list

Re: [gentoo-user] help with the dreaded mount: RPC: Program not registered

[Dan Farrell]

On Sat, 22 Sep 2007 17:12:35 -0400
"John Blinka" <john.blinka@gmail.com> wrote:

> >
> >
> > that should be /etc/init.d/nfsmount start.  /etc/init.d/nfs is for
> > nfs server.
> 
> 
> I''m confused by your answer, because tobey is the server, and
> /etc/init.d/nfs
> fails on tobey.  Perhaps I don't understand something - wouldn't be
> the first
> time!
> 
> John


No, I'm the confused one.  Ignore my unhelpful answer.  
-- 
gentoo-user@gentoo.org mailing list

Re: [gentoo-user] help with the dreaded mount: RPC: Program not registered

[John Blinka]

[-- Attachment #1: Type: text/plain, Size: 951 bytes --]

On 9/23/07, Emil Beinroth <emilbeinroth@gmx.net> wrote:
>
> On Sun, Sep 23, 2007 at 03:37:36PM -0400, John Blinka wrote:
> >  -> ls -lA /var/lib/init.d/
> [snip]
> > drwxr-xr-x 2 root root  4096 Sep 21 13:16 softscripts.old
>
> That shouldn't be there. Normally, that directory is created and later
> removed by /sbin/rc - which is run numerous times at boot. So this seems
> really wrong.
>
> I would suggest a clean cut by running `rm -fr /var/lib/init.d/`
> and doing a reboot. Services won't be stopped, but your filesystems will
> be remouted ro, so they should be fine. I've tested this on my box and
> didn't have any problems.


Did as you suggested.  softscripts.old reappeared and no change in inability
to start nfs automatically, or by hand.

I think it happens when booting, but I see this message in the system log:

Sep 23 21:12:01 tobey rc-scripts: ERROR:  cannot start nfs as
rpc.statdcould not start

Does that shed any light?

John

[-- Attachment #2: Type: text/html, Size: 1350 bytes --]

Re: [gentoo-user] help with the dreaded mount: RPC: Program not registered

[Bogo Mipps]

On Tue, 25 Sep 2007, John Blinka wrote:
> I think it happens when booting, but I see this message in the system log:
>
> Sep 23 21:12:01 tobey rc-scripts: ERROR:  cannot start nfs as
> rpc.statdcould not start

John, I've hesitated to join this thread because I haven't felt I've been able 
to throw any light on your problem - just hoped that you'd get some 
resolution that I could then apply to my own situation which is very similar 
to yours ... but as it's not looking so "rosy" maybe my experience may spark 
some other avenue to explore?

I've been running an amd64 nfs mount successfully for some months on this 
machine until around about mid August (difficult to tell exactly when as I 
had temporary wireless network about then because of building alterations) 
but from that point on have had major problems trying to mount the nfs 
directory.  No point in going though all the error codes etc. again as they 
are pretty similar to yours - main one is always "mount: RPC: Timed out", but 
I have variations.  Like you I _never_ get it to mount from boot as it always 
did in earlier days: now, with a bit of patience, and re-running nfs, 
nfsmount - and sometimes portmap scripts, I can sometimes get it to mount. 
Sometimes I can get it to mount using the manual mount command.  Other times 
it just plain refuses to do anything until I go away for an hour or so - then 
come back and take it by surprise with nfsmount or manual mount and wham, bam 
we're away laughing!  Or sort of. 

I've googled extensively and followed up avenue after avenue, wiki after wiki:  
I've recompiled nfs-utils, portmap, baselayout.  I've altered hosts.allow and 
hosts.deny, etc., etc., and then tried all Emil's suggestions as on this 
thread.  But I still get nowhere, and I think I've now spent so much time on 
it that I really can't see the wood for the trees!  It's obviously something 
so simple, but I just can't see it.  Feel a bit of a prat, but this morning 
was the last straw when I thought I'd better join your thread: no success 
until I left it and went away for an hour - then came back and 
input "mount -t nfs 192.168.0.216:/usr/portage /mnt/nfs_portage/" and away we 
went. All ok, just in time for a cronjob emerge --sync.

But not very satisfactory.  It's almost as though the original "mount" called 
by the scripts and earlier efforts takes some time to "die", and a fresh 
instance does the trick! But I don't know enough about the process to know if 
that's so - I just seem to recall someone somewhere in my endless searches 
saying something along those lines ... 
    
Strange that it's just the two of us to be afflicted by this at about the same 
time?  AAMOI have you tried taking your machine by surprise?

Bogo





-- 
gentoo-user@gentoo.org mailing list

Re: [gentoo-user] help with the dreaded mount: RPC: Program not registered

[John Blinka]

[-- Attachment #1: Type: text/plain, Size: 611 bytes --]

Hi, Bogo,

Your experience is similar in nature to mine.  What I didn't post is that
nfs isn't the only daemon that wouldn't start, and that for a month or two
I've had to cajole and threaten my box - generic x86 - to get various
daemons
to start - all by hand, of course.  All of this mystery started after a
massive
system upgrade.  I've tried rebuilding the entire system with no effect, and
now
I'm contemplating a wipe-the-system-clean and fresh install to exorcise
whatever
ghosts are lurking there.  I don't want to do that, but...

Anyway, the existence of a fellow sufferer makes me feel better.

John

[-- Attachment #2: Type: text/html, Size: 701 bytes --]

Re: [gentoo-user] help with the dreaded mount: RPC: Program not registered

[Emil Beinroth]

[-- Attachment #1: Type: text/plain, Size: 383 bytes --]

On Mon, Sep 24, 2007 at 08:07:04AM -0400, John Blinka wrote:
> Did as you suggested.  softscripts.old reappeared and no change in inability
> to start nfs automatically, or by hand.

Hm, does `rc default` give you and output? Is the softscripts.old gone
afterwards?

Cheers, Emil.

-- 
Emil Beinroth
83059 Kolbermoor | Germany
 
System halted - operator out of coffee!

[-- Attachment #2: Type: application/pgp-signature, Size: 189 bytes --]

Re: [gentoo-user] help with the dreaded mount: RPC: Program not registered

[John Blinka]

[-- Attachment #1: Type: text/plain, Size: 815 bytes --]

On 9/25/07, Emil Beinroth <emilbeinroth@gmx.net> wrote:
>
> On Mon, Sep 24, 2007 at 08:07:04AM -0400, John Blinka wrote:
> > Did as you suggested.  softscripts.old reappeared and no change in
> inability
> > to start nfs automatically, or by hand.
>
> Hm, does `rc default` give you and output? Is the softscripts.old gone
> afterwards?



It  gives the following output, and then hangs indefinitely at the last
line.
And softscripts.old is still there (although there is no "afterwards"!)

-> rc default
 * Setting clock via the NTP client 'ntpdate'
...
[ ok ]
 * Starting ldap-server
...
[ !! ]
 * Mounting nfsd filesystem in /proc
...
[ ok ]
 * Starting NFS statd
...
[ ok ]
 * Exporting NFS directories
...
[ ok ]
 * Starting NFS mountd
...
[ ok ]
 * Starting NFS daemon
...
[ ok ]
 * Starting NFS smnotify ...

[-- Attachment #2: Type: text/html, Size: 7012 bytes --]

[gentoo-user] Re: [SOLVED] help with the dreaded mount: RPC: Program not registered

[John Blinka]

[-- Attachment #1: Type: text/plain, Size: 485 bytes --]

Not an elegant solution, or one that sheds any light on
the nature of the problem, but this process worked for me:

1)  Removed everything from the default run level except for
     the system logger and net.eth0.

2)  Rebooted and started nfs by hand successfully after the
     reboot.  Added nfs to the default run level.

3)  Repeated steps 1) and 2) for each additional program I
     wanted to add the the default run level.  Everything seems
     to work fine now.

John Blinka

[-- Attachment #2: Type: text/html, Size: 636 bytes --]