[gentoo-dev] gpg: signing failed: Inappropriate ioctl for device

[gentoo-dev] gpg: signing failed: Inappropriate ioctl for device

[grozin]

Hello *,

Today, when trying to push my commit to the repo, I got

gpg: signing failed: Inappropriate ioctl for device
gpg: signing failed: Inappropriate ioctl for device
error: gpg failed to sign the data
fatal: failed to sign the push certificate
fatal: The remote end hung up unexpectedly

When I did repoman commit, it did not ask me to type my passphraise, 
because I did another commit not so long ago (and successfully pushed it 
to Gentoo). But this commit sits in my copy of the tree, and I cannot push 
it. What can I do?

Thanks in advance,
Andrey

Re: [gentoo-dev] gpg: signing failed: Inappropriate ioctl for device

[Thomas Deutschmann]

[-- Attachment #1.1: Type: text/plain, Size: 836 bytes --]

On 2016-12-11 15:13, grozin@gentoo.org wrote:
> But this commit sits in my copy of the tree, and I cannot
> push it. What can I do?

You can't push because the commit isn't signed?

If it is the last commit, just run `git commit --amend -S`

If it isn't the last commit, try `git log` to get the commit id before
your unsinged commit followed by `git rebase -i
<COMMITID_BEFORE_YOUR_UNSINGED_COMMIT>^`. Now set the unsigned commit to
"EDIT" (don't touch any other commits, keep "PICK") and run `git commit
--amend -S` and continue rebase to finish.

Now your commit should be signed and you should be able to push.

For future, apply settings like shown in
https://wiki.gentoo.org/wiki/Gentoo_git_workflow#Repository_settings to
the Gentoo repository to prevent situations like that.


-- 
Regards,
Thomas




[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 951 bytes --]

Re: [gentoo-dev] gpg: signing failed: Inappropriate ioctl for device

[Kristian Fiskerstrand]

[-- Attachment #1.1: Type: text/plain, Size: 311 bytes --]

On 12/11/2016 03:13 PM, grozin@gentoo.org wrote:
> gpg: signing failed: Inappropriate ioctl for device

this might indicate a want for export GPG_TTY=$(tty)


-- 
Kristian Fiskerstrand
OpenPGP keyblock reachable at hkp://pool.sks-keyservers.net
fpr:94CB AFDD 3034 5109 5618 35AA 0B7F 8B60 E3ED FAE3


[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 488 bytes --]

Re: [gentoo-dev] gpg: signing failed: Inappropriate ioctl for device

[grozin]

On Sun, 11 Dec 2016, Kristian Fiskerstrand wrote:
> On 12/11/2016 03:13 PM, grozin@gentoo.org wrote:
>> gpg: signing failed: Inappropriate ioctl for device
> this might indicate a want for export GPG_TTY=$(tty)
I don't understand what has really happened. I removed my last commit, an 
attempt to commit it again failed with gpg: signing failed. Then I logged 
out of the box on which I have the git tree (I log in this box via ssh), 
and logged in again. After that the commit succeeded.

Thanks,
Andrey

Re: [gentoo-dev] gpg: signing failed: Inappropriate ioctl for device

[Sam Jorna]

[-- Attachment #1: Type: text/plain, Size: 886 bytes --]

On Mon, Dec 12, 2016 at 09:34:21AM +0700, grozin@gentoo.org wrote:
> On Sun, 11 Dec 2016, Kristian Fiskerstrand wrote:
> > On 12/11/2016 03:13 PM, grozin@gentoo.org wrote:
> >> gpg: signing failed: Inappropriate ioctl for device
> > this might indicate a want for export GPG_TTY=$(tty)
> I don't understand what has really happened. I removed my last commit, an 
> attempt to commit it again failed with gpg: signing failed. Then I logged 
> out of the box on which I have the git tree (I log in this box via ssh), 
> and logged in again. After that the commit succeeded.

I was also getting some odd issues with commit signing, though it seemed 
to settle for me when I switched to pinentry-curses (since I use 
awesome), so I figured it was probably a local issue. Perhaps there's a 
wider problem here?

-- 
Sam Jorna (wraeth)
GnuPG Key: D6180C26

[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 1006 bytes --]

Re: [gentoo-dev] gpg: signing failed: Inappropriate ioctl for device

[Sam Jorna]

[-- Attachment #1: Type: text/plain, Size: 1145 bytes --]

On Mon, Dec 12, 2016 at 02:35:28PM +1100, Sam Jorna wrote:
> On Mon, Dec 12, 2016 at 09:34:21AM +0700, grozin@gentoo.org wrote:
> > On Sun, 11 Dec 2016, Kristian Fiskerstrand wrote:
> > > On 12/11/2016 03:13 PM, grozin@gentoo.org wrote:
> > >> gpg: signing failed: Inappropriate ioctl for device
> > > this might indicate a want for export GPG_TTY=$(tty)
> > I don't understand what has really happened. I removed my last commit, an 
> > attempt to commit it again failed with gpg: signing failed. Then I logged 
> > out of the box on which I have the git tree (I log in this box via ssh), 
> > and logged in again. After that the commit succeeded.
> 
> I was also getting some odd issues with commit signing, though it seemed 
> to settle for me when I switched to pinentry-curses (since I use 
> awesome), so I figured it was probably a local issue. Perhaps there's a 
> wider problem here?

If anyone else is getting this, it seems to be resolved by exporting 
GPG_TTY=$(tty) either immediately before attempting to sign or in your 
shell ~/.*rc file.

-- 
Sam Jorna (wraeth)
GnuPG Key: D6180C26

[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 977 bytes --]

Re: [gentoo-dev] gpg: signing failed: Inappropriate ioctl for device

[Mart Raudsepp]

Ühel kenal päeval, K, 14.12.2016 kell 13:08, kirjutas Sam Jorna:
> On Mon, Dec 12, 2016 at 02:35:28PM +1100, Sam Jorna wrote:
> > 
> > On Mon, Dec 12, 2016 at 09:34:21AM +0700, grozin@gentoo.org wrote:
> > > 
> > > On Sun, 11 Dec 2016, Kristian Fiskerstrand wrote:
> > > > 
> > > > On 12/11/2016 03:13 PM, grozin@gentoo.org wrote:
> > > > > 
> > > > > gpg: signing failed: Inappropriate ioctl for device
> > > > this might indicate a want for export GPG_TTY=$(tty)
> > > I don't understand what has really happened. I removed my last
> > > commit, an 
> > > attempt to commit it again failed with gpg: signing failed. Then
> > > I logged 
> > > out of the box on which I have the git tree (I log in this box
> > > via ssh), 
> > > and logged in again. After that the commit succeeded.
> > 
> > I was also getting some odd issues with commit signing, though it
> > seemed 
> > to settle for me when I switched to pinentry-curses (since I use 
> > awesome), so I figured it was probably a local issue. Perhaps
> > there's a 
> > wider problem here?
> 
> If anyone else is getting this, it seems to be resolved by exporting 
> GPG_TTY=$(tty) either immediately before attempting to sign or in
> your 
> shell ~/.*rc file.

I'd consider this a temporary workaround. The real issue would just be
workarounded with this, which is nice to get something committed, but
not so nice longterm.
I had similar issues, but it turned out some pinentry issues for me
iirc, so properly fixed by now and not needing such hackery anymore.


Mart

Re: [gentoo-dev] gpg: signing failed: Inappropriate ioctl for device

[Fabian Groffen]

[-- Attachment #1: Type: text/plain, Size: 802 bytes --]

On 14-12-2016 11:16:58 +0200, Mart Raudsepp wrote:
> Ühel kenal päeval, K, 14.12.2016 kell 13:08, kirjutas Sam Jorna:
> > If anyone else is getting this, it seems to be resolved by exporting 
> > GPG_TTY=$(tty) either immediately before attempting to sign or in
> > your 
> > shell ~/.*rc file.
> 
> I'd consider this a temporary workaround. The real issue would just be
> workarounded with this, which is nice to get something committed, but
> not so nice longterm.
> I had similar issues, but it turned out some pinentry issues for me
> iirc, so properly fixed by now and not needing such hackery anymore.

https://www.gnupg.org/documentation/manuals/gnupg-devel/Common-Problems.html

gnupg is just weird like that...

Fabian

-- 
Fabian Groffen
Gentoo on a different level

[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 181 bytes --]

Re: [gentoo-dev] gpg: signing failed: Inappropriate ioctl for device

[Andrew Savchenko]

[-- Attachment #1: Type: text/plain, Size: 1990 bytes --]

On Wed, 14 Dec 2016 11:16:58 +0200 Mart Raudsepp wrote:
> Ühel kenal päeval, K, 14.12.2016 kell 13:08, kirjutas Sam Jorna:
> > On Mon, Dec 12, 2016 at 02:35:28PM +1100, Sam Jorna wrote:
> > > 
> > > On Mon, Dec 12, 2016 at 09:34:21AM +0700, grozin@gentoo.org wrote:
> > > > 
> > > > On Sun, 11 Dec 2016, Kristian Fiskerstrand wrote:
> > > > > 
> > > > > On 12/11/2016 03:13 PM, grozin@gentoo.org wrote:
> > > > > > 
> > > > > > gpg: signing failed: Inappropriate ioctl for device
> > > > > this might indicate a want for export GPG_TTY=$(tty)
> > > > I don't understand what has really happened. I removed my last
> > > > commit, an 
> > > > attempt to commit it again failed with gpg: signing failed. Then
> > > > I logged 
> > > > out of the box on which I have the git tree (I log in this box
> > > > via ssh), 
> > > > and logged in again. After that the commit succeeded.
> > > 
> > > I was also getting some odd issues with commit signing, though it
> > > seemed 
> > > to settle for me when I switched to pinentry-curses (since I use 
> > > awesome), so I figured it was probably a local issue. Perhaps
> > > there's a 
> > > wider problem here?
> > 
> > If anyone else is getting this, it seems to be resolved by exporting 
> > GPG_TTY=$(tty) either immediately before attempting to sign or in
> > your 
> > shell ~/.*rc file.
> 
> I'd consider this a temporary workaround. The real issue would just be
> workarounded with this, which is nice to get something committed, but
> not so nice longterm.
> I had similar issues, but it turned out some pinentry issues for me
> iirc, so properly fixed by now and not needing such hackery anymore.

This is not a workaround, but officially recommended practice, from
man gpg-agent:

You should always add the following lines to your .bashrc or
whatever initialization file is used for all shell invocations:

    GPG_TTY=$(tty)
    export GPG_TTY


Best regards,
Andrew Savchenko

[-- Attachment #2: Type: application/pgp-signature, Size: 819 bytes --]

Re: [gentoo-dev] gpg: signing failed: Inappropriate ioctl for device

[Mart Raudsepp]

Ühel kenal päeval, K, 14.12.2016 kell 15:35, kirjutas Andrew Savchenko:
> On Wed, 14 Dec 2016 11:16:58 +0200 Mart Raudsepp wrote:
> > 
> > Ühel kenal päeval, K, 14.12.2016 kell 13:08, kirjutas Sam Jorna:
> > > 
> > > On Mon, Dec 12, 2016 at 02:35:28PM +1100, Sam Jorna wrote:
> > > > 
> > > > 
> > > > On Mon, Dec 12, 2016 at 09:34:21AM +0700, grozin@gentoo.org
> > > > wrote:
> > > > > 
> > > > > 
> > > > > On Sun, 11 Dec 2016, Kristian Fiskerstrand wrote:
> > > > > > 
> > > > > > 
> > > > > > On 12/11/2016 03:13 PM, grozin@gentoo.org wrote:
> > > > > > > 
> > > > > > > 
> > > > > > > gpg: signing failed: Inappropriate ioctl for device
> > > > > > this might indicate a want for export GPG_TTY=$(tty)
> > > > > I don't understand what has really happened. I removed my
> > > > > last
> > > > > commit, an 
> > > > > attempt to commit it again failed with gpg: signing failed.
> > > > > Then
> > > > > I logged 
> > > > > out of the box on which I have the git tree (I log in this
> > > > > box
> > > > > via ssh), 
> > > > > and logged in again. After that the commit succeeded.
> > > > 
> > > > I was also getting some odd issues with commit signing, though
> > > > it
> > > > seemed 
> > > > to settle for me when I switched to pinentry-curses (since I
> > > > use 
> > > > awesome), so I figured it was probably a local issue. Perhaps
> > > > there's a 
> > > > wider problem here?
> > > 
> > > If anyone else is getting this, it seems to be resolved by
> > > exporting 
> > > GPG_TTY=$(tty) either immediately before attempting to sign or in
> > > your 
> > > shell ~/.*rc file.
> > 
> > I'd consider this a temporary workaround. The real issue would just
> > be
> > workarounded with this, which is nice to get something committed,
> > but
> > not so nice longterm.
> > I had similar issues, but it turned out some pinentry issues for me
> > iirc, so properly fixed by now and not needing such hackery
> > anymore.
> 
> This is not a workaround, but officially recommended practice, from
> man gpg-agent:
> 
> You should always add the following lines to your .bashrc or
> whatever initialization file is used for all shell invocations:
> 
>     GPG_TTY=$(tty)
>     export GPG_TTY

Then the packages or eselect pinentry or whatever should be taking care
of it, not have users have to mess with .bashrc to have stuff work.

I don't have GPG_TTY and it works fine, but I use a graphical password
asking agent.


Mart

Re: [gentoo-dev] gpg: signing failed: Inappropriate ioctl for device

[Mike Gilbert]

On Wed, Dec 14, 2016 at 7:56 AM, Mart Raudsepp <leio@gentoo.org> wrote:
> Ühel kenal päeval, K, 14.12.2016 kell 15:35, kirjutas Andrew Savchenko:
>> On Wed, 14 Dec 2016 11:16:58 +0200 Mart Raudsepp wrote:
>> >
>> > Ühel kenal päeval, K, 14.12.2016 kell 13:08, kirjutas Sam Jorna:
>> > >
>> > > On Mon, Dec 12, 2016 at 02:35:28PM +1100, Sam Jorna wrote:
>> > > >
>> > > >
>> > > > On Mon, Dec 12, 2016 at 09:34:21AM +0700, grozin@gentoo.org
>> > > > wrote:
>> > > > >
>> > > > >
>> > > > > On Sun, 11 Dec 2016, Kristian Fiskerstrand wrote:
>> > > > > >
>> > > > > >
>> > > > > > On 12/11/2016 03:13 PM, grozin@gentoo.org wrote:
>> > > > > > >
>> > > > > > >
>> > > > > > > gpg: signing failed: Inappropriate ioctl for device
>> > > > > > this might indicate a want for export GPG_TTY=$(tty)
>> > > > > I don't understand what has really happened. I removed my
>> > > > > last
>> > > > > commit, an
>> > > > > attempt to commit it again failed with gpg: signing failed.
>> > > > > Then
>> > > > > I logged
>> > > > > out of the box on which I have the git tree (I log in this
>> > > > > box
>> > > > > via ssh),
>> > > > > and logged in again. After that the commit succeeded.
>> > > >
>> > > > I was also getting some odd issues with commit signing, though
>> > > > it
>> > > > seemed
>> > > > to settle for me when I switched to pinentry-curses (since I
>> > > > use
>> > > > awesome), so I figured it was probably a local issue. Perhaps
>> > > > there's a
>> > > > wider problem here?
>> > >
>> > > If anyone else is getting this, it seems to be resolved by
>> > > exporting
>> > > GPG_TTY=$(tty) either immediately before attempting to sign or in
>> > > your
>> > > shell ~/.*rc file.
>> >
>> > I'd consider this a temporary workaround. The real issue would just
>> > be
>> > workarounded with this, which is nice to get something committed,
>> > but
>> > not so nice longterm.
>> > I had similar issues, but it turned out some pinentry issues for me
>> > iirc, so properly fixed by now and not needing such hackery
>> > anymore.
>>
>> This is not a workaround, but officially recommended practice, from
>> man gpg-agent:
>>
>> You should always add the following lines to your .bashrc or
>> whatever initialization file is used for all shell invocations:
>>
>>     GPG_TTY=$(tty)
>>     export GPG_TTY
>
> Then the packages or eselect pinentry or whatever should be taking care
> of it, not have users have to mess with .bashrc to have stuff work.

This is not practical.

Adding it to the global /etc/bashrc is a bad idea. It would slow down
every shell startup (fork/exec), even for users who do not actively
use gpg (like root).

Also, there is no way to know what shell each gpg user will be using.

Re: [gentoo-dev] gpg: signing failed: Inappropriate ioctl for device

[M. J. Everitt]

[-- Attachment #1.1: Type: text/plain, Size: 968 bytes --]

On 14/12/16 13:53, Mike Gilbert wrote:
> On Wed, Dec 14, 2016 at 7:56 AM, Mart Raudsepp <leio@gentoo.org> wrote:
>> Ühel kenal päeval, K, 14.12.2016 kell 15:35, kirjutas Andrew Savchenko:
>>> This is not a workaround, but officially recommended practice, from
>>> man gpg-agent:
>>>
>>> You should always add the following lines to your .bashrc or
>>> whatever initialization file is used for all shell invocations:
>>>
>>>     GPG_TTY=$(tty)
>>>     export GPG_TTY
>> Then the packages or eselect pinentry or whatever should be taking care
>> of it, not have users have to mess with .bashrc to have stuff work.
> This is not practical.
>
> Adding it to the global /etc/bashrc is a bad idea. It would slow down
> every shell startup (fork/exec), even for users who do not actively
> use gpg (like root).
>
> Also, there is no way to know what shell each gpg user will be using.
>
Sounds to me like a perfect candidate for an elog/einfo, no??


[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 836 bytes --]

Re: [gentoo-dev] gpg: signing failed: Inappropriate ioctl for device

[Mike Gilbert]

On Wed, Dec 14, 2016 at 9:07 AM, M. J. Everitt <m.j.everitt@iee.org> wrote:
> On 14/12/16 13:53, Mike Gilbert wrote:
>> On Wed, Dec 14, 2016 at 7:56 AM, Mart Raudsepp <leio@gentoo.org> wrote:
>>> Ühel kenal päeval, K, 14.12.2016 kell 15:35, kirjutas Andrew Savchenko:
>>>> This is not a workaround, but officially recommended practice, from
>>>> man gpg-agent:
>>>>
>>>> You should always add the following lines to your .bashrc or
>>>> whatever initialization file is used for all shell invocations:
>>>>
>>>>     GPG_TTY=$(tty)
>>>>     export GPG_TTY
>>> Then the packages or eselect pinentry or whatever should be taking care
>>> of it, not have users have to mess with .bashrc to have stuff work.
>> This is not practical.
>>
>> Adding it to the global /etc/bashrc is a bad idea. It would slow down
>> every shell startup (fork/exec), even for users who do not actively
>> use gpg (like root).
>>
>> Also, there is no way to know what shell each gpg user will be using.
>>
> Sounds to me like a perfect candidate for an elog/einfo, no??

Who reads those? ;-)

It's not a bad idea though.

Re: [gentoo-dev] gpg: signing failed: Inappropriate ioctl for device

[M. J. Everitt]

[-- Attachment #1.1: Type: text/plain, Size: 1595 bytes --]

On 14/12/16 14:57, Mike Gilbert wrote:
> On Wed, Dec 14, 2016 at 9:07 AM, M. J. Everitt <m.j.everitt@iee.org> wrote:
>> On 14/12/16 13:53, Mike Gilbert wrote:
>>> On Wed, Dec 14, 2016 at 7:56 AM, Mart Raudsepp <leio@gentoo.org> wrote:
>>>> Ühel kenal päeval, K, 14.12.2016 kell 15:35, kirjutas Andrew Savchenko:
>>>>> This is not a workaround, but officially recommended practice, from
>>>>> man gpg-agent:
>>>>>
>>>>> You should always add the following lines to your .bashrc or
>>>>> whatever initialization file is used for all shell invocations:
>>>>>
>>>>>     GPG_TTY=$(tty)
>>>>>     export GPG_TTY
>>>> Then the packages or eselect pinentry or whatever should be taking care
>>>> of it, not have users have to mess with .bashrc to have stuff work.
>>> This is not practical.
>>>
>>> Adding it to the global /etc/bashrc is a bad idea. It would slow down
>>> every shell startup (fork/exec), even for users who do not actively
>>> use gpg (like root).
>>>
>>> Also, there is no way to know what shell each gpg user will be using.
>>>
>> Sounds to me like a perfect candidate for an elog/einfo, no??
> Who reads those? ;-)
>
> It's not a bad idea though.
>
I do, but only usually if its the last package of an emerge because
otherwise its lost many many thousands of lines upwards. Thank goodness
for portage's savelog feature. - Actually that reminds me .. someone
mentioned a useful tweak to that, with an appropriate FEATURES switch,
it would categorise the output of the logging system .. must look that
one up again, or poke the wiki team .......


[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 836 bytes --]

Re: [gentoo-dev] gpg: signing failed: Inappropriate ioctl for device

[Rich Freeman]

On Wed, Dec 14, 2016 at 10:27 AM, M. J. Everitt <m.j.everitt@iee.org> wrote:
>
> I do, but only usually if its the last package of an emerge because
> otherwise its lost many many thousands of lines upwards. Thank goodness
> for portage's savelog feature. - Actually that reminds me .. someone
> mentioned a useful tweak to that, with an appropriate FEATURES switch,
> it would categorise the output of the logging system .. must look that
> one up again, or poke the wiki team .......
>

IMO, emailing elogs to root should probably be the default.  By all
means let people turn it off, but I bet a lot of people don't realize
it is an option.

This goes in all my make.conf files:
PORTAGE_ELOG_CLASSES="warn error log"
PORTAGE_ELOG_SYSTEM="save mail"
PORTAGE_ELOG_MAILURI="a@a.com smtp.server.address"
PORTAGE_ELOG_MAILSUBJECT="package \${PACKAGE} merged on \${HOST} with notice"

Yes, some packages are a bit spammy and this should be fixed, but in
general it has prevented more headaches than it has caused.

-- 
Rich

Re: [gentoo-dev] gpg: signing failed: Inappropriate ioctl for device

[M. J. Everitt]

[-- Attachment #1.1: Type: text/plain, Size: 1430 bytes --]

On 14/12/16 15:45, Rich Freeman wrote:
> On Wed, Dec 14, 2016 at 10:27 AM, M. J. Everitt <m.j.everitt@iee.org> wrote:
>> I do, but only usually if its the last package of an emerge because
>> otherwise its lost many many thousands of lines upwards. Thank goodness
>> for portage's savelog feature. - Actually that reminds me .. someone
>> mentioned a useful tweak to that, with an appropriate FEATURES switch,
>> it would categorise the output of the logging system .. must look that
>> one up again, or poke the wiki team .......
>>
> IMO, emailing elogs to root should probably be the default.  By all
> means let people turn it off, but I bet a lot of people don't realize
> it is an option.
>
> This goes in all my make.conf files:
> PORTAGE_ELOG_CLASSES="warn error log"
> PORTAGE_ELOG_SYSTEM="save mail"
> PORTAGE_ELOG_MAILURI="a@a.com smtp.server.address"
> PORTAGE_ELOG_MAILSUBJECT="package \${PACKAGE} merged on \${HOST} with notice"
>
> Yes, some packages are a bit spammy and this should be fixed, but in
> general it has prevented more headaches than it has caused.
>
I would tend to agree that in a sysadmin role this would be very helpful.

At the risk of repeating myself, is there any einfo/elog displayed when
portage is (first) updated, to alert users of this functionality? A link
to the wiki page explaining the features [poke wiki team!] mentioned
would probably be most useful.


[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 836 bytes --]

Re: [gentoo-dev] gpg: signing failed: Inappropriate ioctl for device

[Doug Freed]

On Wed, Dec 14, 2016 at 10:52 AM, M. J. Everitt <m.j.everitt@iee.org> wrote:
> I would tend to agree that in a sysadmin role this would be very helpful.
>
> At the risk of repeating myself, is there any einfo/elog displayed when
> portage is (first) updated, to alert users of this functionality? A link
> to the wiki page explaining the features [poke wiki team!] mentioned
> would probably be most useful.
>

The PORTAGE_ELOG_* variables are documented in
/usr/share/portage/config/make.conf.example, which is referenced by
the make.conf man page.

-Doug