[gentoo-user] Weird slocate behaviour - file ignored?

[gentoo-user] Weird slocate behaviour - file ignored?

[Stroller]

I was looking for a Knoppix DVD today, and came across any anomaly  
whereby locate doesn't show it. It lists the CD iso in the same  
directory, but not the DVD right next to it, and both files seem to be  
read by the database when I run updatedb manually.

Is there anyone who can possibly explain this, please? Am I  
overlooking some intentional slocate behaviour, or should I delete the  
slocate database file & see if rebuilding it makes a difference? That  
seems like a very Windows thing to do, but I guess it's possible the  
db is damaged.

Stroller.




$ locate -i KNOPPIX
/mnt/space/Archive/Linux/CDs/KNOPPIX_V5.1.1CD-2007-01-04-EN.iso
/var/cache/edb/dep/usr/portage/sys-apps/ddcxinfo-knoppix-0.6
/usr/portage/metadata/cache/sys-apps/ddcxinfo-knoppix-0.6
/usr/portage/sys-apps/ddcxinfo-knoppix
/usr/portage/sys-apps/ddcxinfo-knoppix/Manifest
/usr/portage/sys-apps/ddcxinfo-knoppix/ddcxinfo-knoppix-0.6.ebuild
/usr/portage/sys-apps/ddcxinfo-knoppix/ChangeLog
/usr/portage/sys-apps/ddcxinfo-knoppix/metadata.xml
$ locate KNOPPIX
/mnt/space/Archive/Linux/CDs/KNOPPIX_V5.1.1CD-2007-01-04-EN.iso
$ ls -l /mnt/space/Archive/Linux/CDs/KNOPPIX_V5.*
-rwxr--r-- 1 stroller users  730177536 Mar  8  2007 /mnt/space/Archive/ 
Linux/CDs/KNOPPIX_V5.1.1CD-2007-01-04-EN.iso
-rw-r--r-- 1 stroller users 4446816256 Oct 24 05:31 /mnt/space/Archive/ 
Linux/CDs/KNOPPIX_V5.3.1DVD-2008-03-26-EN.iso
$ sudo /usr/bin/updatedb -v | grep -i knoppix
/mnt/space/Archive/Linux/CDs/KNOPPIX_V5.1.1CD-2007-01-04-EN.iso
/mnt/space/Archive/Linux/CDs/KNOPPIX_V5.3.1DVD-2008-03-26-EN.iso
/var/cache/edb/dep/usr/portage/sys-apps/ddcxinfo-knoppix-0.6
/usr/portage/metadata/cache/sys-apps/ddcxinfo-knoppix-0.6
/usr/portage/sys-apps/ddcxinfo-knoppix
/usr/portage/sys-apps/ddcxinfo-knoppix/Manifest
/usr/portage/sys-apps/ddcxinfo-knoppix/ddcxinfo-knoppix-0.6.ebuild
/usr/portage/sys-apps/ddcxinfo-knoppix/ChangeLog
/usr/portage/sys-apps/ddcxinfo-knoppix/metadata.xml
$ locate KNOPPIX
/mnt/space/Archive/Linux/CDs/KNOPPIX_V5.1.1CD-2007-01-04-EN.iso
$

Re: [gentoo-user] Weird slocate behaviour - file ignored?

[Paul Hartman]

On Sat, Mar 7, 2009 at 6:42 AM, Stroller <stroller@stellar.eclipse.co.uk> wrote:
> I was looking for a Knoppix DVD today, and came across any anomaly whereby
> locate doesn't show it. It lists the CD iso in the same directory, but not
> the DVD right next to it, and both files seem to be read by the database
> when I run updatedb manually.

Weird, the only difference seems to be the CD is set +x and the DVD is
not. I don't think that should make it behave that way, though..

Re: [gentoo-user] Weird slocate behaviour - file ignored?

[Stroller]

On 7 Mar 2009, at 17:34, Paul Hartman wrote:

> On Sat, Mar 7, 2009 at 6:42 AM, Stroller <stroller@stellar.eclipse.co.uk 
> > wrote:
>> I was looking for a Knoppix DVD today, and came across any anomaly  
>> whereby
>> locate doesn't show it. It lists the CD iso in the same directory,  
>> but not
>> the DVD right next to it, and both files seem to be read by the  
>> database
>> when I run updatedb manually.
>
> Weird, the only difference seems to be the CD is set +x and the DVD is
> not. I don't think that should make it behave that way, though..

No, I already checked.

Stroller.

Re: [gentoo-user] Weird slocate behaviour - file ignored?

[Stroller]

On 7 Mar 2009, at 12:42, Stroller wrote:
> I was looking for a Knoppix DVD today, and came across any anomaly  
> whereby locate doesn't show it. It lists the CD iso in the same  
> directory, but not the DVD right next to it, and both files seem to  
> be read by the database when I run updatedb manually.

A big old bump from 6 months ago, could I ask kind members of the list  
to try running locate to look for a big file to see if they can  
reproduce this, please?

I'm seeing on a SECOND machine exactly the same thing - files larger  
than about 4gb are not showing up in the locate search results:

$ ls -lh File.big
-rw-r--r-- 1 stroller users 5.4G 2009-02-27 10:31 File.big
$ sudo updatedb -v > foo
Password:
$ grep File.big foo
/home/stroller/File.big
$ locate File.big
$

If you don't have any DVD iso images on your system, you should be   
create a suitable file with `dd if=/dev/zero of=file.big bs=5M  
count=1k`. Update the slocate database & take a look for it, if you  
would be so kind.

I can't quite believe this and I'm kinda rubbing my eyes here. One  
machine behaving like this I can shrug it off as a quirk that I should  
really get around to fixin' sometime. I find it too incredible to  
imagine that I may have stumbled over some heretofore undiscovered bug  
in such a popular package.

Stroller.

Re: [gentoo-user] Weird slocate behaviour - file ignored?

[Alan McKinnon]

On Friday 07 August 2009 05:25:28 Stroller wrote:
> On 7 Mar 2009, at 12:42, Stroller wrote:
> > I was looking for a Knoppix DVD today, and came across any anomaly
> > whereby locate doesn't show it. It lists the CD iso in the same
> > directory, but not the DVD right next to it, and both files seem to
> > be read by the database when I run updatedb manually.
>
> A big old bump from 6 months ago, could I ask kind members of the list
> to try running locate to look for a big file to see if they can
> reproduce this, please?
>
> I'm seeing on a SECOND machine exactly the same thing - files larger
> than about 4gb are not showing up in the locate search results:
>
> $ ls -lh File.big
> -rw-r--r-- 1 stroller users 5.4G 2009-02-27 10:31 File.big
> $ sudo updatedb -v > foo
> Password:
> $ grep File.big foo
> /home/stroller/File.big
> $ locate File.big
> $

Works here:

# ls -alh File.Big
-rw-r--r-- 1 root root 5.0G Aug  7 10:01 File.Big
# updatedb -v > foo
# grep File.Big foo
/var/temp/File.Big
# locate File.Big
/var/temp/File.Big


What are the contents of your /etc/updatedb.conf?

-- 
alan dot mckinnon at gmail dot com

Re: [gentoo-user] Weird slocate behaviour - file ignored?

[pk]

Stroller wrote:
> I'm seeing on a SECOND machine exactly the same thing - files larger
> than about 4gb are not showing up in the locate search results:
> 
> $ ls -lh File.big
> -rw-r--r-- 1 stroller users 5.4G 2009-02-27 10:31 File.big
> $ sudo updatedb -v > foo
> Password:
> $ grep File.big foo
> /home/stroller/File.big
> $ locate File.big
> $

I get the same behaviour as you:
# updatedb -v | grep -i file.big
/home/pk/file.big
# locate file.big
#

Files below that ~4Gb shows up as normal...

I have nothing out of the ordinary in my updatedb.conf either:

# /etc/updatedb.conf: config file for slocate
# $Id: updatedb.conf,v 1.25 2008/12/02 20:09:15 vapier Exp $

# This file sets variables that are used by updatedb.
# For more info, see the updatedb(1) manpage.

# Filesystems that are pruned from updatedb database
PRUNEFS="afs auto autofs cifs devfs devpts eventpollfs futexfs gfs
hugetlbfs iso9660 mqueue ncpfs nfs NFS nfs4 nfsd nnpfs ocfs ocfs2 pipefs
proc ramfs rpc_pipefs selinuxfs sfs shfs smbfs sockfs spufs subfs
supermount sysfs tmpfs udf usbfs vperfctrfs"

# Paths which are pruned from updatedb database
PRUNEPATHS="/tmp /var/tmp /root/.ccache"

# nice value to run at: see -n in nice(1)
NICE="10"

# ionice class to run at: see -c in ionice(1)
IONICE_CLASS="2"

# ionice priority to run at: see -n in ionice(1)
IONICE_PRIORITY="7"

So why does it prune files with bigger size than about 4Gb? The only
thing I can think of is that my machine is 32bit... But why would
slocate use file size as a factor?

Best regards

Peter K

Re: [gentoo-user] Weird slocate behaviour - file ignored?

[Volker Armin Hemmann]

On Samstag 07 März 2009, Stroller wrote:


ls -lh /testfile
-rw-r--r-- 1 root root 5,8G  7. Aug 11:33 /testfile

slocate testfile
/testfile
/usr/bin/create_dirac_testfile.pl

AMD64, slocate 3.1-r2, reiser4

Re: [gentoo-user] Weird slocate behaviour - file ignored?

[Alan McKinnon]

On Friday 07 August 2009 11:31:22 pk wrote:
> Stroller wrote:
> > I'm seeing on a SECOND machine exactly the same thing - files larger
> > than about 4gb are not showing up in the locate search results:
> >
> > $ ls -lh File.big
> > -rw-r--r-- 1 stroller users 5.4G 2009-02-27 10:31 File.big
> > $ sudo updatedb -v > foo
> > Password:
> > $ grep File.big foo
> > /home/stroller/File.big
> > $ locate File.big
> > $
>
> I get the same behaviour as you:
> # updatedb -v | grep -i file.big
> /home/pk/file.big
> # locate file.big
> #

As posted previously, mine works fine :-)

My box is 64 bit. Strolelr and Peter, are yours 32 or 64 bit?

-- 
alan dot mckinnon at gmail dot com

Re: [gentoo-user] Weird slocate behaviour - file ignored?

[pk]

Alan McKinnon wrote:

> My box is 64 bit. Strolelr and Peter, are yours 32 or 64 bit?

Mine is 32bit. It's quite puzzling why that would matter in this case...

Best regards

Peter K

Re: [gentoo-user] Weird slocate behaviour - file ignored?

[Volker Armin Hemmann]

On Freitag 07 August 2009, pk wrote:
> Alan McKinnon wrote:
> > My box is 64 bit. Strolelr and Peter, are yours 32 or 64 bit?
>
> Mine is 32bit. It's quite puzzling why that would matter in this case...
>
> Best regards
>
> Peter K

just calculate the result of 2^32

Re: [gentoo-user] Weird slocate behaviour - file ignored?

[pk]

Volker Armin Hemmann wrote:

> just calculate the result of 2^32

I know this but why would file size matter to slocate?

Best regards

Peter K

Re: [gentoo-user] Weird slocate behaviour - file ignored?

[Alex Schuster]

pk writes:

> So why does it prune files with bigger size than about 4Gb? The only
> thing I can think of is that my machine is 32bit... But why would
> slocate use file size as a factor?

I can confirm the problem on my 32bit machine with default updatedb.conf. I 
had to emerge slocate first for that, though - normally I am using mlocate, 
which does NOT show the problem. So using mlocate instead of slocate would 
be a workaround, and mlocate is supposed to be faster than slocate anyway.

https://fedorahosted.org/mlocate/

	Wonko

Re: [gentoo-user] Weird slocate behaviour - file ignored?

[Stroller]

[-- Attachment #1: Type: text/plain, Size: 704 bytes --]


On 7 Aug 2009, at 09:04, Alan McKinnon wrote:
> ...
> What are the contents of your /etc/updatedb.conf?

I'm pretty sure it's stock standard, see attached.

My systems are both 32-bit - early model Pentium 4s, the kind with  
100mhz FSBs.

I had already opened bug #280620 for this when I posted yesterday - I  
didn't mention it then in case I drew derision because I was doing  
something so obviously stupid. I'm just really glad I'm not alone &  
not going crazy.

I'd be grateful if those of you who have been able to reproduce this  
would confirm so on b.g.o. so that the devs are aware that the problem  
isn't isolated to me:
http://bugs.gentoo.org/show_bug.cgi?id=280620

Cheers,

Stroller.



[-- Attachment #2: updatedb.conf --]
[-- Type: application/octet-stream, Size: 790 bytes --]

# /etc/updatedb.conf: config file for slocate
# $Id: updatedb.conf,v 1.25 2008/12/02 20:09:15 vapier Exp $

# This file sets variables that are used by updatedb.
# For more info, see the updatedb(1) manpage.

# Filesystems that are pruned from updatedb database
PRUNEFS="afs auto autofs cifs devfs devpts eventpollfs futexfs gfs hugetlbfs iso9660 mqueue ncpfs nfs NFS nfs4 nfsd nnpfs ocfs ocfs2 pipefs proc ramfs rpc_pipefs selinuxfs sfs shfs smbfs sockfs spufs subfs supermount sysfs tmpfs udf usbfs vperfctrfs"

# Paths which are pruned from updatedb database
PRUNEPATHS="/tmp /var/tmp /root/.ccache"

# nice value to run at: see -n in nice(1)
NICE="10"

# ionice class to run at: see -c in ionice(1)
IONICE_CLASS="2"

# ionice priority to run at: see -n in ionice(1)
IONICE_PRIORITY="7"

[-- Attachment #3: Type: text/plain, Size: 1 bytes --]

Re: [gentoo-user] Weird slocate behaviour - file ignored?

[Paul Hartman]

On Thu, Aug 6, 2009 at 10:25 PM, Stroller<stroller@stellar.eclipse.co.uk> wrote:
> On 7 Mar 2009, at 12:42, Stroller wrote:
>>
>> I was looking for a Knoppix DVD today, and came across any anomaly whereby
>> locate doesn't show it. It lists the CD iso in the same directory, but not
>> the DVD right next to it, and both files seem to be read by the database
>> when I run updatedb manually.
>
> A big old bump from 6 months ago, could I ask kind members of the list to
> try running locate to look for a big file to see if they can reproduce this,
> please?
>
> I'm seeing on a SECOND machine exactly the same thing - files larger than
> about 4gb are not showing up in the locate search results:

Works as expected for me on ~amd64. Found a 7.5G file just fine.

Re: [gentoo-user] Weird slocate behaviour - file ignored?

[Paul Hartman]

On Fri, Aug 7, 2009 at 10:19 AM, Paul
Hartman<paul.hartman+gentoo@gmail.com> wrote:
> On Thu, Aug 6, 2009 at 10:25 PM, Stroller<stroller@stellar.eclipse.co.uk> wrote:
>> On 7 Mar 2009, at 12:42, Stroller wrote:
>>>
>>> I was looking for a Knoppix DVD today, and came across any anomaly whereby
>>> locate doesn't show it. It lists the CD iso in the same directory, but not
>>> the DVD right next to it, and both files seem to be read by the database
>>> when I run updatedb manually.
>>
>> A big old bump from 6 months ago, could I ask kind members of the list to
>> try running locate to look for a big file to see if they can reproduce this,
>> please?
>>
>> I'm seeing on a SECOND machine exactly the same thing - files larger than
>> about 4gb are not showing up in the locate search results:
>
> Works as expected for me on ~amd64. Found a 7.5G file just fine.
>

I'm using slocate-3.1-r2 by the way

Re: [gentoo-user] Weird slocate behaviour - file ignored?

[pk]

Stroller wrote:

> I'd be grateful if those of you who have been able to reproduce this
> would confirm so on b.g.o. so that the devs are aware that the problem
> isn't isolated to me:
> http://bugs.gentoo.org/show_bug.cgi?id=280620

Done.

Best regards

Peter K