From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from pigeon.gentoo.org ([208.92.234.80] helo=lists.gentoo.org) by finch.gentoo.org with esmtp (Exim 4.60) (envelope-from ) id 1MGtwL-0003dh-RD for garchives@archives.gentoo.org; Wed, 17 Jun 2009 12:08:30 +0000 Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 8D714E04C8; Wed, 17 Jun 2009 12:08:28 +0000 (UTC) Received: from smtp.tmcs.ch (113.245.131.213.static.inetbone.net [213.131.245.113]) by pigeon.gentoo.org (Postfix) with ESMTP id 1D2C1E04C8 for ; Wed, 17 Jun 2009 12:08:28 +0000 (UTC) Received: from [192.168.0.100] (154-224.0-85.cust.bluewin.ch [85.0.224.154]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by smtp.tmcs.ch (Postfix) with ESMTPSA id E5C5A68694B for ; Wed, 17 Jun 2009 14:08:26 +0200 (CEST) Subject: Re: [gentoo-dev] Re: [packagekit] Inviting you to project "PackageMap" From: Tiziano =?ISO-8859-1?Q?M=FCller?= To: gentoo-dev@lists.gentoo.org In-Reply-To: <4A3225F0.6070800@hartwork.org> References: <4A3206DA.3090907@hartwork.org> <15e53e180906120130md68cd94nba61fa5560c73eb4@mail.gmail.com> <4A3225F0.6070800@hartwork.org> Content-Type: multipart/signed; micalg="sha1"; protocol="application/x-pkcs7-signature"; boundary="=-FQnQCy3vCUhzZAlSGxyE" Organization: Gentoo Date: Wed, 17 Jun 2009 14:08:26 +0200 Message-Id: <1245240506.6788.5.camel@localhost> Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-dev@lists.gentoo.org Reply-to: gentoo-dev@lists.gentoo.org Mime-Version: 1.0 X-Mailer: Evolution 2.26.2 X-Archives-Salt: 0361d901-8385-45cc-af3d-41dfef1cd033 X-Archives-Hash: 24c2f5f7e1e532b8dad4a0755f29e434 --=-FQnQCy3vCUhzZAlSGxyE Content-Type: multipart/signed; micalg="pgp-sha1"; protocol="application/pgp-signature"; boundary="=-MGYXeC7JGZAJIybet7lM" --=-MGYXeC7JGZAJIybet7lM Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Am Freitag, den 12.06.2009, 11:54 +0200 schrieb Sebastian Pipping: > Richard Hughes wrote: > > I'm slightly worried about it being called a service. Is it going to > > be a new process that just does the mapping or is this a bad choice of > > words? If it is a new process then I'm not sure such a thing will > > catch on. >=20 > I'm not yet sure about how a mapper will keep it's data > fresh as the use of it is dependent on that. > Ignore my "service" for now. >=20 >=20 > > I'm also worried that a package manager has to read in and parse > > thousands of small files. >=20 > While you mention "package manager" - with the current concept > the data will not be precise enough for use with a package manager. >=20 >=20 > > Why did you decide to write each project as > > a single xml file? >=20 > - The other 99% of the database stay valid XML if a single > file is invalid >=20 > - To better fit the version controlled environment >=20 >=20 > > Parsing and reading 10,000 files (in multiple directories) might take > > a few seconds, and would have to be copied into memory (few Mb) to > > query quickly. >=20 > Correct. >=20 >=20 > > Which has to be invalidated if any of the files or > > directories change. Why didn't you just put them in a sqlite database > > that can be queried in a few ms, without dragging in an xml parser? > > Also 10,000 files take up way more space (and takes longer to install > > and update) than a single database file. >=20 > I like your idea about sqlite. Maybe keeping the data to edit XML > and query and sqlite export snapshot is something to try. Why not use a XML database like dbxml? Maybe you could just specify the XML files as storage and then dbxml would do the rest. >=20 >=20 > > XML might be > > useful for storing the data, but not for querying. >=20 > Good point. Using XPath and XQuery you can do queries on XML as well. Cheers, Tiziano --=20 Tiziano M=C3=BCller Gentoo Linux Developer, Council Member Areas of responsibility: Samba, PostgreSQL, CPP, Python, sysadmin, GLEP Editor E-Mail : dev-zero@gentoo.org GnuPG FP : F327 283A E769 2E36 18D5 4DE2 1B05 6A63 AE9C 1E30 --=-MGYXeC7JGZAJIybet7lM Content-Type: application/pgp-signature; name="signature.asc" Content-Description: Dies ist ein digital signierter Nachrichtenteil Content-Transfer-Encoding: quoted-printable -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.11 (GNU/Linux) iEYEABECAAYFAko43LMACgkQGwVqY66cHjA4FwCaAui7du0I8aKpc6l5zZWSBS27 yQoAn2xde1o2DGcI04EytN9Nhw2qLpsj =3Dfrh6 -----END PGP SIGNATURE----- --=-MGYXeC7JGZAJIybet7lM-- --=-FQnQCy3vCUhzZAlSGxyE Content-Type: application/x-pkcs7-signature; name="smime.p7s" Content-Disposition: attachment; filename="smime.p7s" Content-Transfer-Encoding: base64 MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIKbjCCBTMw ggMboAMCAQICAwcAeTANBgkqhkiG9w0BAQUFADB5MRAwDgYDVQQKEwdSb290IENBMR4wHAYDVQQL ExVodHRwOi8vd3d3LmNhY2VydC5vcmcxIjAgBgNVBAMTGUNBIENlcnQgU2lnbmluZyBBdXRob3Jp dHkxITAfBgkqhkiG9w0BCQEWEnN1cHBvcnRAY2FjZXJ0Lm9yZzAeFw0wOTA2MTIwOTA4NTVaFw0x MTA2MTIwOTA4NTVaMD0xFzAVBgNVBAMUDlRpemlhbm8gTfxsbGVyMSIwIAYJKoZIhvcNAQkBFhNk ZXYtemVyb0BnZW50b28ub3JnMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA1LnPwwQ2 3O3zXpqQ2p8WtdpOnQDeyUja0gn+BSULJ8uZ6ro6Xg9cUZdOVStm6SLjAU82fSVsEsvDw1u2plf1 qTtLkXRtnyaJjFhGC27/MR/tQqOR5eC2qWbwQuB2B+wS/9hHoqjfLAIVksqwDfFjCNz1QEj+EyAl O5LuwRWs7Cwmk37wXkaCW6vEzmATJhN0cBXcR5rKJv0dmvLE66NX5MqXfQQ4kSFMSIaFbhc/+Vix b92hF+KhfG8C0PMUFvCzToFYgU+uEL9kvmUfa8MkVzaicWmsnycZ+aywZrBfgJqB50FCANSq2gQ1 8KnajvMc3lAY5njvJ9S1i0SZQGw7hwIDAQABo4H/MIH8MAwGA1UdEwEB/wQCMAAwVgYJYIZIAYb4 QgENBEkWR1RvIGdldCB5b3VyIG93biBjZXJ0aWZpY2F0ZSBmb3IgRlJFRSBoZWFkIG92ZXIgdG8g aHR0cDovL3d3dy5DQWNlcnQub3JnMEAGA1UdJQQ5MDcGCCsGAQUFBwMEBggrBgEFBQcDAgYKKwYB BAGCNwoDBAYKKwYBBAGCNwoDAwYJYIZIAYb4QgQBMDIGCCsGAQUFBwEBBCYwJDAiBggrBgEFBQcw AYYWaHR0cDovL29jc3AuY2FjZXJ0Lm9yZzAeBgNVHREEFzAVgRNkZXYtemVyb0BnZW50b28ub3Jn MA0GCSqGSIb3DQEBBQUAA4ICAQCq2Lk5Vm616z6oAUINpZi7EbAZ8C6xgPqzLTa+NAZ9RQBKkBY4 Bh1THZNCAve/ngq7LmfqcaahZrg31VIpNLMK4tu0ygI19Hj3oh3oV7mv+1v5NzL7FhFU5oyGOfNI jEVVLdeBreg9dkO/xAHMPdc/HpQUJzHQaEwttJgh+GfII1tWwCkZUjrz2MVSGcV84fivi+W2KW4Z hkn1KXb0T+5mq9B4BxahTUeqeua3zJB3GwE0ssggjCsVTrrXmfsMzbR9RTOArkMxxUFWuS6XQgh7 pCHZy+Who8+cAwGqU1hnthLtFz1F37WxerUTsv4r3GtUwv9hVHRTUIfE7/pRvc3PyoBRIjLB53yN iZlfzbcPx9bF16XJ3AsHQSNciW7TS007oH4PMYHMmIrkf+Ir/dkJpN/qYPGP2Cc3txvrhvhfNiNv yQDtMrwG3cNW6Dml7Sx7vD2eXQ+hk6uAbQEE4OpBsDTCXFdGKZ1MUV7+qsNg2hqYTfYV/aeDFxpL qDBt2buwIvZxI7khyUelQSkO1FPnW6LK/fDxK28iSirnyjFuPDUKPALvj9kiJAyLSStiSGn7ZJ2J rDsxXXsYnBSEKSyik9TLASwn7QN8Eje0lX2ekPB0fNNPR8fs10vKKZPp1AdaYYYCz8qn5iAsdEIq hOWZUT7PohZw0PlxBxKF9BE0tTCCBTMwggMboAMCAQICAwcAeTANBgkqhkiG9w0BAQUFADB5MRAw DgYDVQQKEwdSb290IENBMR4wHAYDVQQLExVodHRwOi8vd3d3LmNhY2VydC5vcmcxIjAgBgNVBAMT GUNBIENlcnQgU2lnbmluZyBBdXRob3JpdHkxITAfBgkqhkiG9w0BCQEWEnN1cHBvcnRAY2FjZXJ0 Lm9yZzAeFw0wOTA2MTIwOTA4NTVaFw0xMTA2MTIwOTA4NTVaMD0xFzAVBgNVBAMUDlRpemlhbm8g TfxsbGVyMSIwIAYJKoZIhvcNAQkBFhNkZXYtemVyb0BnZW50b28ub3JnMIIBIjANBgkqhkiG9w0B AQEFAAOCAQ8AMIIBCgKCAQEA1LnPwwQ23O3zXpqQ2p8WtdpOnQDeyUja0gn+BSULJ8uZ6ro6Xg9c UZdOVStm6SLjAU82fSVsEsvDw1u2plf1qTtLkXRtnyaJjFhGC27/MR/tQqOR5eC2qWbwQuB2B+wS /9hHoqjfLAIVksqwDfFjCNz1QEj+EyAlO5LuwRWs7Cwmk37wXkaCW6vEzmATJhN0cBXcR5rKJv0d mvLE66NX5MqXfQQ4kSFMSIaFbhc/+Vixb92hF+KhfG8C0PMUFvCzToFYgU+uEL9kvmUfa8MkVzai cWmsnycZ+aywZrBfgJqB50FCANSq2gQ18KnajvMc3lAY5njvJ9S1i0SZQGw7hwIDAQABo4H/MIH8 MAwGA1UdEwEB/wQCMAAwVgYJYIZIAYb4QgENBEkWR1RvIGdldCB5b3VyIG93biBjZXJ0aWZpY2F0 ZSBmb3IgRlJFRSBoZWFkIG92ZXIgdG8gaHR0cDovL3d3dy5DQWNlcnQub3JnMEAGA1UdJQQ5MDcG CCsGAQUFBwMEBggrBgEFBQcDAgYKKwYBBAGCNwoDBAYKKwYBBAGCNwoDAwYJYIZIAYb4QgQBMDIG CCsGAQUFBwEBBCYwJDAiBggrBgEFBQcwAYYWaHR0cDovL29jc3AuY2FjZXJ0Lm9yZzAeBgNVHREE FzAVgRNkZXYtemVyb0BnZW50b28ub3JnMA0GCSqGSIb3DQEBBQUAA4ICAQCq2Lk5Vm616z6oAUIN pZi7EbAZ8C6xgPqzLTa+NAZ9RQBKkBY4Bh1THZNCAve/ngq7LmfqcaahZrg31VIpNLMK4tu0ygI1 9Hj3oh3oV7mv+1v5NzL7FhFU5oyGOfNIjEVVLdeBreg9dkO/xAHMPdc/HpQUJzHQaEwttJgh+GfI I1tWwCkZUjrz2MVSGcV84fivi+W2KW4Zhkn1KXb0T+5mq9B4BxahTUeqeua3zJB3GwE0ssggjCsV TrrXmfsMzbR9RTOArkMxxUFWuS6XQgh7pCHZy+Who8+cAwGqU1hnthLtFz1F37WxerUTsv4r3GtU wv9hVHRTUIfE7/pRvc3PyoBRIjLB53yNiZlfzbcPx9bF16XJ3AsHQSNciW7TS007oH4PMYHMmIrk f+Ir/dkJpN/qYPGP2Cc3txvrhvhfNiNvyQDtMrwG3cNW6Dml7Sx7vD2eXQ+hk6uAbQEE4OpBsDTC XFdGKZ1MUV7+qsNg2hqYTfYV/aeDFxpLqDBt2buwIvZxI7khyUelQSkO1FPnW6LK/fDxK28iSirn yjFuPDUKPALvj9kiJAyLSStiSGn7ZJ2JrDsxXXsYnBSEKSyik9TLASwn7QN8Eje0lX2ekPB0fNNP R8fs10vKKZPp1AdaYYYCz8qn5iAsdEIqhOWZUT7PohZw0PlxBxKF9BE0tTGCAzMwggMvAgEBMIGA MHkxEDAOBgNVBAoTB1Jvb3QgQ0ExHjAcBgNVBAsTFWh0dHA6Ly93d3cuY2FjZXJ0Lm9yZzEiMCAG A1UEAxMZQ0EgQ2VydCBTaWduaW5nIEF1dGhvcml0eTEhMB8GCSqGSIb3DQEJARYSc3VwcG9ydEBj YWNlcnQub3JnAgMHAHkwCQYFKw4DAhoFAKCCAYcwGAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEHATAc BgkqhkiG9w0BCQUxDxcNMDkwNjE3MTIwODE5WjAjBgkqhkiG9w0BCQQxFgQU5JtC49xz9PZhJBj3 Z7HSaZ5L94AwgZEGCSsGAQQBgjcQBDGBgzCBgDB5MRAwDgYDVQQKEwdSb290IENBMR4wHAYDVQQL ExVodHRwOi8vd3d3LmNhY2VydC5vcmcxIjAgBgNVBAMTGUNBIENlcnQgU2lnbmluZyBBdXRob3Jp dHkxITAfBgkqhkiG9w0BCQEWEnN1cHBvcnRAY2FjZXJ0Lm9yZwIDBwB5MIGTBgsqhkiG9w0BCRAC CzGBg6CBgDB5MRAwDgYDVQQKEwdSb290IENBMR4wHAYDVQQLExVodHRwOi8vd3d3LmNhY2VydC5v cmcxIjAgBgNVBAMTGUNBIENlcnQgU2lnbmluZyBBdXRob3JpdHkxITAfBgkqhkiG9w0BCQEWEnN1 cHBvcnRAY2FjZXJ0Lm9yZwIDBwB5MA0GCSqGSIb3DQEBAQUABIIBAHAGK19tfe36G0T9avE15V51 y4fXeV5kXSJqcwoBXMv9hDODzwWggUnNbxheBrRm8/Wzh9Vs290NM2UzjzBoTLBHPmdS6zWvUf7H JRP4XWeCNQQAZ03iV6jxYBV8/0C0sc0Qe9IlqDn8m+E2gEpAb4mJX2VvTzEW4q5Ba4Gi5doy7bRZ J2l17e/BqjpMIpztQ9b2JVWUIyftjcKisNuMbLgkxmm/EWFOrp8gHnYJD3TgIBqoMyQb9CAnZtYa jcP+X4XR2NQMehMosOd4dsz4aTr0Tk1pnOWIFPz2gKn6XwZXFY327Ddk9KwMEPYuFvlMo78uUGba jVPlK3sAylrlWqoAAAAAAAA= --=-FQnQCy3vCUhzZAlSGxyE--