From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by finch.gentoo.org (Postfix) with ESMTPS id 2C2E3138359 for ; Sun, 5 Jul 2020 16:18:07 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 36DFFE086A; Sun, 5 Jul 2020 16:18:06 +0000 (UTC) Received: from raba.swcp.com (raba.swcp.com [216.184.2.46]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id 1FDE8E086A for ; Sun, 5 Jul 2020 16:18:05 +0000 (UTC) Received: from roundcube.swcp.com (roundcube.swcp.com [216.184.2.221]) by raba.swcp.com (8.15.2/8.15.2/Debian-14~deb10u1) with ESMTP id 065GI3BH024295 for ; Sun, 5 Jul 2020 10:18:04 -0600 Received: from roundcube.swcp.com (localhost [127.0.0.1]) by roundcube.swcp.com (8.15.2/8.15.2/Debian-8) with ESMTP id 065GI3j2026305 for ; Sun, 5 Jul 2020 10:18:03 -0600 Received: (from www-data@localhost) by roundcube.swcp.com (8.15.2/8.15.2/Submit) id 065GI2Qw026296; Sun, 5 Jul 2020 10:18:02 -0600 X-Authentication-Warning: roundcube.swcp.com: www-data set sender to ebo@sandien.com using -f To: Subject: Re: [gentoo-soc] Weekly Report: Big Data Infrastructure and Maven Overlay in Week 5 X-PHP-Originating-Script: 1000:main.inc Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-soc@lists.gentoo.org Reply-to: gentoo-soc@lists.gentoo.org X-Auto-Response-Suppress: DR, RN, NRN, OOF, AutoReply MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Date: Sun, 05 Jul 2020 10:18:02 -0600 From: EBo In-Reply-To: References: Message-ID: X-Sender: ebo@sandien.com User-Agent: Roundcube Webmail/0.8.2 X-Archives-Salt: f5b40b0f-cdc5-4d07-828c-032a71223940 X-Archives-Hash: 37d64af6936232ff1cf3780637c77b0a Out of curiosity, can you point me to any project write up that was probably part of the proposal? One of my last big-data projects started out with a 3.5 petabyte repository and filtered on down to cover 10 million contiguous kilometers. We did not use Maven, and I would be curious to see where the project is going. Now that I know about this I will try to follow it a bit more. Best of success! On Jul 5 2020 10:05 AM, Zhang Zongyu wrote: > Hello, > > This week I have done a lot of repetitive work. That is, to go > through > all of the ebuild files in Gentoo Repository and to get them the > equivalent GroupId and ArtifactId in Maven Central. There are more > than 500 packages in dev-java/ and java-virtual/ category, and > sometimes one Gentoo package may correspond to more than one Maven > artifact, so it took me a lot of time to complete them. And here is > my > lookup up table which covers all packages in dev-java/ and maps > "category/package:slot" into "groupId:artifactId".[1] As a result, > spark-core can make use of more than 100 Gentoo native packages now. > > Besides, I have also added java-ebuilder some features. It can check > the metadata of a package and get the correct SLOT, and it can make > ebuild unpack "Maven Central distributed source files" into proper > ${JAVA_SRC_DIR} now. > > Next week I am going to test and add jaxb (javax.xml.bind:jaxb-api > and > javax.xml.bind:jaxb-impl) and some newer version packages which are > required by spark-core, and I hope the newer version ebuild files > could be accepted by Gentoo-Java team. The prototype of the ebuild > files that are just generated by java-ebuilder are listed in [2]. > > Regards, > Zhang Zongyu > > [1] lookup table containing all packages from dev-java/ > > https://github.com/6-6-6/JEbuilder/blob/master/app-portage/java-ebuilder/files/scripts/LUT/LUT > [2] a prototype overlay > https://github.com/6-6-6/spark-overlay/tree/master/dev-java