From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by finch.gentoo.org (Postfix) with ESMTPS id 6A9EC138359 for ; Sun, 5 Jul 2020 17:40:28 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id AC54FE0814; Sun, 5 Jul 2020 17:40:27 +0000 (UTC) Received: from raba.swcp.com (raba.swcp.com [216.184.2.46]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id 8FB7AE0814 for ; Sun, 5 Jul 2020 17:40:27 +0000 (UTC) Received: from roundcube.swcp.com (roundcube.swcp.com [216.184.2.221]) by raba.swcp.com (8.15.2/8.15.2/Debian-14~deb10u1) with ESMTP id 065HePZD025065 for ; Sun, 5 Jul 2020 11:40:26 -0600 Received: from roundcube.swcp.com (localhost [127.0.0.1]) by roundcube.swcp.com (8.15.2/8.15.2/Debian-8) with ESMTP id 065HeP5Q030113 for ; Sun, 5 Jul 2020 11:40:25 -0600 Received: (from www-data@localhost) by roundcube.swcp.com (8.15.2/8.15.2/Submit) id 065HePsR030112; Sun, 5 Jul 2020 11:40:25 -0600 X-Authentication-Warning: roundcube.swcp.com: www-data set sender to ebo@sandien.com using -f To: Subject: Re: [gentoo-soc] Weekly Report: Big Data Infrastructure and Maven Overlay in Week 5 X-PHP-Originating-Script: 1000:main.inc Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-soc@lists.gentoo.org Reply-to: gentoo-soc@lists.gentoo.org X-Auto-Response-Suppress: DR, RN, NRN, OOF, AutoReply MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit Date: Sun, 05 Jul 2020 11:40:25 -0600 From: EBo In-Reply-To: References: Message-ID: <948e781d116daa98177d0c778648f0d5@mail.swcp.com> X-Sender: ebo@sandien.com User-Agent: Roundcube Webmail/0.8.2 X-Archives-Salt: e965027b-b07f-4c4d-898b-937f9248e73b X-Archives-Hash: 256a8ee8a2bb1cbb17a52edaef49fb4e Ahhh... thank you for your time and explanation. This all makes sense now. I can see how having something that would pom.xml <==> package.ebuild would be extremely handy. Best of luck to you you and your team. Thanks again, EBo -- On Jul 5 2020 11:23 AM, Zhang Zongyu wrote: > Hello, > > Here is the proposal of this project.[1] > In a nutshell, the goal of this project is to intergrate Portage with > Maven, or to translate Maven pom.xml into ebuild files. > And the most related project should be java-ebuilder, which aims at > processing pom.xml and forming an equivalent ebuild.[2] > The deliverable of this project will be an overlay resolving all the > dependencies of spark, which is widely used for big data processing, > so my > mentor named the project "big data infrastructure". > > Actually it is not related to big data processing or any "big data". > > I am sorry if it confused you, and I am glad that you are interested > in > this project. > > Regards, > Zhang Zongyu > > [1] https://summerofcode.withgoogle.com/projects/#4994566568017920 > [2] https://github.com/6-6-6/java-ebuilder > > EBo 于 2020年7月6日周一 上午12:18写道： > >> Out of curiosity, can you point me to any project write up that was >> probably part of the proposal? One of my last big-data projects >> started >> out with a 3.5 petabyte repository and filtered on down to cover 10 >> million contiguous kilometers. We did not use Maven, and I would be >> curious to see where the project is going. Now that I know about >> this I >> will try to follow it a bit more. >> >> Best of success! >> >> On Jul 5 2020 10:05 AM, Zhang Zongyu wrote: >> > Hello, >> > >> > This week I have done a lot of repetitive work. That is, to go >> > through >> > all of the ebuild files in Gentoo Repository and to get them the >> > equivalent GroupId and ArtifactId in Maven Central. There are more >> > than 500 packages in dev-java/ and java-virtual/ category, and >> > sometimes one Gentoo package may correspond to more than one Maven >> > artifact, so it took me a lot of time to complete them. And here >> is >> > my >> > lookup up table which covers all packages in dev-java/ and maps >> > "category/package:slot" into "groupId:artifactId".[1] As a result, >> > spark-core can make use of more than 100 Gentoo native packages >> now. >> > >> > Besides, I have also added java-ebuilder some features. It can >> check >> > the metadata of a package and get the correct SLOT, and it can >> make >> > ebuild unpack "Maven Central distributed source files" into proper >> > ${JAVA_SRC_DIR} now. >> > >> > Next week I am going to test and add jaxb (javax.xml.bind:jaxb-api >> > and >> > javax.xml.bind:jaxb-impl) and some newer version packages which >> are >> > required by spark-core, and I hope the newer version ebuild files >> > could be accepted by Gentoo-Java team. The prototype of the ebuild >> > files that are just generated by java-ebuilder are listed in [2]. >> > >> > Regards, >> > Zhang Zongyu >> > >> > [1] lookup table containing all packages from dev-java/ >> > >> > >> >> https://github.com/6-6-6/JEbuilder/blob/master/app-portage/java-ebuilder/files/scripts/LUT/LUT >> > [2] a prototype overlay >> > https://github.com/6-6-6/spark-overlay/tree/master/dev-java >> >> >>