From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by finch.gentoo.org (Postfix) with ESMTPS id 351B113933E for ; Tue, 20 Jul 2021 17:39:21 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 36377E09EC; Tue, 20 Jul 2021 17:39:20 +0000 (UTC) Received: from NAM12-MW2-obe.outbound.protection.outlook.com (mail-mw2nam12olkn2035.outbound.protection.outlook.com [40.92.23.35]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id 62346E09EC for ; Tue, 20 Jul 2021 17:39:19 +0000 (UTC) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=UmAYnwtImhIjvxd0IPkxkNeL6gFDuRL8Ja0r/dvaz+EiA61LA5k1Z7cVjOIENpG+E8gJR1M2TUXXY4lmXoxistLSffyix9tvSqlVKKKGq3Y7Of2CYFYvHdVgpgAoFs1xGuJNbgJ0Qu7cnpBzTrshmmBSbZ7uzt4XIeT8tv7ZVET1CaIAtHbnfNeyouIFwH9YlHbSQfinWLLTvfjuk+o/hQCyE3gnMp4NFufxcZgdoCVjmaU3/WLmnrG+Cc8YVzZcbJbpESxV65Jn5oDJQb9QQ8tcMKXbDf11w2a7rOL+AYyeWBmTvm3ujBrhrwzl+iLyUpbyPrf2exhH2uD9ItwXdA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=6zGnCewu29ew6wTbFRzs5zfizZnk402nXCnafZXR+Ps=; b=Tl154cJ1bETmGE76HunJWa84AAGhBu9cqU3hDdz5m9R78oGzFD0Pf4J+ZKQNIQ8yhBwopneinkbUT8dv9Bj2Agc7xzMGS3W5fAi1InvekSyR7LGSntHyC/5DOYSrNz+Et+bAHNY4A5WupLF2eL45OUh/t2HVH+HczAsYeZ6GuIGZxapXKprxeDDstv1TKv/hvDVbSrsolylW8pp2xnx4g0qReUix1UT0/KlkeYs9RXGITH5Lkv/ZmG5ttW8UNX/Wjqd+/xthhlCrfKOa+XYlw11ncuFYbWUUFhrcbBrHzHU/zjqpbwnLs/f4XlDGvXcvOU7CYEFeC3iepfMDkch5fg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=none; dmarc=none; dkim=none; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hotmail.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=6zGnCewu29ew6wTbFRzs5zfizZnk402nXCnafZXR+Ps=; b=XWwK4l4KPNu0wCKbQHXI+Lxj0x4ohnN9Bvl4cdfDCt4WokKVUNiDAWtYVo+SrNBBPp0+7Wbv1Mb2PFDVQwlWhafGKe2bZoXoiUZcEV7YzNKmrcdtUsVJtwz2wWjW9axk20cb6qxR3AWAsh6tCR9wNyEy8pdqJ2K+iJifKtNQc7tGHTSiMKH6KecxPChhNtYHQsTemFkcb54Hq1xc7cAwkC4wxSjGqO/TW/bbvcrHGbe3KENxonN8FAHFOXDpXQ2bO3C1HK3URlsiKNKXFrrM00Ra2Cu/DLj+ijjz6uVH7qQzU9FaOeiuOhDYJwpvuQoGuyqv7SHFiMlbJM2eymkFJA== Received: from BN8NAM12FT040.eop-nam12.prod.protection.outlook.com (2a01:111:e400:fc66::49) by BN8NAM12HT007.eop-nam12.prod.protection.outlook.com (2a01:111:e400:fc66::195) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4352.9; Tue, 20 Jul 2021 17:39:17 +0000 Received: from DM6PR07MB4156.namprd07.prod.outlook.com (2a01:111:e400:fc66::40) by BN8NAM12FT040.mail.protection.outlook.com (2a01:111:e400:fc66::129) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4352.9 via Frontend Transport; Tue, 20 Jul 2021 17:39:17 +0000 X-IncomingTopHeaderMarker: OriginalChecksum:37C3A99390C13C1A1FD66DCF0F20581EB8D75BC556D07EA52A407052CC742191;UpperCasedChecksum:F424CE1F54B7F6F135A281DB5F61428A826A5F6279069D9E4D48FD436F8FD071;SizeAsReceived:8798;Count:47 Received: from DM6PR07MB4156.namprd07.prod.outlook.com ([fe80::d473:4bc7:f4ae:f699]) by DM6PR07MB4156.namprd07.prod.outlook.com ([fe80::d473:4bc7:f4ae:f699%5]) with mapi id 15.20.4331.034; Tue, 20 Jul 2021 17:39:17 +0000 Subject: Re: [gentoo-soc] Week 6 Report for Big Data Infrastructure and H2O ebuilds Project To: gentoo-soc@lists.gentoo.org References: From: A Schenck Message-ID: Date: Tue, 20 Jul 2021 10:39:09 -0700 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.12.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit Content-Language: en-US X-TMN: [8r3PAg+jPAfUinbwHGI2DGZjgAgVHl+yWSSQZOZ2c33j9FRIOQjknFSPZt8eGkGu] X-ClientProxiedBy: BYAPR07CA0029.namprd07.prod.outlook.com (2603:10b6:a02:bc::42) To DM6PR07MB4156.namprd07.prod.outlook.com (2603:10b6:5:c9::16) X-Microsoft-Original-Message-ID: <10c2f52e-80fb-f1e5-cbc4-dc6abbf87cff@hotmail.com> Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-soc@lists.gentoo.org Reply-to: gentoo-soc@lists.gentoo.org X-Auto-Response-Suppress: DR, RN, NRN, OOF, AutoReply MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 Received: from [IPv6:2607:f598:b69c:f5:cfe2:5fc4:d931:f3a6] (2607:f598:b69c:f5:cfe2:5fc4:d931:f3a6) by BYAPR07CA0029.namprd07.prod.outlook.com (2603:10b6:a02:bc::42) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4331.22 via Frontend Transport; Tue, 20 Jul 2021 17:39:16 +0000 X-MS-PublicTrafficType: Email X-IncomingHeaderCount: 47 X-EOPAttributedMessage: 0 X-MS-Office365-Filtering-Correlation-Id: d3d4f666-9875-4006-a9e1-08d94ba54c1c X-MS-TrafficTypeDiagnostic: BN8NAM12HT007: X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: zwx6+Vs6wFrtfrCI8V0M8BaOUs1HWf9H1lZxBEiHWXhTmxfZg6XlTNhbbiDW37Braaid7eQITG4LmCRtp/EuW/PUO/sM6qzpDJhgiwtTEhjPH4OidTsmH05pi1BqcEkhh0qcedEDqtW+eZda98ZilFu7wWfuCZaPJ8C/9c0u6PPTPeCJNAgZURWHP7/GUzAEzC/h9VQaPpDz5m1FnRIpopEWcSe0ZcQCXdLJ4kSIJkprT/TFoXksouNiPyz0ac98ofYmXEife1oxGAUI1x/3nETn6ebPA9PC6AI7pqgmxEiFHrEpHrIRozCUw1kw3llmFLWGsTm0dVjDYymFSKLXHNsvIE9Ot0vS96xBmIAByNXoBoOqYPlGMZsMlfiqRVZkYow42SgXdzpbASSfA+3A/CbfjfhBtjIAD0PkwwwRWsU+oa+CKEie6f0XLxtzm8g92AngByTWavMvSyKkEEnZ1wH6qL25ZBHba+O5uzEEgjA= X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: eY7HyshJjcDMnxOkW4M4QCQqrINzROZno2AhYG6PGyt0ZgjDbTlnBnh+O4kz8Q4mUzBF/J2w+nJKSTEd4wy1QPTPNecs7Mcp9FZK+/ik+nXFsSrdIzUrwcsOJ6nlbQxugptYKYgZHNzvVSZQzhI4o9FEzC0ds9qI7Gig+tCEPqE437dvX8q5RffQskIPDm4l+kuAZJ4rb2JJ8XoKXe0ZUw== X-OriginatorOrg: hotmail.com X-MS-Exchange-CrossTenant-Network-Message-Id: d3d4f666-9875-4006-a9e1-08d94ba54c1c X-MS-Exchange-CrossTenant-OriginalArrivalTime: 20 Jul 2021 17:39:17.3386 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 84df9e7f-e9f6-40af-b435-aaaaaaaaaaaa X-MS-Exchange-CrossTenant-AuthSource: BN8NAM12FT040.eop-nam12.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: Internet X-MS-Exchange-CrossTenant-RMS-PersistedConsumerOrg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN8NAM12HT007 X-Archives-Salt: 0fe70ced-7bd2-4e28-85f6-43ed8b7d65b4 X-Archives-Hash: bfacf633c33dfa75f7575274ee954987 On 7/18/21 10:52 PM, Yuan Liao (Leo) wrote: > Hi folks, > > > > As per my original project proposal, I am also adding a test case for > the ebuild installation tests which will ensure every package in the > Spark overlay can be installed at least once. Adding every package to > the emerge command theoretically works, but the command would be too > long. Invoking emerge separately for each package would resolve this > problem, but the overhead of emerge's dependency calculation would > seriously impact the test runtime. I came up with a solution that > could address both issues: write a script to compute a list of leaf > packages in the Spark overlay and pass the packages in the list to > emerge, so every package in the overlay would be installed, and the > emerge command can be simplified to have a shorter length too. The > script can also act as a helpful tool for any ebuild repository's > maintainers to find out all leaf packages in the repository for > maintenance tasks like last-rite and package clean-up. After some > initial optimization and tuning, the script (written in Python) can > compute a list of leaf packages among about 500 packages in the Spark > overlay within only a few minutes. The optimization and tuning is > also the topic for this week's blog post of mine [1]. This post > covers some knowledge and topics from computer science, including > graph theory, graph algorithms, data structure, and time complexity. > If you are interested in any of those subjects, make sure you don't > miss it! Thanks!  We actually don't really care much about Java (haven't used it seriously since College), and haven't even been involved in Gentoo GSoC in a decade, but we're glad we stay on this list for things like this.  It's really nice seeing someone who still has that spark of interest in computer things.  We do happen to like graph theory and network analysis and time complexity and such, but haven't really been able to apply it in "the real world" of tech companies.  Every time we try to do things "the right way" with real computer science, coworkers and bosses just say "just hack something together". Oh well, thanks for what you're doing, -A > > > > This concludes my work during the past week and this report. Thank > you for reading it (and my blog post in case you are checking it out)! > > Best regards, > Leo > > [1]: https://leo3418.github.io/2021/07/18/find-leaf-packages.html > [2]: https://wiki.gentoo.org/wiki/User:Leo3418/Kotlin/Package_Maintainer_Guide >