From mboxrd@z Thu Jan 1 00:00:00 1970
Return-Path: <gentoo-soc+bounces-2239-garchives=archives.gentoo.org@lists.gentoo.org>
Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80])
(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
(No client certificate requested)
by finch.gentoo.org (Postfix) with ESMTPS id 1EFF0139694
for <garchives@archives.gentoo.org>; Mon, 3 Jul 2017 19:43:17 +0000 (UTC)
Received: from pigeon.gentoo.org (localhost [127.0.0.1])
by pigeon.gentoo.org (Postfix) with SMTP id B1EB723400E;
Mon, 3 Jul 2017 19:43:14 +0000 (UTC)
Received: from mail-qk0-x230.google.com (mail-qk0-x230.google.com [IPv6:2607:f8b0:400d:c09::230])
(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
(No client certificate requested)
by pigeon.gentoo.org (Postfix) with ESMTPS id 84C7A23400E
for <gentoo-soc@lists.gentoo.org>; Mon, 3 Jul 2017 19:43:14 +0000 (UTC)
Received: by mail-qk0-x230.google.com with SMTP id 16so153806253qkg.2
for <gentoo-soc@lists.gentoo.org>; Mon, 03 Jul 2017 12:43:14 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=colorado-edu.20150623.gappssmtp.com; s=20150623;
h=mime-version:reply-to:from:date:message-id:subject:to;
bh=5dagmnad54yrrDl1ONiZig3eIAr3mt+fwZBypR3mXYY=;
b=OcrHt5LSiIUk2jooVj8nNJN52wYzEz+IdRXRQR1Labojkh2kokc3HLBrVdpGL038g3
lNyMmMMihr0ODAap5Kp6qYP3aNPvTc34VsxLOTpyUHxKWMBq2qDdbBMnsu7d34INaW3l
AyQTk/iCD3t0y0o2B4Zre9Pymmsce+HjtsTH1lLk3c4Ptp3EhbM72jh1d98TS+EGv3JZ
nX5+BH3TVz2s5QrcNEMCcgZbE5aopqEkGQszMXgcl051GbYBtes7v6tbG/SPsP3xRlF3
EcrpKSqZWi31kTAKf6weleqh4I4RJ52JxA4t5ITi7fz7Dbzqqf/AadT3xaRMIyrbU57A
g1oQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=1e100.net; s=20161025;
h=x-gm-message-state:mime-version:reply-to:from:date:message-id
:subject:to;
bh=5dagmnad54yrrDl1ONiZig3eIAr3mt+fwZBypR3mXYY=;
b=PVXhc+sJtwO2u0LO07CWpqDUVHifZuaHFlXlsuIS4pUfFuPnfaDC0gi13aGScEgD7T
BKmNREYvIqr6GpuvZIQJZXDfOcbA17ZfFBm4edmBC8clZ+tclUmZzWbq797ZVY9jV1c5
aPmzlSW9855yRf02E6yF6zuw1EYUCewHvR2biMTfotIUh0J4Rn8loUqiVkd38ivYkA+c
zLZQoL4qvL1Eu7G9bCSaP6/q5djKJx5KfYP0aCXp+zO032pDkRVs1P6hTan302iILUvS
XAKYv9TJvpLEfrDZh9ya1lGhH3jkm7HS1NCn0Yccn8GBmlDhx1kZeDTxvhiHcHPsCeQc
nfug==
X-Gm-Message-State: AIVw110awPtGbdYtq/blKbIhuViJzOKi3M70Wg4wry4OneQkIzHOlJ7z
sf+n7GsHBV2GfDhiCI+7qLVTdVdyXtQi2S4=
X-Received: by 10.55.16.153 with SMTP id 25mr11481284qkq.45.1499110993612;
Mon, 03 Jul 2017 12:43:13 -0700 (PDT)
Precedence: bulk
List-Post: <mailto:gentoo-soc@lists.gentoo.org>
List-Help: <mailto:gentoo-soc+help@lists.gentoo.org>
List-Unsubscribe: <mailto:gentoo-soc+unsubscribe@lists.gentoo.org>
List-Subscribe: <mailto:gentoo-soc+subscribe@lists.gentoo.org>
List-Id: Gentoo Linux mail <gentoo-soc.gentoo.org>
X-BeenThere: gentoo-soc@lists.gentoo.org
Reply-to: gentoo-soc@lists.gentoo.org
MIME-Version: 1.0
Received: by 10.12.208.235 with HTTP; Mon, 3 Jul 2017 12:43:13 -0700 (PDT)
From: Michael Gilroy <Michael.Gilroy@colorado.edu>
Date: Mon, 3 Jul 2017 13:43:13 -0600
Message-ID: <CAHsHdL-vuVViHCjW5X7XVS8Z6PgyvNiwvNOHLK+nYGD43TNFhg@mail.gmail.com>
Subject: [gentoo-soc] Weekly Report: MPI Overlay, Week 5
To: gentoo-soc@lists.gentoo.org
Content-Type: multipart/alternative; boundary="001a11459ec440e67c05536efae0"
X-Archives-Salt: 05d101f5-f667-4800-8dd4-0a7eb47e2c28
X-Archives-Hash: e22cf6fef188966d637650b3f9389c4c
--001a11459ec440e67c05536efae0
Content-Type: text/plain; charset="UTF-8"
Hi all,
*Summary:*
Last week's plans:
1) Loop over commands in the build process for multiple implementations.
2) Add more mpi implementation's versions to the overlay, testing with
mpi-providers
3) Adjust libraries/binaries installations globally. This will later be for
mpi-dependent things only
I have split this work into two different versions- one which emulates
multibuild and one which exports src_* in a more normal fashion. I did this
considering multibuild is more complex to fully understand, and that it may
be a better course of action to start with a more normal src_* procedure,
then add multibuild functionality as needed.
Next week's plan:
1) Successfully export src_* and test with mpich.
2) Continue testing against mpi-providers and adding more versions of
openmpi and mpich to the overlay.
3) Continue adding to wiki/README as functionality is added. Will talk to
mentors about other means of documentation as well.
*Day-by-day breakdown:*
*Monday's Goals:*
Complete loop to repeat commands per selected implementation.
Work in progress. Currently using a multibuild-like system, needs further
testing with mpi implementations.
Implement src_* per abi, per mpi implementation.
Further discussion needed. The main question here- how will users be
interacting with this eclass? I was thinking something along the lines of
${implementation}_foreach_version to find the correct range of versions
that need to be installed. Perhaps this could be its own function that acts
globally among all implementations, and pulls the existing Portage tree
versions to find ones that need to be installed. I'll bring this up in the
IRC.
*Tuesday's Goals:*
I will be taking the most of the day off due to an upcoming data science
exam on Wednesday. Work will continue on Wednesday as normal, with hours
shifted to reach over 35 hours for the week. However, I will likely be
asking questions in the IRC. I mainly want to clarify design tomorrow.
*Wednesday's Goals:*
Fix everything that is currently broken in the overlay. Repoman among other
things. Get master to a stable testing point again.
Complete. I am still investigating the "partial QA payment" warnings, and
still need to look into fortran uses in different gcc versions.
Improvements were made to the point where testing can continue.
Mail about mpi-select design. Make revisions and additions accordingly.
Awaiting response. I was intending on sending this much earlier than I did
because I ended up working much later than intended.
Add to wiki.
Work in progress. I updated it to match the README, which is minimal. Next
steps are to add instructions/guidance using proper wiki formatting.
*Thursday's Goals:*
Test new eclass with different versions of different implementations (i.e.
multilib vs. no multilib, fortran vs. no fortran, etc.)
Work in progress. With such varied testing there are still many errors to
be fixed. These will be apart of tomorrow's work.
Ask more questions regarding 2nd eclass as needed. Add to eclass based on
design responses.
Completed, again rather late. I hope to continue this dialogue more in our
weekly meeting. The current dialogue has been very helpful- it has given me
a lot more to research today.
Update wiki to use better formatting to better explain things (i.e. code
blocks)
Incomplete. As we are discussing new ways of doing things and clarifying
design choices, I thought it would be best to postpone the wiki overhaul
until more resolutions have been agreed upon. I'm planning on getting
enough info to overhaul the wiki tomorrow.
*Friday's Goals:*
Further clarify user-end execution in IRC chat. Modify eclass to properly
support make.conf MPI_TARGETS editing as needed.
Incomplete. I failed to set up a meeting. I will try to do this earlier, as
I know differing time zones make things less convenient. My Thursdays and
Fridays are preferable for meetings, as I do not have to leave for class
these days.
Test & edit mpi-select to the point where it is more stable for various
openmpi and mpich versions. Add any working versions to the overlay.
Complete. Worth noting- I have been testing against mpi-providers rather
than mpi-select. mdpi-select needs to have more functionality in order to
warrant bringing something else into the overlay from a successful test.
Finally overhaul the wiki based on current discussions :)
Complete. Will be adding to this as time moves on, of course.
Thanks,
Michael
--001a11459ec440e67c05536efae0
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
<div dir=3D"ltr"><div>Hi all,</div><div><br></div><div><b>Summary:</b></div=
><div><br></div>Last week's plans:<div><div style=3D"font-size:12.8px">=
1) Loop over commands in the build process for multiple implementations.</d=
iv><div style=3D"font-size:12.8px">2) Add more mpi implementation's ver=
sions to the overlay, testing with mpi-providers</div><div style=3D"font-si=
ze:12.8px">3) Adjust libraries/binaries installations globally. This will l=
ater be for mpi-dependent things only</div></div><div style=3D"font-size:12=
.8px"><br></div><div style=3D"font-size:12.8px">I have split this work into=
two different versions- one which emulates multibuild and one which export=
s src_* in a more normal fashion. I did this considering multibuild is more=
complex to fully understand, and that it may be a better course of action =
to start with a more normal src_* procedure, then add multibuild functional=
ity as needed.</div><div style=3D"font-size:12.8px"><br></div><div style=3D=
"font-size:12.8px">Next week's plan:</div><div style=3D"font-size:12.8p=
x">1) Successfully export src_* and test with mpich.</div><div style=3D"fon=
t-size:12.8px">2) Continue testing against mpi-providers and adding more ve=
rsions of openmpi and mpich to the overlay.</div><div style=3D"font-size:12=
.8px">3) Continue adding to wiki/README as functionality is added. Will tal=
k to mentors about other means of documentation as well.</div><div style=3D=
"font-size:12.8px"><b><br></b></div><div style=3D"font-size:12.8px"><b>Day-=
by-day breakdown:</b></div><div style=3D"font-size:12.8px"><b><br></b></div=
><div><div style=3D"font-size:12.8px"><div style=3D"font-size:12.8px"><b><f=
ont color=3D"#000000">Monday's Goals:</font></b></div><blockquote style=
=3D"font-size:12.8px;margin:0px 0px 0px 40px;border:none;padding:0px"><font=
color=3D"#4c1130">Complete loop to repeat commands per selected implementa=
tion.</font><br><font color=3D"#000000">Work in progress. Currently using a=
multibuild-like system, needs further testing with mpi implementations.</f=
ont><br><br></blockquote></div><blockquote style=3D"font-size:12.8px;margin=
:0px 0px 0px 40px;border:none;padding:0px"><font color=3D"#4c1130">Implemen=
t src_* per abi, per mpi implementation.</font></blockquote><blockquote sty=
le=3D"font-size:12.8px;margin:0px 0px 0px 40px;border:none;padding:0px"><fo=
nt color=3D"#000000">Further discussion needed. The main question here- how=
will users be interacting with this eclass? I was thinking something along=
the lines of ${implementation}_foreach_<wbr>version to find the correct ra=
nge of versions that need to be installed. Perhaps this could be its own fu=
nction that acts globally among all implementations, and pulls the existing=
Portage tree versions to find ones that need to be installed. I'll bri=
ng this up in the IRC.</font></blockquote><div style=3D"font-size:12.8px"><=
br></div></div><div><font color=3D"#000000"><br></font></div><div><div styl=
e=3D"font-size:12.8px"><div style=3D"font-size:12.8px"><font color=3D"#0000=
00"><b>Tuesday's Goals:</b></font></div><blockquote style=3D"font-size:=
12.8px;margin:0px 0px 0px 40px;border:none;padding:0px"><font color=3D"#000=
000">I will be taking the most of the day off due to an upcoming data scien=
ce exam on Wednesday. Work will continue on Wednesday as normal, with hours=
shifted to reach over 35 hours for the week. However, I will likely be ask=
ing questions in the IRC. I mainly want to clarify design tomorrow.</font><=
/blockquote></div><div style=3D"font-size:12.8px"><br></div></div><div><div=
style=3D"font-size:12.8px"><b>Wednesday's Goals:</b></div><blockquote =
style=3D"font-size:12.8px;margin:0px 0px 0px 40px;border:none;padding:0px">=
<font color=3D"#4c1130">Fix everything that is currently broken in the over=
lay. Repoman among other things. Get master to a stable testing point again=
.</font><br><font color=3D"#000000">Complete. I am still investigating the =
"partial QA payment" warnings, and still need to look into fortra=
n uses in different gcc versions. Improvements were made to the point where=
testing can continue.</font><br><br><font color=3D"#4c1130">Mail about mpi=
-select design. Make revisions and additions accordingly.</font><br><font c=
olor=3D"#000000">Awaiting response. I was intending on sending this much ea=
rlier than I did because I ended up working much later than intended.</font=
><br><br><font color=3D"#4c1130">Add to wiki.</font></blockquote><blockquot=
e style=3D"font-size:12.8px;margin:0px 0px 0px 40px;border:none;padding:0px=
"><font color=3D"#000000">Work in progress. I updated it to match the READM=
E, which is minimal. Next steps are to add instructions/guidance using prop=
er wiki formatting.</font></blockquote></div><div><font color=3D"#000000"><=
br></font></div><div><div style=3D"font-size:12.8px"><div style=3D"font-siz=
e:12.8px"><font color=3D"#000000"><b><br class=3D"gmail-Apple-interchange-n=
ewline">Thursday's Goals:</b></font></div></div><blockquote style=3D"fo=
nt-size:12.8px;margin:0px 0px 0px 40px;border:none;padding:0px"><span style=
=3D"color:rgb(76,17,48);font-size:12.8px">Test new eclass with different ve=
rsions of different implementations (i.e. multilib vs. no multilib, fortran=
vs. no fortran, etc.)</span></blockquote><blockquote style=3D"font-size:12=
.8px;margin:0px 0px 0px 40px;border:none;padding:0px"><font color=3D"#00000=
0">Work in progress. With such varied testing there are still many errors t=
o be fixed. These will be apart of tomorrow's work.</font></blockquote>=
<blockquote style=3D"font-size:12.8px;margin:0px 0px 0px 40px;border:none;p=
adding:0px"><div><font color=3D"#4c1130"><br></font></div><div><span style=
=3D"color:rgb(76,17,48);font-size:12.8px">Ask more questions regarding 2nd =
eclass as needed. Add to eclass based on design responses.</span></div></bl=
ockquote><blockquote style=3D"font-size:12.8px;margin:0px 0px 0px 40px;bord=
er:none;padding:0px"><font color=3D"#000000">Completed, again rather late. =
I hope to continue this dialogue more in our weekly meeting. The current di=
alogue has been very helpful- it has given me a lot more to research today.=
</font></blockquote><blockquote style=3D"font-size:12.8px;margin:0px 0px 0p=
x 40px;border:none;padding:0px"><div><font color=3D"#4c1130"><br></font></d=
iv><div><font color=3D"#4c1130">Update wiki to use better formatting to bet=
ter explain things (i.e. code blocks)</font></div></blockquote><div style=
=3D"font-size:12.8px"><blockquote style=3D"font-size:12.8px;margin:0px 0px =
0px 40px;border:none;padding:0px"></blockquote><blockquote style=3D"font-si=
ze:12.8px;margin:0px 0px 0px 40px;border:none;padding:0px"></blockquote><bl=
ockquote style=3D"font-size:12.8px;margin:0px 0px 0px 40px;border:none;padd=
ing:0px"></blockquote></div><blockquote style=3D"font-size:12.8px;margin:0p=
x 0px 0px 40px;border:none;padding:0px"><font color=3D"#000000">Incomplete.=
As we are discussing new ways of doing things and clarifying design choice=
s, I thought it would be best to postpone the wiki overhaul until more reso=
lutions have been agreed upon. I'm planning on getting enough info to o=
verhaul the wiki tomorrow.</font></blockquote></div><div><font color=3D"#00=
0000"><br></font></div><div><div style=3D"font-size:12.8px"><div style=3D"f=
ont-size:12.8px"><font color=3D"#000000"><b>Friday's Goals:</b></font><=
/div><blockquote style=3D"font-size:12.8px;margin:0px 0px 0px 40px;border:n=
one;padding:0px"><font color=3D"#4c1130">Further clarify user-end execution=
in IRC chat. Modify eclass to properly support make.conf MPI_TARGETS editi=
ng as needed.</font><br><font color=3D"#000000">Incomplete. I failed to set=
up a meeting. I will try to do this earlier, as I know differing time zone=
s make things less convenient. My Thursdays and Fridays are preferable for =
meetings, as I do not have to leave for class these days.</font><br><br><fo=
nt color=3D"#4c1130">Test & edit mpi-select to the point where it is mo=
re stable for various openmpi and mpich versions. Add any working versions =
to the overlay.</font><br>Complete. Worth noting- I have been testing again=
st mpi-providers rather than mpi-select. mdpi-select needs to have more fun=
ctionality in order to warrant bringing something else into the overlay fro=
m a successful test.<br><br><font color=3D"#4c1130">Finally overhaul the wi=
ki based on current discussions :)</font><br><font color=3D"#000000">Comple=
te. Will be adding to this as time moves on, of course.</font></blockquote>=
<div><font color=3D"#000000"><br></font></div><div><font color=3D"#000000">=
<br></font></div><div><font color=3D"#000000">Thanks,</font></div><div><fon=
t color=3D"#000000">Michael</font></div></div></div><div><font color=3D"#00=
0000"><br></font></div></div>
--001a11459ec440e67c05536efae0--