[gentoo-powerpc] Re: [gentoo-dev] Introduce ppc64le architecture into gentoo ! please share your comments

[gentoo-powerpc] Re: [gentoo-dev] Introduce ppc64le architecture into gentoo ! please share your comments

[Leno Hou]

[-- Attachment #1: Type: text/plain, Size: 3258 bytes --]

On Wed, Aug 12, 2015 at 11:50 AM, Mike Frysinger <vapier@gentoo.org> wrote:

> On 11 Aug 2015 10:45, Anthony G. Basile wrote:
> > On 8/11/15 10:33 AM, Ian Stakenvicius wrote:
> > > On 11/08/15 06:11 AM, Leno Hou wrote:
> > >> I think ppc64le would become popular,
> > >> https://en.wikipedia.org/wiki/Ppc64.
> > >>
> > >> 1. enable porting x86 Linux based application with minimal effort.
> > >>   2. Some PowerPC user, little endian apparently feels cheap, wrong,
> > >> and PCish. 3. Other distrbutions like Ubuntu, Redhat and SUSE
> > >> already support little endian in powerpc.
> > >
> > > In terms of the codepaths, what's different between ppc64le vs ppc64,
> > > and ppc64le vs amd64 ?  Obviously kernels will differ, but in terms of
> > > C/C++/other compiled source code what needs to change?
> > >
> > > If all this needs is its own profile for a CHOST/CBUILD specification
> > > and it can leverage an existing keyword, then this should be rather
> > > simple to implement yes?
> >
> > We would leverage this on ppc64 keyword.  It is a bit dangerous to claim
> > that a pkg stable on ppc64 is stable on ppc64le, but we would live with
> > that risk.  Ideally you should test on both.  The situation is analogous
> > to mips where there are many different ISAs and both be and le.  It is
> > one of the reasons mips is hard to move back into stable.  But having
> > stable keywords is really nice when it comes to building and maintaining
> > stages and keeping base pkgs versions in sync with the other arches.
> > For this reason, I would even been in favor of restoring stable mips
> > with the understanding that "stable" carries something of a risk when
> > crossing the be/le boundry, or the mips I vs mips III, or 32 vs 64, etc.
>
> yes, we should just re-use the existing KEYWORDS and control the endian
> differences via profiles.  it's how other arches (mips, ppc, arm, arm64)
> are handled currently.
>
> note: people have already built Gentoo for ppc little endian, but that
> tends to only be used in embedded setups, so the builds don't get published
> like other arches as stages.

-mike
>


1.   I have successfully complied ppc64le chroot environment manually.
      General Steps that omitted modify USE flag are here.

https://docs.google.com/document/d/1zGO5Gvu4DGPX7Pn70q5vbW_uF___4h8_pIpOtoOEdnY/edit?usp=sharing

2.  How to control endian difference via profiles ? i.e.  *How to get
ppc64le as a full stage/profile along side ppc64* ?
     Could you give me in detail ?

3.  ppc64 already have stage3,  why ppc64le tends to only be used in
embedded setups ?  If embedded setups, please
     let me know any forward/ steps .
    http://distfiles.gentoo.org/releases/ppc/autobuilds/current-iso/

4.  I would like become a developer of porting gentoo on ppc64le.  Anyone
could help/mentor me to join this project ?
    https://wiki.gentoo.org/wiki/Project:PowerPC  appreciated your
assistance and help.

5.  https://wiki.gentoo.org/wiki/Porting   The Section 'Converting to
Gentoo' needs to be updated.
     From portage-2.2.20 on, please download portage and install it by
'python setup.py install'

**Most importantly, Any Ideas/steps of how to  porting gentoo on  ppc64le
architecture?**

Leno Hou
E-mail: lenohou@gmail.com

[-- Attachment #2: Type: text/html, Size: 5260 bytes --]

[gentoo-powerpc] Re: [gentoo-dev] Introduce ppc64le architecture into gentoo ! please share your comments

[Shuai Zhao]

[-- Attachment #1: Type: text/plain, Size: 372 bytes --]

2015-08-12 15:47 GMT+08:00 Mike Frysinger <vapier@gentoo.org>:

> On 12 Aug 2015 15:20, Leno Hou wrote:
> > **Most importantly, Any Ideas/steps of how to  porting gentoo on  ppc64le
> > architecture?**
>
> do you have hardware ?  then it's simply a matter of booting Gentoo in it
> and
> filing/fixing bugs :).
> -mike
>

Yeah, we has several virtual machines of PPC64le.

[-- Attachment #2: Type: text/html, Size: 785 bytes --]

Re: [gentoo-powerpc] Re: [gentoo-dev] Introduce ppc64le architecture into gentoo ! please share your comments

[Luca Barbato]

On 12/08/15 11:46, Shuai Zhao wrote:
> 2015-08-12 15:47 GMT+08:00 Mike Frysinger <vapier@gentoo.org>:
> 
>> On 12 Aug 2015 15:20, Leno Hou wrote:
>>> **Most importantly, Any Ideas/steps of how to  porting gentoo on  ppc64le
>>> architecture?**
>>
>> do you have hardware ?  then it's simply a matter of booting Gentoo in it
>> and
>> filing/fixing bugs :).
>> -mike
>>
> 
> Yeah, we has several virtual machines of PPC64le.
> 

Are they based on qemu or something completely different?

lu

[gentoo-powerpc] Re: [gentoo-dev] Introduce ppc64le architecture into gentoo ! please share your comments

[Leno Hou]

[-- Attachment #1: Type: text/plain, Size: 3467 bytes --]

On Wed, Aug 12, 2015 at 3:47 PM, Mike Frysinger <vapier@gentoo.org> wrote:

> On 12 Aug 2015 15:20, Leno Hou wrote:
> > 2.  How to control endian difference via profiles ? i.e.  *How to get
> > ppc64le as a full stage/profile along side ppc64* ?
> >      Could you give me in detail ?
>
> you probably want to create a new profile dir:
>         profiles/arch/powerpc/ppc64/little-endian/
> then add a make.defaults file with the right CHOST defaults.  as we find
> packages that have problems on little endian, that provides you a safe
> space to mask features too.
>
> then create a new target for linux users:
>
> profiles/default/linux/powerpc/ppc64/13.0/64bit-userland/little-endian/
> that'll inherit the arch/powerpc/ppc64/little-endian parent
>
> > 5.  https://wiki.gentoo.org/wiki/Porting   The Section 'Converting to
> > Gentoo' needs to be updated.
> >      From portage-2.2.20 on, please download portage and install it by
> > 'python setup.py install'
>
> you mean my bootstrap-portage script ?
>

See my comments in below mail.

>
> > **Most importantly, Any Ideas/steps of how to  porting gentoo on  ppc64le
> > architecture?**
>
> do you have hardware ?  then it's simply a matter of booting Gentoo in it
> and
> filing/fixing bugs :).
>

YES. We have KVM virtual machine of ppc64le.  Can we booting/filing/fixing
by KVM ?

> -mike
>

Greetings !~~


*What I have done according to your suggestions.*

Once you have these packages, you can easily install Portage.

root #wget http://distfiles.gentoo.org/distfiles/portage-2.2.20.tar.bz2
root #tar -xvf portage-2.2.20
root #cd portage-2.2.20 && python setup.py install



1, sync up and we should have our Portage tree!

root #emerge --sync

Then we need to create a new  profile for the new architecture  ppc64le:

root #cd /usr/portage/profiles/arch/powerpc/ppc64/ && mkdir little-endian
root #cd little-endian
root #echo '..' > parent
root #cat << EOF > make.defaults
CHOST="powerpc64le-linux-gnu"
EOF


2, create a new target for linux users:

root #cd
/usr/portage/profiles/default/linux/powerpc/ppc64/13.0/64bit-userland/
root #mkdir little-endian && cd little-endian
root #cat << EOF > parent
..
../../../../../../../arch/powerpc/ppc64/little-endian
EOF
root #cd /etc/portage
root #ln -s
../../usr/portage/profiles/default/linux/powerpc/ppc64/13.0/64bit-userland/little-endian
make.profile
root #cd /etc/portage
root #cat << EOF > make.conf
PORTDIR_OVERLAY=/usr/local/portage
MAKEOPTS="-j8"
CFLAGS="-mcpu=power8 -mtune=power8 -O2 -pipe -I/gentoo/usr/include
-L/gentoo/usr/lib64 -L/gentoo/lib -L/gentoo/lib64 -lpthread "
CXXFLAGS="${CFLAGS}"
CPPFLAGS="${CFLAGS}"
LDFLAGS="-I/gentoo/usr/include -L/gentoo/usr/lib64 -L/gentoo/lib
-L/gentoo/lib64 -lpthread "
LC_ALL="en_US.UTF-8"
FEATURES="buildpkg"
USE="python_targets_python2_7"
EOF


3, Fix Problem with sandbox

root #apt-get install pax-utils build-essential gawk
root # emerge --nodeps  --ask sandbox


4, Build the whole system

root #ROOT=/gentoo emerge @system
Results: https://bpaste.net/show/e6db5a5a70aa


           Should `ROOT=/gentoo emerge glibc`  or `ROOT=/gentoo emerge gcc`
first to fix the circle dependencies ?
           Please let me know forward/steps to port gentoo on ppc64le.

 /etc/portage/package.accept_keywords  in ppc64le and bug reports as
following links.
>=dev-libs/libffi-3.2.1 ~ppc64
>=dev-libs/gmp-6.0.0a ~ppc64

Links:
https://bugzilla.redhat.com/show_bug.cgi?id=1083429
https://github.com/ffi/ffi/issues/413

[-- Attachment #2: Type: text/html, Size: 7432 bytes --]

[gentoo-powerpc] Re: [gentoo-dev] Introduce ppc64le architecture into gentoo ! please share your comments

[Leno Hou]

[-- Attachment #1: Type: text/plain, Size: 1139 bytes --]

On Thu, Sep 24, 2015 at 11:07 PM, Mike Frysinger <vapier@gentoo.org> wrote:

> On 14 Aug 2015 15:52, Leno Hou wrote:
> > On Wed, Aug 12, 2015 at 3:47 PM, Mike Frysinger wrote:
> > > On 12 Aug 2015 15:20, Leno Hou wrote:
> > > > **Most importantly, Any Ideas/steps of how to  porting gentoo on
> ppc64le
> > > > architecture?**
> > >
> > > do you have hardware ?  then it's simply a matter of booting Gentoo in
> it
> > > and
> > > filing/fixing bugs :).
> > >
> >
> > YES. We have KVM virtual machine of ppc64le.  Can we
> booting/filing/fixing
> > by KVM ?
>
> KVM is fine.  i'm assuming you can't boot a ppc64le vm when the host is
> ppc64be ?


We can boot ppc64le by KVM on POWER7  (abbrev. PowerKVM)
and KVM on Power7 is big endian. If you have real POWER7 hardware,
you can install Ubuntu or RedHat ( integrated with KVM by default) on
POWER7.



> i don't think any Gentoo dev has access to ppc64le hardware,
> so we'd rely on ibm to fix bugs and such.
>

As above, we can boot ppc64le by KVM on POWER7. Is not mean that we can
booting/filing/fixing by KVM? If so, i'll try to get some KVM virtual
machines :-)


-mike
>

-Leno Hou

[-- Attachment #2: Type: text/html, Size: 2332 bytes --]

[gentoo-powerpc] Re: [gentoo-dev] Introduce ppc64le architecture into gentoo ! please share your comments

[Leno Hou]

[-- Attachment #1: Type: text/plain, Size: 2017 bytes --]

On Wed, Aug 12, 2015 at 4:30 PM, Anthony G. Basile <blueness@gentoo.org>
wrote:

> On 8/12/15 3:47 AM, Mike Frysinger wrote:
>
>>
>> 4.  I would like become a developer of porting gentoo on ppc64le.  Anyone
>>> could help/mentor me to join this project ?
>>>
>> ideally someone on the ppc side would pick you up, but i think they've
>> been
>> a bit of a skeleton team of late.  so if need be, i can help you here.
>>
>
> I can help out here.

See in my mail

>
>
> **Most importantly, Any Ideas/steps of how to  porting gentoo on  ppc64le
>>> architecture?**
>>>
>> do you have hardware ?  then it's simply a matter of booting Gentoo in it
>> and
>> filing/fixing bugs :).
>> -mike
>>
> We should also start building stage3s.
>
>
> --
> Anthony G. Basile, Ph.D.
> Gentoo Linux Developer [Hardened]
> E-Mail    : blueness@gentoo.org
> GnuPG FP  : 1FED FAD9 D82C 52A5 3BAB  DC79 9384 FA6E F52D 4BBA
> GnuPG ID  : F52D4BBA
>
>
>
Appreciated your efforts and comments.

1.  We've successfully compiled stage 3 for  ppc64le. The stage 3 covers
most useful functionalities:

   - GNU tool chains. e.g. automake, autoconf, gcc & glibc.
   - Normally use Portage, e.g. emerge, ebuild & python
   - Normally chroot in this stage 3.
   - Not included linux kernel & bootloader yet.

2. We believe to make Gentoo support ppc64le, we still need to compile
kernel and bootloader

   - Which version of kernel provided by Gentoo would you suggest us to use?

          As to Ubuntu, there will be many patches to make the kernel
workable, so how to patch
          our Gentoo kernel  to make it work for ppc64le?

   - Which version of grub suitable for ppc64le ?  Is there any patches to
   ppc64le grub ?

3. When the gentoo we make out workable on ppc64le, we would like to know
the process of
    making it officially supported by Gentoo community

   - For each arch, do we have a subteam to verify the packages? If so, how
   to reach these guys?
   - For hardware environment, does anyone have Power8 systems ?


-Leno Hou

[-- Attachment #2: Type: text/html, Size: 4012 bytes --]

[gentoo-powerpc] Re: [gentoo-dev] Introduce ppc64le architecture into gentoo ! please share your comments

[Leno Hou]

[-- Attachment #1: Type: text/plain, Size: 2060 bytes --]

*Leno Hou*
E-mail :  lenohou@gmail.com
Phone : 185-0093-5995

On Fri, Sep 11, 2015 at 8:01 PM, Leno Hou <lenohou@gmail.com> wrote:
>
> This is a great pleasure to announce that we've made ppc64le stage 3.
>
> 1.  We've successfully compiled stage 3 for  ppc64le. The stage 3 covers
> most useful functionalities:
>
>    - GNU tool chains. e.g. automake, autoconf, gcc & glibc.
>    - Normally use Portage, e.g. emerge, ebuild & python
>    - Normally chroot in this stage 3.
>    - Not included linux kernel & bootloader yet.
>
> 2. We believe to make Gentoo support ppc64le, we still need to compile
> kernel and bootloader
>
>    - Which version of kernel provided by Gentoo would you suggest us to
>    use?
>
>           As to Ubuntu, there will be many patches to make the kernel
> workable, so how to patch
>           our Gentoo kernel  to make it work for ppc64le?
>
>    - Which version of grub suitable for ppc64le ?  Is there any patches
>    to ppc64le grub ?
>
>           When I building grub, it happens
https://bpaste.net/show/732172bfe927 .
          CC:  grub-dev community  , could you give me a hand with ppc64le
grub ?
          Or the latest grub  merged ppc64le patches ?


> 3. When the gentoo we make out workable on ppc64le, we would like to know
> the process of
>     making it officially supported by Gentoo community
>
>    - For each arch, do we have a subteam to verify the packages? If so,
>    how to reach these guys?
>
>            ppc64le are inherit from ppc64 profile.  Is that say we should
push this portage contains ppc64le
           profile. And provides this stage 3 made by catalyst ?
          What my mean is, I known arm64 ( aarch64 ?)  was merged to
portage, Could you let me know the
          process of ppc64le as same as arm64 supported by Gentoo community
?

>
>    - For hardware environment, does anyone have Power8 systems ?
>
>           If someone have POWER8 OR POWER 7 systems,  it would be nice If
you'll  join this project.

-Leno Hou
>
E-mail: houqy@linux.vnet.ibm.com
E-mail: lenohou@gmail.com

[-- Attachment #2: Type: text/html, Size: 3990 bytes --]

[gentoo-powerpc] Re: [gentoo-dev] Introduce ppc64le architecture into gentoo ! please share your comments

[Leno Hou]

[-- Attachment #1: Type: text/plain, Size: 1400 bytes --]

On Fri, Sep 11, 2015 at 8:01 PM, Leno Hou <lenohou@gmail.com> wrote:

>
> 2. We believe to make Gentoo support ppc64le, we still need to compile
> kernel and bootloader
>
>    - Which version of kernel provided by Gentoo would you suggest us to
>    use?
>
>           As to Ubuntu, there will be many patches to make the kernel
> workable, so how to patch
>           our Gentoo kernel  to make it work for ppc64le?
>

        Upstream's 4.2.1 is OK  :-)
        I've compiled sys-kernel/gentoo-sources-4.2.1 on Ubuntu and
successfully booted  Ubuntu as following.
        root@ppc64le:~# uname -a
        Linux ppc64le 4.2.1-gentoo #1 SMP Wed Sep 23 19:28:17 PDT 2015
ppc64le ppc64le ppc64le GNU/Linux


>    - Which version of grub suitable for ppc64le ?  Is there any patches
>    to ppc64le grub ?
>
> 3. When the gentoo we make out workable on ppc64le, we would like to know
> the process of
>     making it officially supported by Gentoo community
>
>    - For each arch, do we have a subteam to verify the packages? If so,
>    how to reach these guys?
>    - For hardware environment, does anyone have Power8 systems ?
>
>          Again, please apply POWER8 Systems and join our work  :-)
         [1]: https://www.runabove.com/instances/ibm-power8.xml
         [2]: https://ptopenlab.com/cloudlabconsole/#/
         [3]: http://osuosl.org/services/powerdev/request_hosting


> -Leno Hou
>

[-- Attachment #2: Type: text/html, Size: 3367 bytes --]

Re: [gentoo-powerpc] Re: [gentoo-dev] Introduce ppc64le architecture into gentoo ! please share your comments

[Konstantin Tokarev]

24.09.2015, 15:24, "Leno Hou" <lenohou@gmail.com>:
> On Fri, Sep 11, 2015 at 8:01 PM, Leno Hou <lenohou@gmail.com> wrote:
>> 2. We believe to make Gentoo support ppc64le, we still need to compile kernel and bootloader
>>
>> * Which version of kernel provided by Gentoo would you suggest us to use?
>>           As to Ubuntu, there will be many patches to make the kernel workable, so how to patch
>>           our Gentoo kernel  to make it work for ppc64le?
>
>         Upstream's 4.2.1 is OK  :-)
>         I've compiled sys-kernel/gentoo-sources-4.2.1 on Ubuntu and successfully booted  Ubuntu as following.
>         root@ppc64le:~# uname -a
>         Linux ppc64le 4.2.1-gentoo #1 SMP Wed Sep 23 19:28:17 PDT 2015 ppc64le ppc64le ppc64le GNU/Linux
>
>> * Which version of grub suitable for ppc64le ?  Is there any patches to ppc64le grub ?
>> 3. When the gentoo we make out workable on ppc64le, we would like to know the process of
>>     making it officially supported by Gentoo community
>>
>> * For each arch, do we have a subteam to verify the packages? If so, how to reach these guys?
>> * For hardware environment, does anyone have Power8 systems ?
>          Again, please apply POWER8 Systems and join our work  :-)
>          [1]: https://www.runabove.com/instances/ibm-power8.xml
>          [2]: https://ptopenlab.com/cloudlabconsole/#/
>          [3]: http://osuosl.org/services/powerdev/request_hosting

By chance, don't you know how to buy real OpenPOWER-based hardware for affordable price?


-- 
Regards,
Konstantin

Re: [gentoo-powerpc] Re: [gentoo-dev] Introduce ppc64le architecture into gentoo ! please share your comments

[Luca Barbato]

On 24/09/15 14:23, Leno Hou wrote:
> On Fri, Sep 11, 2015 at 8:01 PM, Leno Hou <lenohou@gmail.com> wrote:
> 
>>
>> 2. We believe to make Gentoo support ppc64le, we still need to compile
>> kernel and bootloader
>>
>>    - Which version of kernel provided by Gentoo would you suggest us to
>>    use?
>>
>>           As to Ubuntu, there will be many patches to make the kernel
>> workable, so how to patch
>>           our Gentoo kernel  to make it work for ppc64le?
>>
> 
>         Upstream's 4.2.1 is OK  :-)
>         I've compiled sys-kernel/gentoo-sources-4.2.1 on Ubuntu and
> successfully booted  Ubuntu as following.
>         root@ppc64le:~# uname -a
>         Linux ppc64le 4.2.1-gentoo #1 SMP Wed Sep 23 19:28:17 PDT 2015
> ppc64le ppc64le ppc64le GNU/Linux
> 
> 
>>    - Which version of grub suitable for ppc64le ?  Is there any patches
>>    to ppc64le grub ?
>>
>> 3. When the gentoo we make out workable on ppc64le, we would like to know
>> the process of
>>     making it officially supported by Gentoo community
>>
>>    - For each arch, do we have a subteam to verify the packages? If so,
>>    how to reach these guys?
>>    - For hardware environment, does anyone have Power8 systems ?
>>
>>          Again, please apply POWER8 Systems and join our work  :-)
>          [1]: https://www.runabove.com/instances/ibm-power8.xml
>          [2]: https://ptopenlab.com/cloudlabconsole/#/
>          [3]: http://osuosl.org/services/powerdev/request_hosting

We do not have an IBM contact (that I know) otherwise I'd love to get 3
powerdev minimal paravirt enviroments to test BE, LE and Power7.

Anybody with ties with IBM willing to help? =)

lu

[gentoo-powerpc] Re: [gentoo-dev] Introduce ppc64le architecture into gentoo ! please share your comments

[Kevin Zhao]

[-- Attachment #1: Type: text/plain, Size: 1536 bytes --]

Hi Guys， We have finish compiling stage3 for ppc64  (little-endian).Here is
the link:

https://drive.google.com/file/d/0B2k84p6709AyTFlwLUF1WjlxUk0/view?usp=sharing
 Now we are going to build LiveCD using stage3.  Could you help to give
some demo or a guide for building LiveCD? That will help we a lot to make
effort.
Thanks ~


2015-09-27 3:16 GMT+08:00 Anthony G. Basile <blueness@gentoo.org>:

> On 9/24/15 8:23 AM, Leno Hou wrote:
>
>>
>>
>>           Again, please apply POWER8 Systems and join our work  :-)
>>           [1]: https://www.runabove.com/instances/ibm-power8.xml
>>           [2]: https://ptopenlab.com/cloudlabconsole/#/
>>           [3]: http://osuosl.org/services/powerdev/request_hosting
>>
>>
>> -Leno Hou
>>>
>>>
> I have applied to osuosl for an ibm power8 ppc64le node.  I've put myself
> down as the point-of-contact.  I asked for openstack gui access and will
> try to build a system using Leno's stage3.  I'm not sure what the env looks
> like right now, but i assume i'll have to boot off a cd image.  I'll use
> debians.  I guess I could be macho and try to build everything from
> scratch, cross compile a kernel and all, but  .... time.
>
> Has anyone tried qemu simulating ppc64le on amd64?  Lu I thought you said
> you tried on x86 and it didn't work.
>
>
>
> --
> Anthony G. Basile, Ph.D.
> Gentoo Linux Developer [Hardened]
> E-Mail    : blueness@gentoo.org
> GnuPG FP  : 1FED FAD9 D82C 52A5 3BAB  DC79 9384 FA6E F52D 4BBA
> GnuPG ID  : F52D4BBA
>
>

[-- Attachment #2: Type: text/html, Size: 2778 bytes --]