[gentoo-user] "Headless question": Harvesting the results...software needed.

[gentoo-user] "Headless question": Harvesting the results...software needed.

[meino.cramer]

Hi,

with lot of help of this forum (***TAHNKS!***) I now
have a embedded device which is able to
dis/connect itsself from/to the LAN, set the clock via ntp-client
and is able to fire up a tool, which collects
data from sensors and put those into
a file ... even if the tool has no
connection to a terminal.

Next step will be to connect a GPS module
(ordered) to the GPIO pins of that board
(which is quite offtopic and I fear therefore
my sole problem... ;).

Suppose the GPS would already be attached
to the board and works...

Is there any free available software and data for
strict offline useage (which does NOT calls
to home), which is able to map GPS data to a street/land
map?
I need both: The maps themselves and the logic to read
GPS coordinates and map movements and ways to those maps.

Is something like that available for free or should
I directly ask the NSA/CIA/FBI/...?

Thank you very much in advance for any help!
Best regards,
mcc

Re: [gentoo-user] "Headless question": Harvesting the results...software needed.

[Alec Ten Harmsel]

On 09/30/2014 10:05 AM, meino.cramer@gmx.de wrote:
> Suppose the GPS would already be attached
> to the board and works...
>
> Is there any free available software and data for
> strict offline useage (which does NOT calls
> to home), which is able to map GPS data to a street/land
> map?
> I need both: The maps themselves and the logic to read
> GPS coordinates and map movements and ways to those maps.
>
> Is something like that available for free or should
> I directly ask the NSA/CIA/FBI/...?
>
> Thank you very much in advance for any help!
> Best regards,
> mcc
>
The only project I know of that has openly available map data is
OpenStreetMap (openstreetmap.org). I know they have an API, and they
probably (not sure) have maps available for download.

afaik the only way to combine various map data out of the box is to use
a GIS package like QGIS. You can write software to do this using the
proj4 library for an embedded box, not sure if anything for your
specific use case already exists and is open source.

Alec

Re: [gentoo-user] "Headless question": Harvesting the results...software needed.

[Matti Nykyri]

On Sep 30, 2014, at 17:12, Alec Ten Harmsel <alec@alectenharmsel.com> wrote:
> 
> 
>> On 09/30/2014 10:05 AM, meino.cramer@gmx.de wrote:
>> Suppose the GPS would already be attached
>> to the board and works...
>> 
>> Is there any free available software and data for
>> strict offline useage (which does NOT calls
>> to home), which is able to map GPS data to a street/land
>> map?
>> I need both: The maps themselves and the logic to read
>> GPS coordinates and map movements and ways to those maps.
>> 
>> Is something like that available for free or should
>> I directly ask the NSA/CIA/FBI/...?
>> 
>> Thank you very much in advance for any help!
>> Best regards,
>> mcc
> The only project I know of that has openly available map data is
> OpenStreetMap (openstreetmap.org). I know they have an API, and they
> probably (not sure) have maps available for download.
> 
> afaik the only way to combine various map data out of the box is to use
> a GIS package like QGIS. You can write software to do this using the
> proj4 library for an embedded box, not sure if anything for your
> specific use case already exists and is open source.
> 
> Alec
> 

Re: [gentoo-user] "Headless question": Harvesting the results...software needed.

[J. Roeleveld]

On 30 September 2014 16:12:31 CEST, Alec Ten Harmsel <alec@alectenharmsel.com> wrote:
>
>On 09/30/2014 10:05 AM, meino.cramer@gmx.de wrote:
>> Suppose the GPS would already be attached
>> to the board and works...
>>
>> Is there any free available software and data for
>> strict offline useage (which does NOT calls
>> to home), which is able to map GPS data to a street/land
>> map?
>> I need both: The maps themselves and the logic to read
>> GPS coordinates and map movements and ways to those maps.
>>
>> Is something like that available for free or should
>> I directly ask the NSA/CIA/FBI/...?
>>
>> Thank you very much in advance for any help!
>> Best regards,
>> mcc
>>
>The only project I know of that has openly available map data is
>OpenStreetMap (openstreetmap.org). I know they have an API, and they
>probably (not sure) have maps available for download.
>
>afaik the only way to combine various map data out of the box is to use
>a GIS package like QGIS. You can write software to do this using the
>proj4 library for an embedded box, not sure if anything for your
>specific use case already exists and is open source.
>
>Alec

Openstreetmap is a good bet.

You might also have some luck if you look into PostGIS.
It is an extension to postgresql, which might be overkill, but you might be able to use that in yiur Google searches.

If borders would be nice and straight, it would be easy. Unfortunately they are not.

--
Joost
-- 
Sent from my Android device with K-9 Mail. Please excuse my brevity.

Re: [gentoo-user] "Headless question": Harvesting the results...software needed.

[Matti Nykyri]

> On Sep 30, 2014, at 20:36, "J. Roeleveld" <joost@antarean.org> wrote:

> 
>> On 30 September 2014 16:12:31 CEST, Alec Ten Harmsel <alec@alectenharmsel.com> wrote:
>> 
>>> On 09/30/2014 10:05 AM, meino.cramer@gmx.de wrote:
>>> Suppose the GPS would already be attached
>>> to the board and works...
>>> 
>>> Is there any free available software and data for
>>> strict offline useage (which does NOT calls
>>> to home), which is able to map GPS data to a street/land
>>> map?
>>> I need both: The maps themselves and the logic to read
>>> GPS coordinates and map movements and ways to those maps.
>>> 
>>> Is something like that available for free or should
>>> I directly ask the NSA/CIA/FBI/...?
>>> 
>>> Thank you very much in advance for any help!
>>> Best regards,
>>> mcc
>> The only project I know of that has openly available map data is
>> OpenStreetMap (openstreetmap.org). I know they have an API, and they
>> probably (not sure) have maps available for download.
>> 
>> afaik the only way to combine various map data out of the box is to use
>> a GIS package like QGIS. You can write software to do this using the
>> proj4 library for an embedded box, not sure if anything for your
>> specific use case already exists and is open source.
>> 
>> Alec
> 
> Openstreetmap is a good bet.
> 
> You might also have some luck if you look into PostGIS.
> It is an extension to postgresql, which might be overkill, but you might be able to use that in yiur Google searches.
> 
> If borders would be nice and straight, it would be easy. Unfortunately they are not.

Yes. For example the land border of Finland is around 2000 km long and only it contains 52000 coordinates ;)

-- 
-Matti

Re: [gentoo-user] "Headless question": Harvesting the results...software needed.

[meino.cramer]

J. Roeleveld <joost@antarean.org> [14-09-30 19:40]:
> On 30 September 2014 16:12:31 CEST, Alec Ten Harmsel <alec@alectenharmsel.com> wrote:
> >
> >On 09/30/2014 10:05 AM, meino.cramer@gmx.de wrote:
> >> Suppose the GPS would already be attached
> >> to the board and works...
> >>
> >> Is there any free available software and data for
> >> strict offline useage (which does NOT calls
> >> to home), which is able to map GPS data to a street/land
> >> map?
> >> I need both: The maps themselves and the logic to read
> >> GPS coordinates and map movements and ways to those maps.
> >>
> >> Is something like that available for free or should
> >> I directly ask the NSA/CIA/FBI/...?
> >>
> >> Thank you very much in advance for any help!
> >> Best regards,
> >> mcc
> >>
> >The only project I know of that has openly available map data is
> >OpenStreetMap (openstreetmap.org). I know they have an API, and they
> >probably (not sure) have maps available for download.
> >
> >afaik the only way to combine various map data out of the box is to use
> >a GIS package like QGIS. You can write software to do this using the
> >proj4 library for an embedded box, not sure if anything for your
> >specific use case already exists and is open source.
> >
> >Alec
> 
> Openstreetmap is a good bet.
> 
> You might also have some luck if you look into PostGIS.
> It is an extension to postgresql, which might be overkill, but you might be able to use that in yiur Google searches.
> 
> If borders would be nice and straight, it would be easy. Unfortunately they are not.
> 
> --
> Joost
> -- 
> Sent from my Android device with K-9 Mail. Please excuse my brevity.
> 

...its a damn long way...of waiting, though...;)

I am currently downloading the data (Only Europe)...this will be a
journey of two days uninterrupted waiting.

And -- if murphy will be good to me -- only one file (there are two of
them) is the wrong one and has to replaced by another 20GByte file
lateron.

Will see....

Next in this cinema: "The incredible download from Mars -- Episode II: The revenge of the forgotten bytes"
;)

Best regards,
mcc

Re: [gentoo-user] "Headless question": Harvesting the results...software needed.

[Matti Nykyri]

> On Sep 30, 2014, at 17:12, Alec Ten Harmsel <alec@alectenharmsel.com> wrote:

> 
> 
>> On 09/30/2014 10:05 AM, meino.cramer@gmx.de wrote:
>> Suppose the GPS would already be attached
>> to the board and works...
>> 
>> Is there any free available software and data for
>> strict offline useage (which does NOT calls
>> to home), which is able to map GPS data to a street/land
>> map?
>> I need both: The maps themselves and the logic to read
>> GPS coordinates and map movements and ways to those maps.
>> 
>> Is something like that available for free or should
>> I directly ask the NSA/CIA/FBI/...?
>> 
>> Thank you very much in advance for any help!
>> Best regards,
>> mcc
> The only project I know of that has openly available map data is
> OpenStreetMap (openstreetmap.org). I know they have an API, and they
> probably (not sure) have maps available for download.
> 
> afaik the only way to combine various map data out of the box is to use
> a GIS package like QGIS. You can write software to do this using the
> proj4 library for an embedded box, not sure if anything for your
> specific use case already exists and is open source.
> 
> Alec

Sorry iphone send mail even if you don't wanna :/

What you are considering doing is quite a challenge. What kind of coordinates does your gps module give you? The gps system works with cartesian x y z coordinates. Then these are usually displayed to the user in WGS-84. This is a quite hard mathematical problem (differential elliptical problem). Usually is done by your gps receiver and is approximated. GIS libraries have these functions built inside. Distances are easier and faster to calculate in cartesian coordinates. You need to calculate distance because coordinates from gps will never coincide with any address.

Open street maps provides a very good start, but addresses have great differences in different countries. For example google misses addresses quite much depending on where you are searching. Getting the address right requires good locality from the program. Addresses and roads are vector maps. The fastest way to get address is to have the vector map of the world and then calculate distance to the closest address. The database will be huge :)

Maps are usually raster pictures which have some projection. When you display them you can use 3d or 2d visual. In 3d (like google earth) you draw a sphere (or oblate spheroid) and draw textures on top of is to the right coordinates. In 3d everything needs to be converted to cartesian coordinates. Or in 2d you decide a projection and then convert the projection of your maps to this projection. After that it is just easy drawing. GIS libraries contain all the needed tools for these operations. There are a few of them with open source license.

I have been doing some work with opengl 3d drawing maps. Good luck your project is quite big but it is sure very much fun :)

-- 
-Matti

Re: [gentoo-user] "Headless question": Harvesting the results...software needed.

[meino.cramer]

Matti Nykyri <matti.nykyri@iki.fi> [14-09-30 19:44]:
> > On Sep 30, 2014, at 17:12, Alec Ten Harmsel <alec@alectenharmsel.com> wrote:
> 
> > 
> > 
> >> On 09/30/2014 10:05 AM, meino.cramer@gmx.de wrote:
> >> Suppose the GPS would already be attached
> >> to the board and works...
> >> 
> >> Is there any free available software and data for
> >> strict offline useage (which does NOT calls
> >> to home), which is able to map GPS data to a street/land
> >> map?
> >> I need both: The maps themselves and the logic to read
> >> GPS coordinates and map movements and ways to those maps.
> >> 
> >> Is something like that available for free or should
> >> I directly ask the NSA/CIA/FBI/...?
> >> 
> >> Thank you very much in advance for any help!
> >> Best regards,
> >> mcc
> > The only project I know of that has openly available map data is
> > OpenStreetMap (openstreetmap.org). I know they have an API, and they
> > probably (not sure) have maps available for download.
> > 
> > afaik the only way to combine various map data out of the box is to use
> > a GIS package like QGIS. You can write software to do this using the
> > proj4 library for an embedded box, not sure if anything for your
> > specific use case already exists and is open source.
> > 
> > Alec
> 
> Sorry iphone send mail even if you don't wanna :/
> 
> What you are considering doing is quite a challenge. What kind of coordinates does your gps module give you? The gps system works with cartesian x y z coordinates. Then these are usually displayed to the user in WGS-84. This is a quite hard mathematical problem (differential elliptical problem). Usually is done by your gps receiver and is approximated. GIS libraries have these functions built inside. Distances are easier and faster to calculate in cartesian coordinates. You need to calculate distance because coordinates from gps will never coincide with any address.
> 
> Open street maps provides a very good start, but addresses have great differences in different countries. For example google misses addresses quite much depending on where you are searching. Getting the address right requires good locality from the program. Addresses and roads are vector maps. The fastest way to get address is to have the vector map of the world and then calculate distance to the closest address. The database will be huge :)
> 
> Maps are usually raster pictures which have some projection. When you display them you can use 3d or 2d visual. In 3d (like google earth) you draw a sphere (or oblate spheroid) and draw textures on top of is to the right coordinates. In 3d everything needs to be converted to cartesian coordinates. Or in 2d you decide a projection and then convert the projection of your maps to this projection. After that it is just easy drawing. GIS libraries contain all the needed tools for these operations. There are a few of them with open source license.
> 
> I have been doing some work with opengl 3d drawing maps. Good luck your project is quite big but it is sure very much fun :)
> 
> -- 
> -Matti
> 
> 
> 

YEAH! Matti is back! I saw your previous mail and thought: Oh
boy...Clint Eastwood is very talkative compared to /him/. ;;;)))

I am not /that/ serious this evening...sorry...
With all the help from this forum this evening I got by far more
working results as I have thought...

But back to your mail:
The GPS module I plan to use is this one (by Adafruit, Lady Ada):
https://learn.adafruit.com/adafruit-ultimate-gps/overview
From there (see link list on the left) you can also download
the manuals (pdf).

I will not use this thing as a driving assistant or "navi" (is this
common speaking outside germany also...or is it one of those pseudo
english german words like "handy" for "cell phone"...dont laugh! This
time /I am/ serious! :) )

Its more like a GPS data logger. I plan to copy the gathered data on 
my PC later and I will try to "draw" them onto a map.
May be the results proof later, that I am able to walk through walls
and hovering over the face of the waters...;)

May be the UV-mappinga abillity of this 3D renderig program will help -- I am
using it for other purposes since 2006.
www.blender.org

Will see how far it will go. First step in progress will be acchived,
when I can read any data from the GPS module and they are not that
changing if I dont move and they will change when I move. The module
is ordered and will arrive -- I hope -- next week.

Best regards,
mcc

Re: [gentoo-user] "Headless question": Harvesting the results...software needed.

[Matti Nykyri]

On Tue, Sep 30, 2014 at 08:12:38PM +0200, meino.cramer@gmx.de wrote:
> Matti Nykyri <matti.nykyri@iki.fi> [14-09-30 19:44]:
> > > On Sep 30, 2014, at 17:12, Alec Ten Harmsel <alec@alectenharmsel.com> wrote:
> > 
> > > 
> > > 
> > >> On 09/30/2014 10:05 AM, meino.cramer@gmx.de wrote:
> > >> Suppose the GPS would already be attached
> > >> to the board and works...
> > >> 
> > >> Is there any free available software and data for
> > >> strict offline useage (which does NOT calls
> > >> to home), which is able to map GPS data to a street/land
> > >> map?
> > >> I need both: The maps themselves and the logic to read
> > >> GPS coordinates and map movements and ways to those maps.
> > >> 
> > >> Is something like that available for free or should
> > >> I directly ask the NSA/CIA/FBI/...?
> > >> 
> > >> Thank you very much in advance for any help!
> > >> Best regards,
> > >> mcc
> > > The only project I know of that has openly available map data is
> > > OpenStreetMap (openstreetmap.org). I know they have an API, and they
> > > probably (not sure) have maps available for download.
> > > 
> > > afaik the only way to combine various map data out of the box is to use
> > > a GIS package like QGIS. You can write software to do this using the
> > > proj4 library for an embedded box, not sure if anything for your
> > > specific use case already exists and is open source.
> > > 
> > > Alec
> > 
> > Sorry iphone send mail even if you don't wanna :/
> > 
> > What you are considering doing is quite a challenge. What kind of coordinates does your gps module give you? The gps system works with cartesian x y z coordinates. Then these are usually displayed to the user in WGS-84. This is a quite hard mathematical problem (differential elliptical problem). Usually is done by your gps receiver and is approximated. GIS libraries have these functions built inside. Distances are easier and faster to calculate in cartesian coordinates. You need to calculate distance because coordinates from gps will never coincide with any address.
> > 
> > Open street maps provides a very good start, but addresses have great differences in different countries. For example google misses addresses quite much depending on where you are searching. Getting the address right requires good locality from the program. Addresses and roads are vector maps. The fastest way to get address is to have the vector map of the world and then calculate distance to the closest address. The database will be huge :)
> > 
> > Maps are usually raster pictures which have some projection. When you display them you can use 3d or 2d visual. In 3d (like google earth) you draw a sphere (or oblate spheroid) and draw textures on top of is to the right coordinates. In 3d everything needs to be converted to cartesian coordinates. Or in 2d you decide a projection and then convert the projection of your maps to this projection. After that it is just easy drawing. GIS libraries contain all the needed tools for these operations. There are a few of them with open source license.
> > 
> > I have been doing some work with opengl 3d drawing maps. Good luck your project is quite big but it is sure very much fun :)
> > 
> > -- 
> > -Matti
> > 
> > 
> > 
> 
> YEAH! Matti is back! I saw your previous mail and thought: Oh
> boy...Clint Eastwood is very talkative compared to /him/. ;;;)))

Trashed the phone... and now back to the good old fashion terminal 
connection.

> I am not /that/ serious this evening...sorry...
> With all the help from this forum this evening I got by far more
> working results as I have thought...
> 
> But back to your mail:
> The GPS module I plan to use is this one (by Adafruit, Lady Ada):
> https://learn.adafruit.com/adafruit-ultimate-gps/overview
> From there (see link list on the left) you can also download
> the manuals (pdf).

Nice... MicroTek chipset. Quite easy to use.

> I will not use this thing as a driving assistant or "navi" (is this
> common speaking outside germany also...or is it one of those pseudo
> english german words like "handy" for "cell phone"...dont laugh! This
> time /I am/ serious! :) )
> 
> Its more like a GPS data logger. I plan to copy the gathered data on 
> my PC later and I will try to "draw" them onto a map.
> May be the results proof later, that I am able to walk through walls
> and hovering over the face of the waters...;)

Ok. This is easy... You just need some maps... openstreetmaps are good
for that. From the MT3339 you get NMEA messages and WGS-84 coordinates. 
I would suggest displaying your results in 2D. For germany Lambert 
conformal conic projection is good choice. In this projection all angles 
are true and sreight lines are great circle routes. Just convert the 
maps to this projection and convert your coordinates to Lambert false
easting and false northing and you will have cartesian coordinates that
are easy to draw. Even excel is able to draw this in real time :) I don't
see where you need the address resolution.

> May be the UV-mappinga abillity of this 3D renderig program will help -- I am
> using it for other purposes since 2006.
> www.blender.org

From what I know about blender isn't it just 3d rendering program. Not
a GIS application. It doesn't know anythin about coordinates...

> Will see how far it will go. First step in progress will be acchived,
> when I can read any data from the GPS module and they are not that
> changing if I dont move and they will change when I move. The module
> is ordered and will arrive -- I hope -- next week.

Nice.

-- 
-Matti

Re: [gentoo-user] "Headless question": Harvesting the results...software needed.

[meino.cramer]

Matti Nykyri <Matti.Nykyri@iki.fi> [14-10-01 00:26]:
> On Tue, Sep 30, 2014 at 08:12:38PM +0200, meino.cramer@gmx.de wrote:
> > Matti Nykyri <matti.nykyri@iki.fi> [14-09-30 19:44]:
> > > > On Sep 30, 2014, at 17:12, Alec Ten Harmsel <alec@alectenharmsel.com> wrote:
> > > 
> > > > 
> > > > 
> > > >> On 09/30/2014 10:05 AM, meino.cramer@gmx.de wrote:
> > > >> Suppose the GPS would already be attached
> > > >> to the board and works...
> > > >> 
> > > >> Is there any free available software and data for
> > > >> strict offline useage (which does NOT calls
> > > >> to home), which is able to map GPS data to a street/land
> > > >> map?
> > > >> I need both: The maps themselves and the logic to read
> > > >> GPS coordinates and map movements and ways to those maps.
> > > >> 
> > > >> Is something like that available for free or should
> > > >> I directly ask the NSA/CIA/FBI/...?
> > > >> 
> > > >> Thank you very much in advance for any help!
> > > >> Best regards,
> > > >> mcc
> > > > The only project I know of that has openly available map data is
> > > > OpenStreetMap (openstreetmap.org). I know they have an API, and they
> > > > probably (not sure) have maps available for download.
> > > > 
> > > > afaik the only way to combine various map data out of the box is to use
> > > > a GIS package like QGIS. You can write software to do this using the
> > > > proj4 library for an embedded box, not sure if anything for your
> > > > specific use case already exists and is open source.
> > > > 
> > > > Alec
> > > 
> > > Sorry iphone send mail even if you don't wanna :/
> > > 
> > > What you are considering doing is quite a challenge. What kind of coordinates does your gps module give you? The gps system works with cartesian x y z coordinates. Then these are usually displayed to the user in WGS-84. This is a quite hard mathematical problem (differential elliptical problem). Usually is done by your gps receiver and is approximated. GIS libraries have these functions built inside. Distances are easier and faster to calculate in cartesian coordinates. You need to calculate distance because coordinates from gps will never coincide with any address.
> > > 
> > > Open street maps provides a very good start, but addresses have great differences in different countries. For example google misses addresses quite much depending on where you are searching. Getting the address right requires good locality from the program. Addresses and roads are vector maps. The fastest way to get address is to have the vector map of the world and then calculate distance to the closest address. The database will be huge :)
> > > 
> > > Maps are usually raster pictures which have some projection. When you display them you can use 3d or 2d visual. In 3d (like google earth) you draw a sphere (or oblate spheroid) and draw textures on top of is to the right coordinates. In 3d everything needs to be converted to cartesian coordinates. Or in 2d you decide a projection and then convert the projection of your maps to this projection. After that it is just easy drawing. GIS libraries contain all the needed tools for these operations. There are a few of them with open source license.
> > > 
> > > I have been doing some work with opengl 3d drawing maps. Good luck your project is quite big but it is sure very much fun :)
> > > 
> > > -- 
> > > -Matti
> > > 
> > > 
> > > 
> > 
> > YEAH! Matti is back! I saw your previous mail and thought: Oh
> > boy...Clint Eastwood is very talkative compared to /him/. ;;;)))
> 
> Trashed the phone... and now back to the good old fashion terminal 
> connection.
> 
> > I am not /that/ serious this evening...sorry...
> > With all the help from this forum this evening I got by far more
> > working results as I have thought...
> > 
> > But back to your mail:
> > The GPS module I plan to use is this one (by Adafruit, Lady Ada):
> > https://learn.adafruit.com/adafruit-ultimate-gps/overview
> > From there (see link list on the left) you can also download
> > the manuals (pdf).
> 
> Nice... MicroTek chipset. Quite easy to use.
> 
> > I will not use this thing as a driving assistant or "navi" (is this
> > common speaking outside germany also...or is it one of those pseudo
> > english german words like "handy" for "cell phone"...dont laugh! This
> > time /I am/ serious! :) )
> > 
> > Its more like a GPS data logger. I plan to copy the gathered data on 
> > my PC later and I will try to "draw" them onto a map.
> > May be the results proof later, that I am able to walk through walls
> > and hovering over the face of the waters...;)
> 
> Ok. This is easy... You just need some maps... openstreetmaps are good
> for that. From the MT3339 you get NMEA messages and WGS-84 coordinates. 
> I would suggest displaying your results in 2D. For germany Lambert 
> conformal conic projection is good choice. In this projection all angles 
> are true and sreight lines are great circle routes. Just convert the 
> maps to this projection and convert your coordinates to Lambert false
> easting and false northing and you will have cartesian coordinates that
> are easy to draw. Even excel is able to draw this in real time :) I don't
> see where you need the address resolution.
> 
> > May be the UV-mappinga abillity of this 3D renderig program will help -- I am
> > using it for other purposes since 2006.
> > www.blender.org
> 
> From what I know about blender isn't it just 3d rendering program. Not
> a GIS application. It doesn't know anythin about coordinates...
> 
> > Will see how far it will go. First step in progress will be acchived,
> > when I can read any data from the GPS module and they are not that
> > changing if I dont move and they will change when I move. The module
> > is ordered and will arrive -- I hope -- next week.
> 
> Nice.
> 
> -- 
> -Matti
> 

Hi Matti,

thanks for your explanation. If I start struggling...you will receive
email (ok?) !

Blender:
The UV-Mapping of blender maps 2D-Images to whatever shaped things in 
3D quite good...it is used for texturing.
Additionally Blender has a python API, so missing things can added.

Just a shot in the dark...

Best regards,
mcc

Re: [gentoo-user] "Headless question": Harvesting the results...software needed.

[Matti Nykyri]

> On Oct 1, 2014, at 5:54, meino.cramer@gmx.de wrote:
> 
> Matti Nykyri <Matti.Nykyri@iki.fi> [14-10-01 00:26]:
>>> On Tue, Sep 30, 2014 at 08:12:38PM +0200, meino.cramer@gmx.de wrote:
>>> Matti Nykyri <matti.nykyri@iki.fi> [14-09-30 19:44]:
>>>>>> On Sep 30, 2014, at 17:12, Alec Ten Harmsel <alec@alectenharmsel.com> wrote:
>>>>> 
>>>>> 
>>>>> 
>>>>>> On 09/30/2014 10:05 AM, meino.cramer@gmx.de wrote:
>>>>>> Suppose the GPS would already be attached
>>>>>> to the board and works...
>>>>>> 
>>>>>> Is there any free available software and data for
>>>>>> strict offline useage (which does NOT calls
>>>>>> to home), which is able to map GPS data to a street/land
>>>>>> map?
>>>>>> I need both: The maps themselves and the logic to read
>>>>>> GPS coordinates and map movements and ways to those maps.
>>>>>> 
>>>>>> Is something like that available for free or should
>>>>>> I directly ask the NSA/CIA/FBI/...?
>>>>>> 
>>>>>> Thank you very much in advance for any help!
>>>>>> Best regards,
>>>>>> mcc
>>>>> The only project I know of that has openly available map data is
>>>>> OpenStreetMap (openstreetmap.org). I know they have an API, and they
>>>>> probably (not sure) have maps available for download.
>>>>> 
>>>>> afaik the only way to combine various map data out of the box is to use
>>>>> a GIS package like QGIS. You can write software to do this using the
>>>>> proj4 library for an embedded box, not sure if anything for your
>>>>> specific use case already exists and is open source.
>>>>> 
>>>>> Alec
>>>> 
>>>> Sorry iphone send mail even if you don't wanna :/
>>>> 
>>>> What you are considering doing is quite a challenge. What kind of coordinates does your gps module give you? The gps system works with cartesian x y z coordinates. Then these are usually displayed to the user in WGS-84. This is a quite hard mathematical problem (differential elliptical problem). Usually is done by your gps receiver and is approximated. GIS libraries have these functions built inside. Distances are easier and faster to calculate in cartesian coordinates. You need to calculate distance because coordinates from gps will never coincide with any address.
>>>> 
>>>> Open street maps provides a very good start, but addresses have great differences in different countries. For example google misses addresses quite much depending on where you are searching. Getting the address right requires good locality from the program. Addresses and roads are vector maps. The fastest way to get address is to have the vector map of the world and then calculate distance to the closest address. The database will be huge :)
>>>> 
>>>> Maps are usually raster pictures which have some projection. When you display them you can use 3d or 2d visual. In 3d (like google earth) you draw a sphere (or oblate spheroid) and draw textures on top of is to the right coordinates. In 3d everything needs to be converted to cartesian coordinates. Or in 2d you decide a projection and then convert the projection of your maps to this projection. After that it is just easy drawing. GIS libraries contain all the needed tools for these operations. There are a few of them with open source license.
>>>> 
>>>> I have been doing some work with opengl 3d drawing maps. Good luck your project is quite big but it is sure very much fun :)
>>>> 
>>>> -- 
>>>> -Matti
>>> 
>>> YEAH! Matti is back! I saw your previous mail and thought: Oh
>>> boy...Clint Eastwood is very talkative compared to /him/. ;;;)))
>> 
>> Trashed the phone... and now back to the good old fashion terminal 
>> connection.
>> 
>>> I am not /that/ serious this evening...sorry...
>>> With all the help from this forum this evening I got by far more
>>> working results as I have thought...
>>> 
>>> But back to your mail:
>>> The GPS module I plan to use is this one (by Adafruit, Lady Ada):
>>> https://learn.adafruit.com/adafruit-ultimate-gps/overview
>>> From there (see link list on the left) you can also download
>>> the manuals (pdf).
>> 
>> Nice... MicroTek chipset. Quite easy to use.
>> 
>>> I will not use this thing as a driving assistant or "navi" (is this
>>> common speaking outside germany also...or is it one of those pseudo
>>> english german words like "handy" for "cell phone"...dont laugh! This
>>> time /I am/ serious! :) )
>>> 
>>> Its more like a GPS data logger. I plan to copy the gathered data on 
>>> my PC later and I will try to "draw" them onto a map.
>>> May be the results proof later, that I am able to walk through walls
>>> and hovering over the face of the waters...;)
>> 
>> Ok. This is easy... You just need some maps... openstreetmaps are good
>> for that. From the MT3339 you get NMEA messages and WGS-84 coordinates. 
>> I would suggest displaying your results in 2D. For germany Lambert 
>> conformal conic projection is good choice. In this projection all angles 
>> are true and sreight lines are great circle routes. Just convert the 
>> maps to this projection and convert your coordinates to Lambert false
>> easting and false northing and you will have cartesian coordinates that
>> are easy to draw. Even excel is able to draw this in real time :) I don't
>> see where you need the address resolution.
>> 
>>> May be the UV-mappinga abillity of this 3D renderig program will help -- I am
>>> using it for other purposes since 2006.
>>> www.blender.org
>> 
>> From what I know about blender isn't it just 3d rendering program. Not
>> a GIS application. It doesn't know anythin about coordinates...
>> 
>>> Will see how far it will go. First step in progress will be acchived,
>>> when I can read any data from the GPS module and they are not that
>>> changing if I dont move and they will change when I move. The module
>>> is ordered and will arrive -- I hope -- next week.
>> 
>> Nice.
>> 
>> -- 
>> -Matti
> 
> Hi Matti,
> 
> thanks for your explanation. If I start struggling...you will receive
> email (ok?) !
> 
> Blender:
> The UV-Mapping of blender maps 2D-Images to whatever shaped things in 
> 3D quite good...it is used for texturing.
> Additionally Blender has a python API, so missing things can added.

Of course you can do that, but it's gazillion times harder to do than 2d. If you want to have a good 3d visual (like google earth) you need to calculate your oblate spheroid on the fly and i don't think blender will be able to do that.

With basic UV-mapping you will have uneven distribution with poles compared to equator. The best solution is to use icosahedron (like a normal football with alternating hexagons and pentagons). Also with that you will automatically end up with triangles which are better for your GPU. Also the size of the triangles are even throughout the object. No tessellation is required. 

You will never need to draw more than one half of this spheroid because the other side is hidden an equal to the visual side. If you really wan't conserve memory of you GPU you can just have 1/8 of the vertices of the spheroid. The remaining 3/8 vertices can be created on the fly by a rotation matrix.

Even better choice is to have a fixed amount of vertices and draw only the needed parts of the sphere on the fly. You also need to calculate the coordinates for your texture.

To have see the goodies of 3d map view you probably want to have tilt with your visual. Otherwise there is not much difference with 2d view. The WGS-84 defines just the spheroid which does not describe earth accurately. Because earth's densities are not equal the height of mean sea level is not equal above the WGS-84 ellipse. To calculate that you need EGM (earth gravitational model). The result is called geoid. EGM96 is now mostly used but newer more accurate EGM2008 is also available. In maps and all other applications heights are always reported as above mean sea level.

To calculate coordinates, lets say N52 E16, you take the WGS-84 ellipse that goes through the poles and is 16 deg east of 0 ellipse. Now the N52 is at the ellipse in the point where a normal to ellipse form 52deg angle with equator plane. To calculate where this point is at mean sea level or at arbitrary altitude you need to follow the vector of gravity. Vector of gravity does not have the same direction as the normal to the ellipse, but it is close. The gravity vector is twisted by the gravitational differences of earth (EGM) and the rotation of earth. These will give accurate result but in most applications it is not needed. A GIS library can do these calculations. Inverse of this is much much harder to do accurately (but every gps receiver needs to calculate it and usually use approximating algorithms).

So if you want to draw a map of lets say Aachen you it is not efficient to have vertices of the entire earth in GPU's memory. It is much better to have lets say 10000 points in Aachen and draw the texture on top of them an calculate the coordinates on the fly. If you are drawing areas bigger than Europe then you have more advantages with 3d view.

> Just a shot in the dark...

It would be nice to hear how well blender is able to do this :)

-- 
-Matti

Re: [gentoo-user] "Headless question": Harvesting the results...software needed.

[meino.cramer]

Matti Nykyri <matti.nykyri@iki.fi> [14-10-01 13:16]:
> > On Oct 1, 2014, at 5:54, meino.cramer@gmx.de wrote:
> > 
> > Matti Nykyri <Matti.Nykyri@iki.fi> [14-10-01 00:26]:
> >>> On Tue, Sep 30, 2014 at 08:12:38PM +0200, meino.cramer@gmx.de
> >>> wrote: Matti Nykyri <matti.nykyri@iki.fi> [14-09-30 19:44]:
> >>>>>> On Sep 30, 2014, at 17:12, Alec Ten Harmsel
> >>>>>> <alec@alectenharmsel.com> wrote:
> >>>>> 
> >>>>> 
> >>>>> 
> >>>>>> On 09/30/2014 10:05 AM, meino.cramer@gmx.de wrote: Suppose
> >>>>>> the GPS would already be attached to the board and works...
> >>>>>> 
> >>>>>> Is there any free available software and data for strict
> >>>>>> offline useage (which does NOT calls to home), which is able
> >>>>>> to map GPS data to a street/land map?  I need both: The maps
> >>>>>> themselves and the logic to read GPS coordinates and map
> >>>>>> movements and ways to those maps.
> >>>>>> 
> >>>>>> Is something like that available for free or should I
> >>>>>> directly ask the NSA/CIA/FBI/...?
> >>>>>> 
> >>>>>> Thank you very much in advance for any help!  Best regards,
> >>>>>> mcc
> >>>>> The only project I know of that has openly available map data
> >>>>> is OpenStreetMap (openstreetmap.org). I know they have an API,
> >>>>> and they probably (not sure) have maps available for download.
> >>>>> 
> >>>>> afaik the only way to combine various map data out of the box
> >>>>> is to use a GIS package like QGIS. You can write software to
> >>>>> do this using the proj4 library for an embedded box, not sure
> >>>>> if anything for your specific use case already exists and is
> >>>>> open source.
> >>>>> 
> >>>>> Alec
> >>>> 
> >>>> Sorry iphone send mail even if you don't wanna :/
> >>>> 
> >>>> What you are considering doing is quite a challenge. What kind
> >>>> of coordinates does your gps module give you? The gps system
> >>>> works with cartesian x y z coordinates. Then these are usually
> >>>> displayed to the user in WGS-84. This is a quite hard
> >>>> mathematical problem (differential elliptical problem). Usually
> >>>> is done by your gps receiver and is approximated. GIS libraries
> >>>> have these functions built inside. Distances are easier and
> >>>> faster to calculate in cartesian coordinates. You need to
> >>>> calculate distance because coordinates from gps will never
> >>>> coincide with any address.
> >>>> 
> >>>> Open street maps provides a very good start, but addresses have
> >>>> great differences in different countries. For example google
> >>>> misses addresses quite much depending on where you are
> >>>> searching. Getting the address right requires good locality
> >>>> from the program. Addresses and roads are vector maps. The
> >>>> fastest way to get address is to have the vector map of the
> >>>> world and then calculate distance to the closest address. The
> >>>> database will be huge :)
> >>>> 
> >>>> Maps are usually raster pictures which have some projection.
> >>>> When you display them you can use 3d or 2d visual. In 3d (like
> >>>> google earth) you draw a sphere (or oblate spheroid) and draw
> >>>> textures on top of is to the right coordinates. In 3d
> >>>> everything needs to be converted to cartesian coordinates. Or
> >>>> in 2d you decide a projection and then convert the projection
> >>>> of your maps to this projection. After that it is just easy
> >>>> drawing. GIS libraries contain all the needed tools for these
> >>>> operations. There are a few of them with open source license.
> >>>> 
> >>>> I have been doing some work with opengl 3d drawing maps. Good
> >>>> luck your project is quite big but it is sure very much fun :)
> >>>> 
> >>>> -- -Matti
> >>> 
> >>> YEAH! Matti is back! I saw your previous mail and thought: Oh
> >>> boy...Clint Eastwood is very talkative compared to /him/. ;;;)))
> >> 
> >> Trashed the phone... and now back to the good old fashion
> >> terminal connection.
> >> 
> >>> I am not /that/ serious this evening...sorry...  With all the
> >>> help from this forum this evening I got by far more working
> >>> results as I have thought...
> >>> 
> >>> But back to your mail: The GPS module I plan to use is this one
> >>> (by Adafruit, Lady Ada):
> >>> https://learn.adafruit.com/adafruit-ultimate-gps/overview From
> >>> there (see link list on the left) you can also download the
> >>> manuals (pdf).
> >> 
> >> Nice... MicroTek chipset. Quite easy to use.
> >> 
> >>> I will not use this thing as a driving assistant or "navi" (is
> >>> this common speaking outside germany also...or is it one of
> >>> those pseudo english german words like "handy" for "cell
> >>> phone"...dont laugh! This time /I am/ serious! :) )
> >>> 
> >>> Its more like a GPS data logger. I plan to copy the gathered
> >>> data on my PC later and I will try to "draw" them onto a map.
> >>> May be the results proof later, that I am able to walk through
> >>> walls and hovering over the face of the waters...;)
> >> 
> >> Ok. This is easy... You just need some maps... openstreetmaps are
> >> good for that. From the MT3339 you get NMEA messages and WGS-84
> >> coordinates.  I would suggest displaying your results in 2D. For
> >> germany Lambert conformal conic projection is good choice. In
> >> this projection all angles are true and sreight lines are great
> >> circle routes. Just convert the maps to this projection and
> >> convert your coordinates to Lambert false easting and false
> >> northing and you will have cartesian coordinates that are easy to
> >> draw. Even excel is able to draw this in real time :) I don't see
> >> where you need the address resolution.
> >> 
> >>> May be the UV-mappinga abillity of this 3D renderig program will
> >>> help -- I am using it for other purposes since 2006.
> >>> www.blender.org
> >> 
> >> From what I know about blender isn't it just 3d rendering
> >> program. Not a GIS application. It doesn't know anythin about
> >> coordinates...
> >> 
> >>> Will see how far it will go. First step in progress will be
> >>> acchived, when I can read any data from the GPS module and they
> >>> are not that changing if I dont move and they will change when I
> >>> move. The module is ordered and will arrive -- I hope -- next
> >>> week.
> >> 
> >> Nice.
> >> 
> >> -- -Matti
> > 
> > Hi Matti,
> > 
> > thanks for your explanation. If I start struggling...you will
> > receive email (ok?) !
> > 
> > Blender: The UV-Mapping of blender maps 2D-Images to whatever
> > shaped things in 3D quite good...it is used for texturing.
> > Additionally Blender has a python API, so missing things can
> > added.
> 
> Of course you can do that, but it's gazillion times harder to do
> than 2d. If you want to have a good 3d visual (like google earth)
> you need to calculate your oblate spheroid on the fly and i don't
> think blender will be able to do that.
> 
> With basic UV-mapping you will have uneven distribution with poles
> compared to equator. The best solution is to use icosahedron (like a
> normal football with alternating hexagons and pentagons). Also with
> that you will automatically end up with triangles which are better
> for your GPU. Also the size of the triangles are even throughout the
> object. No tessellation is required. 
> 
> You will never need to draw more than one half of this spheroid
> because the other side is hidden an equal to the visual side. If you
> really wan't conserve memory of you GPU you can just have 1/8 of the
> vertices of the spheroid. The remaining 3/8 vertices can be created
> on the fly by a rotation matrix.
> 
> Even better choice is to have a fixed amount of vertices and draw
> only the needed parts of the sphere on the fly. You also need to
> calculate the coordinates for your texture.
> 
> To have see the goodies of 3d map view you probably want to have
> tilt with your visual. Otherwise there is not much difference with
> 2d view. The WGS-84 defines just the spheroid which does not
> describe earth accurately. Because earth's densities are not equal
> the height of mean sea level is not equal above the WGS-84 ellipse.
> To calculate that you need EGM (earth gravitational model). The
> result is called geoid. EGM96 is now mostly used but newer more
> accurate EGM2008 is also available. In maps and all other
> applications heights are always reported as above mean sea level.
> 
> To calculate coordinates, lets say N52 E16, you take the WGS-84
> ellipse that goes through the poles and is 16 deg east of 0 ellipse.
> Now the N52 is at the ellipse in the point where a normal to ellipse
> form 52deg angle with equator plane. To calculate where this point
> is at mean sea level or at arbitrary altitude you need to follow the
> vector of gravity. Vector of gravity does not have the same
> direction as the normal to the ellipse, but it is close. The gravity
> vector is twisted by the gravitational differences of earth (EGM)
> and the rotation of earth. These will give accurate result but in
> most applications it is not needed. A GIS library can do these
> calculations. Inverse of this is much much harder to do accurately
> (but every gps receiver needs to calculate it and usually use
> approximating algorithms).
> 
> So if you want to draw a map of lets say Aachen you it is not
> efficient to have vertices of the entire earth in GPU's memory. It
> is much better to have lets say 10000 points in Aachen and draw the
> texture on top of them an calculate the coordinates on the fly. If
> you are drawing areas bigger than Europe then you have more
> advantages with 3d view.
> 
> > Just a shot in the dark...
> 
> It would be nice to hear how well blender is able to do this :)
> 
> -- -Matti

Hi Matti,

I have the first result of trying to do as described: With my DSL
connection it is impossible to download the OSM data for offline
browsing. Reason: The duration for the download (~40GB) exceeds 24
hours. After 24 h my DSL line is forced to disconnect by the provider 
and the download fails.
Grrmmmpppfff...
Reminds me of times when modems were hi-tec...

I found another program called "viking" (sci-geosciences/viking),
which claims to be able to download all needed data/maps/etc... and
store them for later usage on harddisk. This is not exactky "offline"
but ... kind of "second hand offline" ;)

The idea to use blender was born in the moment when it seems
that I have to do all the mapping myself...no longer needed as
it seems.

Furthermore I installed sci-geosciences/gpsd and found this 
page: http://the8thlayerof.net/category/beaglebone-black/
which described how to connect the beaglebone black, the gps module I
ordered and gpsd.

Still waiting for the parcel to arrive...

Best regards,
mcc

Re: [gentoo-user] "Headless question": Harvesting the results...software needed.

[Mick]

[-- Attachment #1: Type: Text/Plain, Size: 239 bytes --]

On Wednesday 01 Oct 2014 14:26:33 meino.cramer@gmx.de wrote:
> After 24 h my DSL line is forced to disconnect by the provider 
> and the download fails.
> Grrmmmpppfff...

Will wget -c <URL> work in this case?

-- 
Regards,
Mick

[-- Attachment #2: This is a digitally signed message part. --]
[-- Type: application/pgp-signature, Size: 473 bytes --]

Re: [gentoo-user] "Headless question": Harvesting the results...software needed.

[meino.cramer]

Mick <michaelkintzios@gmail.com> [14-10-01 15:34]:
> On Wednesday 01 Oct 2014 14:26:33 meino.cramer@gmx.de wrote:
> > After 24 h my DSL line is forced to disconnect by the provider 
> > and the download fails.
> > Grrmmmpppfff...
> 
> Will wget -c <URL> work in this case?
> 
> -- 
> Regards,
> Mick

Hi Mick,

yesno... ;)
or
it depends...

There is anoter problem...the data files will be updated each
day as far as I understand that...
So you get two parts of data which will or will not fit together.

Best regards,
mcc

Re: [gentoo-user] "Headless question": Harvesting the results...software needed.

[Matti Nykyri]

> On Oct 1, 2014, at 16:40, meino.cramer@gmx.de wrote:
> 
> Mick <michaelkintzios@gmail.com> [14-10-01 15:34]:
>>> On Wednesday 01 Oct 2014 14:26:33 meino.cramer@gmx.de wrote:
>>> After 24 h my DSL line is forced to disconnect by the provider 
>>> and the download fails.
>>> Grrmmmpppfff...
>> 
>> Will wget -c <URL> work in this case?
>> 
>> -- 
>> Regards,
>> Mick
> 
> Hi Mick,
> 
> yesno... ;)
> or
> it depends...
> 
> There is anoter problem...the data files will be updated each
> day as far as I understand that...
> So you get two parts of data which will or will not fit together.

Nice :)

Re: [gentoo-user] "Headless question": Harvesting the results...software needed.

[Frank Steinmetzger]

[-- Attachment #1: Type: text/plain, Size: 1228 bytes --]

On Wed, Oct 01, 2014 at 03:40:00PM +0200, meino.cramer@gmx.de wrote:
> Mick <michaelkintzios@gmail.com> [14-10-01 15:34]:
> > On Wednesday 01 Oct 2014 14:26:33 meino.cramer@gmx.de wrote:
> > > After 24 h my DSL line is forced to disconnect by the provider 
> > > and the download fails.
> > > Grrmmmpppfff...
> > 
> > Will wget -c <URL> work in this case?
> 
> Hi Mick,
> 
> yesno... ;)
> or
> it depends...
> 
> There is anoter problem...the data files will be updated each
> day as far as I understand that...
> So you get two parts of data which will or will not fit together.

Isn’t it possible to download just the relevant areas? I don’t suppose it is
the same format, but (since you use a German address) for example Osmand
allows me to download either Germany as a whole or even each state
separately.

A while back I tried to find out on how to render my own OSM maps locally. I
found a feature (me thinks) on the OSM website that allowed me to specify a
rectangle on the map which I could then download.
-- 
Gruß | Greetings | Qapla’
Please do not share anything from, with or about me with any Facebook service.

Even a dream job does not entitle to sleeping during work hours.

[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 819 bytes --]

Re: [gentoo-user] "Headless question": Harvesting the results...software needed.

[meino.cramer]

Frank Steinmetzger <Warp_7@gmx.de> [14-10-04 18:28]:
> On Wed, Oct 01, 2014 at 03:40:00PM +0200, meino.cramer@gmx.de wrote:
> > Mick <michaelkintzios@gmail.com> [14-10-01 15:34]:
> > > On Wednesday 01 Oct 2014 14:26:33 meino.cramer@gmx.de wrote:
> > > > After 24 h my DSL line is forced to disconnect by the provider 
> > > > and the download fails.
> > > > Grrmmmpppfff...
> > > 
> > > Will wget -c <URL> work in this case?
> > 
> > Hi Mick,
> > 
> > yesno... ;)
> > or
> > it depends...
> > 
> > There is anoter problem...the data files will be updated each
> > day as far as I understand that...
> > So you get two parts of data which will or will not fit together.
> 
> Isn’t it possible to download just the relevant areas? I don’t suppose it is
> the same format, but (since you use a German address) for example Osmand
> allows me to download either Germany as a whole or even each state
> separately.
> 
> A while back I tried to find out on how to render my own OSM maps locally. I
> found a feature (me thinks) on the OSM website that allowed me to specify a
> rectangle on the map which I could then download.
> -- 
> Gruß | Greetings | Qapla’
> Please do not share anything from, with or about me with any Facebook service.
> 
> Even a dream job does not entitle to sleeping during work hours.

Hi Frank,

...this thread soon will consist of a cascade of
yesnomaybemabenotitdepends answers :::))))

First of all -  to seperate me from for example Matti...
I am the bloodiest beginner according this topic as one can imagine...
;)

My first idea was: Combine a GPS receiver chip ("Ultimate GPS" by
Adafruit available via www.exp-tech.de for example) with a beaglebone
black.
Second idea was: This will result in a lot of really naked
coordinates.
Third idea was: MAPS!
Fourth idea was: I dont like Google Maps...use OSM.
This results in a download impulse...and the smallest thing I could
find was the data of EUROPE.

...download time more than two days result in the problems I already 
described.

Joost was so kind to offer help (THX, Joost! :)

But in the meanwhile I found a program called viking, which seems to
cache data for offline browsing and automates the download process:
It simply download the data to which area one goes to.
I am still waiting for my parcel to arrive and hopefully I soon will
be able to combine the beaglebone black with the GPS so I will get
data and check whether viking is able to use them.
If so, everything is fine and I dont need to directly download data.

We will see...fingers crossed.

Best regards,
mcc

Re: [gentoo-user] "Headless question": Harvesting the results...software needed.

[thegeezer]

On 30/09/14 15:05, meino.cramer@gmx.de wrote:
> Hi,
>
> with lot of help of this forum (***TAHNKS!***) I now
> have a embedded device which is able to
> dis/connect itsself from/to the LAN, set the clock via ntp-client
> and is able to fire up a tool, which collects
> data from sensors and put those into
> a file ... even if the tool has no
> connection to a terminal.
>
> Next step will be to connect a GPS module
> (ordered) to the GPIO pins of that board
> (which is quite offtopic and I fear therefore
> my sole problem... ;).
>
> Suppose the GPS would already be attached
> to the board and works...
>
> Is there any free available software and data for
> strict offline useage (which does NOT calls
> to home), which is able to map GPS data to a street/land
> map?
> I need both: The maps themselves and the logic to read
> GPS coordinates and map movements and ways to those maps.
>
> Is something like that available for free or should
> I directly ask the NSA/CIA/FBI/...?
>
> Thank you very much in advance for any help!
> Best regards,
> mcc
>
>
>
>
you can also have a look at something like www.openpaths.cc they have an
api you can plug into but you need to post your gps data to them
doesn't quite fit the offline part but to start it takes a lot of the
heavy lifting for you
alternatively you could save your gps co-ordinates to an xml file and
send that via email, which you can then push up to google maps
again, doesn't quite fit the offline part, but i'm not sure how you
would visually see your map if it's headless unless if it's on another
computer

Re: [gentoo-user] "Headless question": Harvesting the results...software needed.

[meino.cramer]

thegeezer <thegeezer@thegeezer.net> [14-09-30 20:24]:
> On 30/09/14 15:05, meino.cramer@gmx.de wrote:
> > Hi,
> >
> > with lot of help of this forum (***TAHNKS!***) I now
> > have a embedded device which is able to
> > dis/connect itsself from/to the LAN, set the clock via ntp-client
> > and is able to fire up a tool, which collects
> > data from sensors and put those into
> > a file ... even if the tool has no
> > connection to a terminal.
> >
> > Next step will be to connect a GPS module
> > (ordered) to the GPIO pins of that board
> > (which is quite offtopic and I fear therefore
> > my sole problem... ;).
> >
> > Suppose the GPS would already be attached
> > to the board and works...
> >
> > Is there any free available software and data for
> > strict offline useage (which does NOT calls
> > to home), which is able to map GPS data to a street/land
> > map?
> > I need both: The maps themselves and the logic to read
> > GPS coordinates and map movements and ways to those maps.
> >
> > Is something like that available for free or should
> > I directly ask the NSA/CIA/FBI/...?
> >
> > Thank you very much in advance for any help!
> > Best regards,
> > mcc
> >
> >
> >
> >
> you can also have a look at something like www.openpaths.cc they have an
> api you can plug into but you need to post your gps data to them
> doesn't quite fit the offline part but to start it takes a lot of the
> heavy lifting for you
> alternatively you could save your gps co-ordinates to an xml file and
> send that via email, which you can then push up to google maps
> again, doesn't quite fit the offline part, but i'm not sure how you
> would visually see your map if it's headless unless if it's on another
> computer
> 

Hi,

the offline part is important to me. In times where knowledge slowly
and surely becomes a criminal act if created just "by interest" I am
not willing to send any data (like GPS data) to google or others like
them.

"headless" vs. "see the map":
Sorry, the explanation may be missing in my mails.
The headless device is only used as "GPS recorder", which only stores
the GOS data given by GPS module.
The visualization is done lateron on my PC...
The headless device (Beaglebone black) "only" has 512MB RAM and 16GB
SDcard flash...
And the CPU is not made for heavy mathematics...

Best regards,
mcc

Re: [gentoo-user] "Headless question": Harvesting the results...software needed.

[meino.cramer]

meino.cramer@gmx.de <meino.cramer@gmx.de> [14-09-30 16:08]:
> Hi,
> 
> with lot of help of this forum (***TAHNKS!***) I now
> have a embedded device which is able to
> dis/connect itsself from/to the LAN, set the clock via ntp-client
> and is able to fire up a tool, which collects
> data from sensors and put those into
> a file ... even if the tool has no
> connection to a terminal.
> 
> Next step will be to connect a GPS module
> (ordered) to the GPIO pins of that board
> (which is quite offtopic and I fear therefore
> my sole problem... ;).
> 
> Suppose the GPS would already be attached
> to the board and works...
> 
> Is there any free available software and data for
> strict offline useage (which does NOT calls
> to home), which is able to map GPS data to a street/land
> map?
> I need both: The maps themselves and the logic to read
> GPS coordinates and map movements and ways to those maps.
> 
> Is something like that available for free or should
> I directly ask the NSA/CIA/FBI/...?
> 
> Thank you very much in advance for any help!
> Best regards,
> mcc
> 
> 
> 
> 

Hi all,

first of all I want to thank you all, who have participated in this
thread and offered their help and wisdom. :)

The result is: Now there is a cigarette sized metal case, which
includes a Beaglebone Black running Gentoo Linux, an Ultimate GPS
receiver chip on a breakout board both made by Adafruit Industries
(Lady Ada) and even the software to display position and track (if
any).

To summarize:
- Hardware: Beaglebone Black, Ultimate GPS, metal case for Beaglebone
  Black, uf.l to RMA adapter cable (which socket nicely fits into a
  hole of the metal case) and an external GPS antenna (adapter and
  antenna by Adafruit Industries).  Additionally a 4600mAh LiOn accu
  pack to power the whole thing.
- Software: Gpsd, Foxtrotgps, x11vnc, xvfb, ifplugd

When I boot the Beaglbone Black via accupack it starts gpsd and the
GPS receiver begins to sync with satelites in view. If done gpsd will
collect the data.  Since the output of gpsdpipe (comes with gpsd) is
json format, in the simplest case one could stream the data onto
disk/flash.

When I boot the Beaglebone at home, I plug in the LAN (which will be
recognized by ifplugs, which in turn reinitializes everything needed.

Now I fire xvfb and xvnc and start foxtrotgps.

On my PC I can easily can display the "desktop" of the Beaglebone
Black via tigervnc (vncviewer).

Two things need still to be investigated: How can I store GPSdata onto the
flash in a way, that no additional data is stored if no movement is
there. And I have to prevent, that a sector/block/organisation unit
of the flash is written more than once to prevent ware out of the
flash.

Secondly I have to figure out how to feed store data into foxtrotgps,
which normally directly connects to/with gpsd.

Foxtrottgps reads maps from OSM and store them on disk/flash and
reuses this.  So this kinda "delayed offline browsing";)) :))

Thank you very much again! :)

Best regards and have a nice weekend!
mcc

Re: [gentoo-user] "Headless question": Harvesting the results...software needed.

[Stroller]

On Sat, 11 October 2014, at 3:10 pm, meino.cramer@gmx.de wrote:
> ...
> Two things need still to be investigated: How can I store GPSdata onto the
> flash in a way, that no additional data is stored if no movement is
> there.

This should be pretty easy, but if you want help with it, you're going to need to give us some insight into how you're storing or accessing the GPS data at present.

Having said that, I'm not convinced that this is necessary. I have a logfile here with 91,000 lines of text in it, and it's 9.9mb and bzips down to 369kb. 91,000 is close to 10 entries every minute for a week, and I'd guess that you'd find CSV formatted GPS data written as text to have about the same length and compressibility as a typical /var/log/messages entry.

> And I have to prevent, that a sector/block/organisation unit
> of the flash is written more than once to prevent ware out of the
> flash.

Wear-levelling should be handled by the flash memory controller, and you shouldn't need to worry about it.

Stroller.

Re: [gentoo-user] "Headless question": Harvesting the results...software needed.

[meino.cramer]

Stroller <stroller@stellar.eclipse.co.uk> [14-10-12 09:28]:
> 
> On Sat, 11 October 2014, at 3:10 pm, meino.cramer@gmx.de wrote:
> > ...
> > Two things need still to be investigated: How can I store GPSdata onto the
> > flash in a way, that no additional data is stored if no movement is
> > there.
> 
> This should be pretty easy, but if you want help with it, you're going to need to give us some insight into how you're storing or accessing the GPS data at present.
> 
> Having said that, I'm not convinced that this is necessary. I have a logfile here with 91,000 lines of text in it, and it's 9.9mb and bzips down to 369kb. 91,000 is close to 10 entries every minute for a week, and I'd guess that you'd find CSV formatted GPS data written as text to have about the same length and compressibility as a typical /var/log/messages entry.
> 
> > And I have to prevent, that a sector/block/organisation unit
> > of the flash is written more than once to prevent ware out of the
> > flash.
> 
> Wear-levelling should be handled by the flash memory controller, and you shouldn't need to worry about it.
> 
> Stroller.
> 
> 
> 

Hi Stroller,

thank you for your input :) !!

I am still a pure newbie to gps. This morning I discovered, that there
a LOT of kinds of output of the different GPS devices...the output of
mine looks /so standard/, that I thought it would be /THAT STANDARD/.
;)

Ok ... the device I use is an Ultimate GPS by Adafruit Industries.
The device is a GlobalTop-FGPMMOPA6C module with a MediaTek MT3339
chipset.

The output are NMEA sentences (pure ASCII as it seems). The module is
wired to UART01 on my embedded computer, so gpsd can read the data
from /dev/ttyO1.
Via gpsd it is possible to create json output from that (instead of 
NMEA).

The module creates from 1 to 10 position reports per second. I want
to make this speed depended (read: I have to write some code for it,
if I dont find some...). If one choose 1 report/second it will send
5 position report and then 1 status report (current time for example).

Since civil GPS modules have the feature to obfuscate the exact
position up to some degree (otherwise I would build a weapon instead
of tinkering with an embedded system...at least according to some
external laws ;) I see problems in deciding, whether I am really
moving or my position is moving due to """less accuracy of the
chipset""".

Currently the GPS antenna is clamped to my desktop lamp and I am
nearly up to 100% sure that it is not moving at all...but gpsmon gives
me a natural speed of 0.5km/h which is definitely too much for
a warmth induced Brownian molecular motion... ;)

"Wear levelling should be handled by the flash memory controller..."

This "should" makes me a little nervous, Stroller... ;)
Linux includes a filesystem called F2FS, which takes care 
of the wear levelling problem (as far as I know). This F2FS originates
from SAMSUNG, one of the greater manufacturer of Flash memories of all
kind. Why the effort, if the memory controller take care of it?
Stroller, I DONT EXPLICETLY OR IMPLICITELY EXPRESS A "I DONT BELIEVE
YOU" HERE...!
It is just the difference between what manufacturer states ("...should be
handled...") and what mechanisms create more benefits for them.

Best regards,
mcc

Re: [gentoo-user] "Headless question": Harvesting the results...software needed.

[Neil Bothwick]

[-- Attachment #1: Type: text/plain, Size: 607 bytes --]

On Sun, 12 Oct 2014 08:24:46 +0100, Stroller wrote:

> > And I have to prevent, that a sector/block/organisation unit
> > of the flash is written more than once to prevent ware out of the
> > flash.  
> 
> Wear-levelling should be handled by the flash memory controller, and
> you shouldn't need to worry about it.

Also, good cards these days handle far more writes to the same location
without failure. Stick to quality, branded cards and wear shouldn't be a
problem. If you are still concerned, replace the card every year.


-- 
Neil Bothwick

Top Oxymorons Number 3: Working vacation

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 181 bytes --]