[gentoo-user] Akonadi database errors

[gentoo-user] Akonadi database errors

[Peter Humphrey]

Hello list,

Do any other KDE users have serious-looking errors in 
~/.local/share/akonadi/db_data/mysql.err? I'm seeing a whole lot of table 
structure errors, among others. KMail seems to limp on regardless, which seems 
odd.

https://bugs.kde.org/show_bug.cgi?id=348491 refers.

-- 
Rgds
Peter

Re: [gentoo-user] Akonadi database errors

[Mick]

[-- Attachment #1: Type: Text/Plain, Size: 690 bytes --]

On Wednesday 11 Nov 2015 12:10:36 Peter Humphrey wrote:
> Hello list,
> 
> Do any other KDE users have serious-looking errors in
> ~/.local/share/akonadi/db_data/mysql.err? I'm seeing a whole lot of table
> structure errors, among others. KMail seems to limp on regardless, which
> seems odd.
> 
> https://bugs.kde.org/show_bug.cgi?id=348491 refers.

Yes, I noticed repeated errors like this:

151111  7:12:31 [ERROR] Native table 
'performance_schema'.'events_statements_summary_by_account_by_event_name' has 
the wrong structure


The user has not complained that her emails stopped working, so I'm assuming 
all is well on the Kmail front.  o_O

-- 
Regards,
Mick

[-- Attachment #2: This is a digitally signed message part. --]
[-- Type: application/pgp-signature, Size: 473 bytes --]

Re: [gentoo-user] Akonadi database errors

[J. Roeleveld]

On 11 November 2015 20:11:55 CET, Mick <michaelkintzios@gmail.com> wrote:
>On Wednesday 11 Nov 2015 12:10:36 Peter Humphrey wrote:
>> Hello list,
>> 
>> Do any other KDE users have serious-looking errors in
>> ~/.local/share/akonadi/db_data/mysql.err? I'm seeing a whole lot of
>table
>> structure errors, among others. KMail seems to limp on regardless,
>which
>> seems odd.
>> 
>> https://bugs.kde.org/show_bug.cgi?id=348491 refers.
>
>Yes, I noticed repeated errors like this:
>
>151111  7:12:31 [ERROR] Native table 
>'performance_schema'.'events_statements_summary_by_account_by_event_name'
>has 
>the wrong structure
>
>
>The user has not complained that her emails stopped working, so I'm
>assuming 
>all is well on the Kmail front.  o_O

I saw plenty of errors with mysql.

After switching to Postgresql, they seem to have disappeared. 

--
Joost
-- 
Sent from my Android device with K-9 Mail. Please excuse my brevity.

Re: [gentoo-user] Akonadi database errors

[Marc Joliet]

[-- Attachment #1: Type: text/plain, Size: 404 bytes --]

On Wednesday 11 November 2015 20:37:24 J. Roeleveld wrote:
>I saw plenty of errors with mysql.
>
>After switching to Postgresql, they seem to have disappeared. 

FWIW, I use mariadb myself, which is also the virtual/mysql default provider, 
last I checked.

Greetings
-- 
Marc Joliet
--
"People who think they know everything really annoy those of us who know we
don't" - Bjarne Stroustrup

[-- Attachment #2: This is a digitally signed message part. --]
[-- Type: application/pgp-signature, Size: 819 bytes --]

Re: [gentoo-user] Akonadi database errors

[Mick]

[-- Attachment #1: Type: Text/Plain, Size: 711 bytes --]

On Wednesday 11 Nov 2015 20:28:07 Marc Joliet wrote:
> On Wednesday 11 November 2015 20:37:24 J. Roeleveld wrote:
> >I saw plenty of errors with mysql.
> >
> >After switching to Postgresql, they seem to have disappeared.
> 
> FWIW, I use mariadb myself, which is also the virtual/mysql default
> provider, last I checked.
> 
> Greetings

@Mark: Yes, same here, but the errors are produced by mariadb too.

@Joost: Is postgresql starting as a process by akonadi, or are you running it 
independently and pointing akonadi to it?

PS. I read somewhere that if mysql is running independently of akonadi, then 
the akonadi errors/corruptions are fewer, or not happen at all.

-- 
Regards,
Mick

[-- Attachment #2: This is a digitally signed message part. --]
[-- Type: application/pgp-signature, Size: 473 bytes --]

Re: [gentoo-user] Akonadi database errors

[J. Roeleveld]

On 11 November 2015 23:07:41 CET, Mick <michaelkintzios@gmail.com> wrote:
>On Wednesday 11 Nov 2015 20:28:07 Marc Joliet wrote:
>> On Wednesday 11 November 2015 20:37:24 J. Roeleveld wrote:
>> >I saw plenty of errors with mysql.
>> >
>> >After switching to Postgresql, they seem to have disappeared.
>> 
>> FWIW, I use mariadb myself, which is also the virtual/mysql default
>> provider, last I checked.
>> 
>> Greetings
>
>@Mark: Yes, same here, but the errors are produced by mariadb too.
>
>@Joost: Is postgresql starting as a process by akonadi, or are you
>running it 
>independently and pointing akonadi to it?
>
>PS. I read somewhere that if mysql is running independently of akonadi,
>then 
>the akonadi errors/corruptions are fewer, or not happen at all.

As I use Postgresql also for other stuff, it's started seperately.

I also found this performs better, having it run "embedded" only had a slightly better performance when compared to mysql (or mariadb, don't remember) "embedded".

A framework like akonadi should, IMO, also be able to be run on a server with clients connecting to there to allow different machines to all use the same data.

The current solution makes running with a shared home and logged in from different clients simultaneously problematic  (to say the least)

--
Joost 
-- 
Sent from my Android device with K-9 Mail. Please excuse my brevity.

Re: [gentoo-user] Akonadi database errors

[Mick]

[-- Attachment #1: Type: Text/Plain, Size: 1637 bytes --]

On Thursday 12 Nov 2015 04:48:49 J. Roeleveld wrote:
> On 11 November 2015 23:07:41 CET, Mick <michaelkintzios@gmail.com> wrote:
> >On Wednesday 11 Nov 2015 20:28:07 Marc Joliet wrote:
> >> On Wednesday 11 November 2015 20:37:24 J. Roeleveld wrote:
> >> >I saw plenty of errors with mysql.
> >> >
> >> >After switching to Postgresql, they seem to have disappeared.
> >> 
> >> FWIW, I use mariadb myself, which is also the virtual/mysql default
> >> provider, last I checked.
> >> 
> >> Greetings
> >
> >@Mark: Yes, same here, but the errors are produced by mariadb too.
> >
> >@Joost: Is postgresql starting as a process by akonadi, or are you
> >running it
> >independently and pointing akonadi to it?
> >
> >PS. I read somewhere that if mysql is running independently of akonadi,
> >then
> >the akonadi errors/corruptions are fewer, or not happen at all.
> 
> As I use Postgresql also for other stuff, it's started seperately.
> 
> I also found this performs better, having it run "embedded" only had a
> slightly better performance when compared to mysql (or mariadb, don't
> remember) "embedded".
> 
> A framework like akonadi should, IMO, also be able to be run on a server
> with clients connecting to there to allow different machines to all use
> the same data.
> 
> The current solution makes running with a shared home and logged in from
> different clients simultaneously problematic  (to say the least)
> 
> --
> Joost

Can you please explain how you have akonadi configured to use an existing db 
instance?  Did you have to set up an akonadi db user and passwd?
-- 
Regards,
Mick

[-- Attachment #2: This is a digitally signed message part. --]
[-- Type: application/pgp-signature, Size: 473 bytes --]

Re: [gentoo-user] Akonadi database errors

[J. Roeleveld]

[-- Attachment #1: Type: text/plain, Size: 2248 bytes --]

On Thursday, November 12, 2015 07:30:49 AM Mick wrote:
> On Thursday 12 Nov 2015 04:48:49 J. Roeleveld wrote:
> > On 11 November 2015 23:07:41 CET, Mick <michaelkintzios@gmail.com> wrote:
> > >On Wednesday 11 Nov 2015 20:28:07 Marc Joliet wrote:
> > >> On Wednesday 11 November 2015 20:37:24 J. Roeleveld wrote:
> > >> >I saw plenty of errors with mysql.
> > >> >
> > >> >After switching to Postgresql, they seem to have disappeared.
> > >> 
> > >> FWIW, I use mariadb myself, which is also the virtual/mysql default
> > >> provider, last I checked.
> > >> 
> > >> Greetings
> > >
> > >@Mark: Yes, same here, but the errors are produced by mariadb too.
> > >
> > >@Joost: Is postgresql starting as a process by akonadi, or are you
> > >running it
> > >independently and pointing akonadi to it?
> > >
> > >PS. I read somewhere that if mysql is running independently of akonadi,
> > >then
> > >the akonadi errors/corruptions are fewer, or not happen at all.
> > 
> > As I use Postgresql also for other stuff, it's started seperately.
> > 
> > I also found this performs better, having it run "embedded" only had a
> > slightly better performance when compared to mysql (or mariadb, don't
> > remember) "embedded".
> > 
> > A framework like akonadi should, IMO, also be able to be run on a server
> > with clients connecting to there to allow different machines to all use
> > the same data.
> > 
> > The current solution makes running with a shared home and logged in from
> > different clients simultaneously problematic  (to say the least)
> > 
> > --
> > Joost
> 
> Can you please explain how you have akonadi configured to use an existing db
> instance?  Did you have to set up an akonadi db user and passwd?

Yes.
You need to create a user with password on the database where akonadi can 
create the tables.

Here is my akonadi-config:
***
% cat .config/akonadi/akonadiserverrc 
[%General]
Driver=QPSQL

[QPSQL]
Name=joost-akonadi
Host=localhost
Options=
ServerPath=/usr/bin/pg_ctl
InitDbPath=/usr/bin/initdb
StartServer=false
User=<username>
Password=<password>
Port=5432

[Debug]
Tracer=null

***

It also works with the database running on a different machine.

--
Joost

[-- Attachment #2: This is a digitally signed message part. --]
[-- Type: application/pgp-signature, Size: 473 bytes --]

Re: [gentoo-user] Akonadi database errors

[Peter Humphrey]

On Wednesday 11 Nov 2015 12:10:36 I wrote:

> Do any other KDE users have serious-looking errors in
> ~/.local/share/akonadi/db_data/mysql.err? I'm seeing a whole lot of table
> structure errors, among others. KMail seems to limp on regardless, which
> seems odd.
> 
> https://bugs.kde.org/show_bug.cgi?id=348491 refers.

Looks like the problem's gone away. I archived all my mails, then created a 
new user for myself and set it up anew, then re-imported from the archive 
and all seems fine now.

How can a problem like that hide in the data? It's almost like software 
breaking the hardware (and no, I don't count displays being sensitive to 
being driven too hard).

-- 
Rgds
Peter

Re: [gentoo-user] Akonadi database errors

[Mick]

[-- Attachment #1: Type: Text/Plain, Size: 2679 bytes --]

On Thursday 12 Nov 2015 08:05:52 J. Roeleveld wrote:
> On Thursday, November 12, 2015 07:30:49 AM Mick wrote:
> > On Thursday 12 Nov 2015 04:48:49 J. Roeleveld wrote:
> > > On 11 November 2015 23:07:41 CET, Mick <michaelkintzios@gmail.com> 
wrote:
> > > >On Wednesday 11 Nov 2015 20:28:07 Marc Joliet wrote:
> > > >> On Wednesday 11 November 2015 20:37:24 J. Roeleveld wrote:
> > > >> >I saw plenty of errors with mysql.
> > > >> >
> > > >> >After switching to Postgresql, they seem to have disappeared.
> > > >> 
> > > >> FWIW, I use mariadb myself, which is also the virtual/mysql default
> > > >> provider, last I checked.
> > > >> 
> > > >> Greetings
> > > >
> > > >@Mark: Yes, same here, but the errors are produced by mariadb too.
> > > >
> > > >@Joost: Is postgresql starting as a process by akonadi, or are you
> > > >running it
> > > >independently and pointing akonadi to it?
> > > >
> > > >PS. I read somewhere that if mysql is running independently of
> > > >akonadi, then
> > > >the akonadi errors/corruptions are fewer, or not happen at all.
> > > 
> > > As I use Postgresql also for other stuff, it's started seperately.
> > > 
> > > I also found this performs better, having it run "embedded" only had a
> > > slightly better performance when compared to mysql (or mariadb, don't
> > > remember) "embedded".
> > > 
> > > A framework like akonadi should, IMO, also be able to be run on a
> > > server with clients connecting to there to allow different machines to
> > > all use the same data.
> > > 
> > > The current solution makes running with a shared home and logged in
> > > from different clients simultaneously problematic  (to say the least)
> > > 
> > > --
> > > Joost
> > 
> > Can you please explain how you have akonadi configured to use an existing
> > db instance?  Did you have to set up an akonadi db user and passwd?
> 
> Yes.
> You need to create a user with password on the database where akonadi can
> create the tables.
> 
> Here is my akonadi-config:
> ***
> % cat .config/akonadi/akonadiserverrc
> [%General]
> Driver=QPSQL
> 
> [QPSQL]
> Name=joost-akonadi
> Host=localhost
> Options=
> ServerPath=/usr/bin/pg_ctl
> InitDbPath=/usr/bin/initdb
> StartServer=false
> User=<username>
> Password=<password>
> Port=5432
> 
> [Debug]
> Tracer=null
> 
> ***
> 
> It also works with the database running on a different machine.
> 
> --
> Joost

Thank you Joost.  Did you export/import akonadi databases when you moved over 
from MySQL, or was it not necessary?

One of the databases contains calendar data and I do not want to cause loss of 
it.
-- 
Regards,
Mick

[-- Attachment #2: This is a digitally signed message part. --]
[-- Type: application/pgp-signature, Size: 473 bytes --]

Re: [gentoo-user] Akonadi database errors

[J. Roeleveld]

On 15 November 2015 17:32:07 CET, Mick <michaelkintzios@gmail.com> wrote:
>On Thursday 12 Nov 2015 08:05:52 J. Roeleveld wrote:
>> On Thursday, November 12, 2015 07:30:49 AM Mick wrote:
>> > On Thursday 12 Nov 2015 04:48:49 J. Roeleveld wrote:
>> > > On 11 November 2015 23:07:41 CET, Mick
><michaelkintzios@gmail.com> 
>wrote:
>> > > >On Wednesday 11 Nov 2015 20:28:07 Marc Joliet wrote:
>> > > >> On Wednesday 11 November 2015 20:37:24 J. Roeleveld wrote:
>> > > >> >I saw plenty of errors with mysql.
>> > > >> >
>> > > >> >After switching to Postgresql, they seem to have disappeared.
>> > > >> 
>> > > >> FWIW, I use mariadb myself, which is also the virtual/mysql
>default
>> > > >> provider, last I checked.
>> > > >> 
>> > > >> Greetings
>> > > >
>> > > >@Mark: Yes, same here, but the errors are produced by mariadb
>too.
>> > > >
>> > > >@Joost: Is postgresql starting as a process by akonadi, or are
>you
>> > > >running it
>> > > >independently and pointing akonadi to it?
>> > > >
>> > > >PS. I read somewhere that if mysql is running independently of
>> > > >akonadi, then
>> > > >the akonadi errors/corruptions are fewer, or not happen at all.
>> > > 
>> > > As I use Postgresql also for other stuff, it's started
>seperately.
>> > > 
>> > > I also found this performs better, having it run "embedded" only
>had a
>> > > slightly better performance when compared to mysql (or mariadb,
>don't
>> > > remember) "embedded".
>> > > 
>> > > A framework like akonadi should, IMO, also be able to be run on a
>> > > server with clients connecting to there to allow different
>machines to
>> > > all use the same data.
>> > > 
>> > > The current solution makes running with a shared home and logged
>in
>> > > from different clients simultaneously problematic  (to say the
>least)
>> > > 
>> > > --
>> > > Joost
>> > 
>> > Can you please explain how you have akonadi configured to use an
>existing
>> > db instance?  Did you have to set up an akonadi db user and passwd?
>> 
>> Yes.
>> You need to create a user with password on the database where akonadi
>can
>> create the tables.
>> 
>> Here is my akonadi-config:
>> ***
>> % cat .config/akonadi/akonadiserverrc
>> [%General]
>> Driver=QPSQL
>> 
>> [QPSQL]
>> Name=joost-akonadi
>> Host=localhost
>> Options=
>> ServerPath=/usr/bin/pg_ctl
>> InitDbPath=/usr/bin/initdb
>> StartServer=false
>> User=<username>
>> Password=<password>
>> Port=5432
>> 
>> [Debug]
>> Tracer=null
>> 
>> ***
>> 
>> It also works with the database running on a different machine.
>> 
>> --
>> Joost
>
>Thank you Joost.  Did you export/import akonadi databases when you
>moved over 
>from MySQL, or was it not necessary?
>
>One of the databases contains calendar data and I do not want to cause
>loss of 
>it.

I store my emails in IMAP (Cyrus) and my contacts and calendar are stored in Egroupware.

IOW, I treat akonadi as a local cache and the server is the master copy being used by all other devices.

--
Joost
-- 
Sent from my Android device with K-9 Mail. Please excuse my brevity.

Re: [gentoo-user] Akonadi database errors

[J. Roeleveld]

On 15 November 2015 17:32:07 CET, Mick <michaelkintzios@gmail.com> wrote:
>On Thursday 12 Nov 2015 08:05:52 J. Roeleveld wrote:
>> On Thursday, November 12, 2015 07:30:49 AM Mick wrote:
>> > On Thursday 12 Nov 2015 04:48:49 J. Roeleveld wrote:
>> > > On 11 November 2015 23:07:41 CET, Mick
><michaelkintzios@gmail.com> 
>wrote:
>> > > >On Wednesday 11 Nov 2015 20:28:07 Marc Joliet wrote:
>> > > >> On Wednesday 11 November 2015 20:37:24 J. Roeleveld wrote:
>> > > >> >I saw plenty of errors with mysql.
>> > > >> >
>> > > >> >After switching to Postgresql, they seem to have disappeared.
>> > > >> 
>> > > >> FWIW, I use mariadb myself, which is also the virtual/mysql
>default
>> > > >> provider, last I checked.
>> > > >> 
>> > > >> Greetings
>> > > >
>> > > >@Mark: Yes, same here, but the errors are produced by mariadb
>too.
>> > > >
>> > > >@Joost: Is postgresql starting as a process by akonadi, or are
>you
>> > > >running it
>> > > >independently and pointing akonadi to it?
>> > > >
>> > > >PS. I read somewhere that if mysql is running independently of
>> > > >akonadi, then
>> > > >the akonadi errors/corruptions are fewer, or not happen at all.
>> > > 
>> > > As I use Postgresql also for other stuff, it's started
>seperately.
>> > > 
>> > > I also found this performs better, having it run "embedded" only
>had a
>> > > slightly better performance when compared to mysql (or mariadb,
>don't
>> > > remember) "embedded".
>> > > 
>> > > A framework like akonadi should, IMO, also be able to be run on a
>> > > server with clients connecting to there to allow different
>machines to
>> > > all use the same data.
>> > > 
>> > > The current solution makes running with a shared home and logged
>in
>> > > from different clients simultaneously problematic  (to say the
>least)
>> > > 
>> > > --
>> > > Joost
>> > 
>> > Can you please explain how you have akonadi configured to use an
>existing
>> > db instance?  Did you have to set up an akonadi db user and passwd?
>> 
>> Yes.
>> You need to create a user with password on the database where akonadi
>can
>> create the tables.
>> 
>> Here is my akonadi-config:
>> ***
>> % cat .config/akonadi/akonadiserverrc
>> [%General]
>> Driver=QPSQL
>> 
>> [QPSQL]
>> Name=joost-akonadi
>> Host=localhost
>> Options=
>> ServerPath=/usr/bin/pg_ctl
>> InitDbPath=/usr/bin/initdb
>> StartServer=false
>> User=<username>
>> Password=<password>
>> Port=5432
>> 
>> [Debug]
>> Tracer=null
>> 
>> ***
>> 
>> It also works with the database running on a different machine.
>> 
>> --
>> Joost
>
>Thank you Joost.  Did you export/import akonadi databases when you
>moved over 
>from MySQL, or was it not necessary?
>
>One of the databases contains calendar data and I do not want to cause
>loss of 
>it.

To migrate calendar data, I would export to an ical file and then reimport it.

For contacts, use vcf.

Both of these are mostly human readable and allow for simple editing if necessary.

I am not certain this will work. I would suggest testing with a temporary user first.

--
Joost
-- 
Sent from my Android device with K-9 Mail. Please excuse my brevity.

Re: [gentoo-user] Akonadi database errors

[Mick]

[-- Attachment #1: Type: Text/Plain, Size: 744 bytes --]

On Sunday 15 Nov 2015 17:55:08 J. Roeleveld wrote:

> To migrate calendar data, I would export to an ical file and then reimport
> it.
> 
> For contacts, use vcf.
> 
> Both of these are mostly human readable and allow for simple editing if
> necessary.
> 
> I am not certain this will work. I would suggest testing with a temporary
> user first.
> 
> --
> Joost

Thank you for your advice.  I'll try it out when a get a spare moment.  Last 
question:

akonadi seems to run a mysql_upgrade command whenever the mysql application is 
updated by portage.  Will it also run the equivalent command with postgres?  
If not, dumping and reloading all the akonadi databases will be a pain for a 
desktop.
 
-- 
Regards,
Mick

[-- Attachment #2: This is a digitally signed message part. --]
[-- Type: application/pgp-signature, Size: 473 bytes --]

Re: [gentoo-user] Akonadi database errors

[J. Roeleveld]

On 15 November 2015 20:49:46 CET, Mick <michaelkintzios@gmail.com> wrote:
>On Sunday 15 Nov 2015 17:55:08 J. Roeleveld wrote:
>
>> To migrate calendar data, I would export to an ical file and then
>reimport
>> it.
>> 
>> For contacts, use vcf.
>> 
>> Both of these are mostly human readable and allow for simple editing
>if
>> necessary.
>> 
>> I am not certain this will work. I would suggest testing with a
>temporary
>> user first.
>> 
>> --
>> Joost
>
>Thank you for your advice.  I'll try it out when a get a spare moment. 
>Last 
>question:
>
>akonadi seems to run a mysql_upgrade command whenever the mysql
>application is 
>updated by portage.  Will it also run the equivalent command with
>postgres?  
>If not, dumping and reloading all the akonadi databases will be a pain
>for a 
>desktop.
> 

It might do something similar when run 'embedded'.
I run it standalone, which means I need to handle updates myself.

Postgresql only needs extra steps for updates when changing major version. Which doesn't happen too often.

--
Joost 
-- 
Sent from my Android device with K-9 Mail. Please excuse my brevity.