* [gentoo-soc] Log collection and analysis: report for 6.25-7.04
@ 2013-07-05 0:48 99% Antanas Uršulis
0 siblings, 0 replies; 1+ results
From: Antanas Uršulis @ 2013-07-05 0:48 UTC (permalink / raw
To: gentoo-soc
Hello everyone,
I'm working on the "Log collection and analysis for the tinderbox"
project. It aims to create a replacement for the current solution,
which, in short, collects build logs (and other info) from the
tinderbox, finds out which of these logs come from builds that failed,
and displays them, along with lines indicating errors/warnings/etc. to
the tinderbox runner, so that the issue can be investigated, bugs
filed, and so on.
There is a wiki page [1] which currently contains a copy of the
original proposal and code will be placed in [2].
---------
It was decided to base the application around the Flask [3] Python
framework, which will nicely abstract away HTTP and provide URL
routing, templated HTML generation, and more niceties.
The log submission protocol will be protobuf[4]-over-HTTP.
Right now, the app accepts multiple files submitted, and groups them
by source hostname in the filesystem. There is a submission client
that wraps files given as arguments with protobuf and performs the
HTTP POST.
The project is slightly behind schedule right now - I've had
graduation and packing and moving all of my belongings from the UK
back to Lithuania. Here's what will come next:
* this is about time to add some configuration file support
* stub log analysers
* SQL database with metadata of the submissions
[1] https://wiki.gentoo.org/wiki/Tinderbox_log_collection_and_analysis
[2] https://git.overlays.gentoo.org/gitweb/?p=proj/log-analysis.git;a=summary
[3] http://flask.pocoo.org/
[4] http://code.google.com/p/protobuf/
^ permalink raw reply [relevance 99%]
Results 1-1 of 1 | reverse | options above
-- pct% links below jump to the message on this page, permalinks otherwise --
2013-07-05 0:48 99% [gentoo-soc] Log collection and analysis: report for 6.25-7.04 Antanas Uršulis
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox