ICRAR / ngas / 429
69%
master: 69%

LAST BUILD BRANCH: config_use_prepared_stmts_for_clients
DEFAULT BRANCH: master
Ran
Jobs 7
Files 163
Run time 13min
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst
429

push

travis-ci

rtobar 
Deal correctly with errors when archiving logfiles

Before logfiles are rotated (i.e., removed) a series of processing tasks
are performed onto them. Among these, the first one is to archive the
logfile into the NGAS server itself, if the server has been configured
for this. During normal operations this is not a problem, but exactly on
the first try, when the janitor process has just been created and the
HTTP server might not be bound yet, it might result on an ECONNREFUSED
error. This produced big error messages on the logs, while in reality
this is a transient error that should disappear on the next try.

A second, more general problem, was found while inspecting this code:
logfiles were not renamed back to have their original ".unsaved"
extensions when errors happened. This meant that when errors in general
were found (and in particular when ECONNREFUSED was raised) logfiles
were not picked up by successive janitor cycles.

This commit acknowledges these problems, improving the handling of the
ECONNREFUSED error in particular, and of errors in general. On the on
hand, when the ECONNREFUSED error is encountered we simply issue a
warning log statement instead of letting the exception to propagate up
through the stack. On the other hand, if *any* error happens during
archiving we rename the file back to its original *.unsaved name so it
gets picked up again in the next janitor cycle.

To make code and error handling a bit simpler I took the chance of
moving the archiving of files into a separate try_archiving() function,
whose invocation is then surrounded by the error handling block.
Additionally I also added a sorted() call to process unsaved logfiles in
time order, which until now wasn't guaranteed (and is a nice property to
have).

This commit addresses #26.

Signed-off-by: Rodrigo Tobar <rtobar@icrar.org>

13334 of 19451 relevant lines covered (68.55%)

4.78 hits per line

Jobs
ID Job ID Ran Files Coverage
1 429.1 (DB=sqlite3) 0
68.22
 Travis Job 429.1
2 429.2 (DB=mysql) 0
68.31
 Travis Job 429.2
3 429.3 (DB=postgresql) 0
68.26
 Travis Job 429.3
4 429.4 0
68.25
 Travis Job 429.4
5 429.5 0
68.28
 Travis Job 429.5
6 429.6 0
68.34
 Travis Job 429.6
7 429.7 0
68.3
 Travis Job 429.7
Source Files on build 429
Detailed source file information is not available for this build.