catmaid / CATMAID / 6745
45%
master: 45%

LAST BUILD BRANCH: dev
DEFAULT BRANCH: master
Ran
Jobs 4
Files 107
Run time 15min
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst
6745

Pull #1887

travis-ci

web-flow 
Make concept based table IDs 64 bit

While we still have some headroom for the datasets we work with at the
moment, keeping the IDs of concept table based tables (inheritance) at
32 bit would have been a limit at some point. Already we see large
segmentation datasets that make this headroom rather small. Therefore
this migration will rewrite all concept based tables as well as tables
that reference them through foreign keys so that 64 bit IDs are used.

This migration also updates the review table to use 64 bit IDs. It also
fixes the history views of the catmaid_sampler table, which haven't been
kept up to date with column changes.

In addition a lot of missing foreign key constraints have been added.
They shouldn't have a big import on performance and in fact no real
difference could be measured.

The column order of concept changed slightly to improve the column
alignment and reduce padding. So far we wasted 4 Bytes per row, because
project_id occupied 4 Bytes and required 4 Bytes of padding, because it
was followed by a bigint. This is changed now and no more padding is
needed. This also lowers the impact on storage of the change to 64 bit
IDs.

Also, the indices backing the primary keys of many semantic tables
include now additional data like the class_id for class instances and
the relation_id for some relation instance types. This Postgres 11
feature allows to use more index-only scans.

In addition many index names follow now a more consistent pattern.

I tested this migration by multiple reviews and analyzing the schema
diff generated by pgquarrel for both migration 98 vs 99 as well as 99 vs
(99 -> 98) (i.e. a rollback). These migrations look reasonable and the
effective migration (diff) from 98 to 99 is attached at the end of this
commit message. The actual migration is more complicated, because it
cares also about column ordering, which below schema changes don't.

Fixes catmaid/CATMAID#1848

---

Effective migration 99:

ALTER SEQUENCE publ... (continued)
Pull Request #1887: Use 64 bit IDs in `concept` table

8705 of 19283 relevant lines covered (45.14%)

1.68 hits per line

Jobs
ID Job ID Ran Files Coverage
1 6745.1 0
45.15
 Travis Job 6745.1
2 6745.2 0
45.15
 Travis Job 6745.2
3 6745.3 0
45.23
 Travis Job 6745.3
4 6745.4 0
42.09
 Travis Job 6745.4
Source Files on build 6745
Detailed source file information is not available for this build.