ledatelescope / bifrost / 351
61%

Ran 04 Oct 2017 06:44AM UTC

Jobs 2

Files 64

Run time 45s

Badge

pending completion

Build # 351

Build Type

push

travis-ci

Committed by

Commit Message

Ring memory logging (#100)

Added support for logging of ring metadata (space, alignment, size, etc.) and updated several of the tools to use the new information. This includes:

- a new ring directory under /dev/shm/bifrost/<pid> where the metadata is stored
- per-ring ProcLog metadata indexed by the ring name that includes:
- space - where the ring is allocated
- binding - NUMA binding, if applicable
- alignment - allocation alignment, in bytes
- ghost - size of the ghost region, in bytes
- span - size of a span, in bytes
- stride - stride size, in bytes
- nringlet - the number of ringlets in use
- updates to like_ps.py and like_top.py to work with the new structure in /dev/shm
- a new script called like_pmap.py that provides some insight into memory usage in a pipeline
- update to bifrost.ring.SpanBase.data_view() to support non-NumPy data types, i.e., 'ci4'
- small changes to some of the "like" script to help suppress VMA messages
- added a core keyword to the bifrost.ring[2].Ring.__init__() to set the NUMA binding for a ring

* Started adding simple size/stride logging to the ring buffers to help keep track of how large they are.

* Fixed a bug in ring_impl.cpp related to moving the ring information into a new 'rings' directroy. Added a catch to proclog.py to skip over 'rings' to keep most of the tools working correctly. Updated like_ps.py to display the new ring information.

* Small tweak to like_ps.py to have nicer ring sizes.

* Small fix for like_bmon.py that helps deal with a crash that sometimes occurs when the selected process disappears.

* Fixed a few problems with like_bmon.py and like_top.py when working with TF syntax pipelines.

* Added ring binding information for when BF_NUMA_ENABLED is set.

* Worked on adding a new memory usage monitoring utility for bifrost. The new script is called like_pmap.py.

* Moved from tabs to spaces in the relevant Python files.

* Converted a few mor... (continued)

Run Details

4006 of 6441 relevant lines covered (62.2%)

1.24 hits per line

Uncovered Existing Lines

Lines	Coverage	∆	File
6	100.0		/usr/local/lib/python2.7/dist-packages/bifrost-0.8.0-py2.7.egg/bifrost/proclog.py
18	100.0		/usr/local/lib/python2.7/dist-packages/bifrost-0.8.0-py2.7.egg/bifrost/ring.py
42	100.0		/usr/local/lib/python2.7/dist-packages/bifrost-0.8.0-py2.7.egg/bifrost/ring2.py
144	100.0		/usr/local/lib/python2.7/dist-packages/bifrost-0.8.0-py2.7.egg/bifrost/libbifrost_generated.py

Jobs

ID	Job ID	Ran	Files	Coverage
1	351.1	04 Oct 2017 06:44AM UTC	0	62.2	Travis Job 351.1
2	351.2	04 Oct 2017 06:45AM UTC	0	62.2	Travis Job 351.2

Source Files on build 351

Detailed source file information is not available for this build.