berkmancenter / mediacloud / 5657
61%
master: 70%

LAST BUILD BRANCH: release
DEFAULT BRANCH: master
Ran
Jobs 4
Files 383
Run time 923min
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst
5657

Pull #473

travis-ci

web-flow 
Remove extractor tag set / tag caching

Doesn't work when unit tests get run in the same process so some tests fail when being run in a specific sequence.
Pull Request #473: Rewrite extractor's codepath to Python

994 of 994 new or added lines in 38 files covered. (100.0%)

14065 of 22654 relevant lines covered (62.09%)

316.1 hits per line

New Missed Lines in Diff

Lines Coverage ∆ File
1
12.75
 0.29% lib/MediaWords/Controller/Admin/Media.pm
1
6.14
 0.08% lib/MediaWords/Controller/Admin/TM.pm
1
94.12
 0.37% lib/MediaWords/Controller/Api/V2/Util.pm
1
27.27
 0.0% lib/MediaWords/Crawler/Download/Content.pm
1
87.5
 9.38% lib/MediaWords/Job/ExtractAndVector.pm
1
89.73
 0.0% lib/MediaWords/Solr.pm
1
80.35
 0.23% lib/MediaWords/Solr/WordCounts.pm
1
96.25
 0.1% mediacloud/mediawords/tm/extract_story_links.py
2
100.0
 0.0% lib/MediaWords/Controller/Api/V2/Downloads.pm
2
78.43
 -1.57% lib/MediaWords/Crawler/Download/DefaultHandler.pm
3
79.23
 0.16% lib/MediaWords/Controller/Api/V2/Topics/Stories.pm
4
10.38
 -0.06% lib/MediaWords/Controller/Search.pm
5
10.98
 0.34% lib/MediaWords/Controller/Admin/Stories.pm
5
96.0
 -0.3% lib/MediaWords/DBI/Stories/ExtractorArguments.pm
5
56.7
 0.0% lib/MediaWords/TM/Mine.pm
5
85.29
 mediacloud/mediawords/dbi/stories/extractor_arguments.py
5
84.85
 mediacloud/mediawords/dbi/stories/process.py
6
20.51
 0.26% lib/MediaWords/Controller/Admin/Downloads.pm
6
88.0
 mediacloud/mediawords/dbi/stories/extract.py
8
94.79
 0.48% mediacloud/mediawords/dbi/downloads.py
10
86.79
 -0.55% lib/MediaWords/Controller/Api/V2/StoriesBase.pm
10
92.91
 mediacloud/mediawords/story_vectors.py
13
85.06
 mediacloud/mediawords/dbi/stories/stories.py
18
59.17
 -4.33% lib/MediaWords/DBI/Stories.pm
22
84.06
 mediacloud/mediawords/dbi/stories/ap.py
46
0.0
 mediacloud/mediawords/job/extract_and_vector.py
51
46.32
 mediacloud/mediawords/test/data.py
53
61.03
 mediacloud/mediawords/test/db/create.py

Uncovered Existing Lines

Lines Coverage ∆ File
1
64.29
 0.0% lib/MediaWords/Job/RescrapeMedia.pm
1
100.0
 0.0% lib/MediaWords/ActionRole/StoriesEditAuthenticated.pm
1
92.77
 0.0% lib/MediaWords/Feed/Parse/SyndicatedFeed.pm
1
95.45
 0.0% lib/MediaWords/DBI/Auth/Register.pm
1
100.0
 0.0% lib/MediaWords/ActionRole/MediaEditAuthenticated.pm
1
20.51
 0.26% lib/MediaWords/Controller/Admin/Downloads.pm
2
51.85
 0.0% lib/MediaWords/Controller/Api/V2/Topics/Focal_Sets.pm
2
100.0
 0.0% lib/MediaWords/Controller/Api/V2/Stories_Public.pm
2
75.68
 0.0% lib/MediaWords/CommonLibs.pm
2
43.33
 0.0% lib/MediaWords/Controller/Api/V2/Topics/Timespans.pm
2
39.13
 0.0% lib/MediaWords/Controller/Api/V2/Topics/Permissions.pm
2
66.67
 0.0% lib/MediaWords/Controller/Api/V2/Topics/Sentences.pm
2
100.0
 0.0% lib/HTML/FormFu/Unicode.pm
2
100.0
 0.0% lib/MediaWords/Languages/en.pm
2
100.0
 0.0% lib/MediaWords/Languages/Language.pm
2
70.0
 0.0% lib/MediaWords/Controller/Api/V2/Topics/Foci.pm
2
70.37
 0.0% lib/MediaWords/Controller/Api/V2/Topics/Wc.pm
2
100.0
 0.0% lib/MediaWords/Controller/Api/V2/Controversies.pm
3
94.12
 0.0% lib/MediaWords/Languages/Language/PythonWrapper.pm
3
100.0
 0.0% lib/MediaWords/Controller/Api/V2/Controversy_Dumps.pm
3
100.0
 0.0% lib/MediaWords/Util/Word2vec.pm
3
100.0
 0.0% lib/MediaWords/Controller/Api/V2/Controversy_Dump_Time_Slices.pm
3
66.23
 0.0% lib/MediaWords.pm
4
60.98
 0.0% lib/MediaWords/DBI/Auth/User/CurrentUser.pm
4
96.0
 -0.3% lib/MediaWords/DBI/Stories/ExtractorArguments.pm
4
40.38
 0.0% lib/MediaWords/Controller/Api/V2/Topics/Focus_Definitions.pm
4
94.12
 0.37% lib/MediaWords/Controller/Api/V2/Util.pm
4
100.0
 0.0% lib/MediaWords/Controller/Api/V2/Stats.pm
4
43.18
 0.0% lib/MediaWords/Controller/Api/V2/Topics/Focal_Set_Definitions.pm
4
84.48
 0.0% lib/MediaWords/Controller/Api/V2/MC_Controller_REST.pm
5
93.58
 0.02% lib/MediaWords/Solr/Dump.pm
5
100.0
 0.0% lib/MediaWords/Crawler/Download/Feed/FeedHandler.pm
5
30.0
 0.0% lib/MediaWords/Util/Mail/Message.pm
6
89.47
 0.0% lib/MediaWords/Util/Mail.pm
6
45.45
 0.0% lib/MediaWords/Util/Process.pm
6
100.0
 0.0% lib/MediaWords/Util/Word2vec/SnapshotDatabaseModelStore.pm
7
85.71
 0.0% lib/MediaWords/Util/Mail/Message/Templates/AuthActivatedMessage.pm
7
67.86
 0.0% lib/MediaWords/DBI/Auth/Profile.pm
7
85.71
 0.0% lib/MediaWords/Util/Mail/Message/Templates/AuthPasswordChangedMessage.pm
7
85.71
 0.0% lib/MediaWords/Util/Mail/Message/Templates/AuthAPIKeyResetMessage.pm
7
100.0
 0.0% lib/MediaWords/Controller/Api/V2/Downloads.pm
7
100.0
 0.0% lib/MediaWords/Util/Timing.pm
8
23.75
 -5.46% lib/MediaWords/Util/Tags.pm
8
100.0
 0.0% lib/MediaWords/TM/GuessDate/Result.pm
8
60.87
 0.0% lib/MediaWords/DBI/Media/Lookup.pm
8
81.25
 0.0% lib/MediaWords/Util/Mail/Message/Templates/AuthResetPasswordMessage.pm
9
77.78
 0.0% lib/MediaWords/Util/Mail/Message/Templates/TopicSpiderUpdateMessage.pm
9
92.19
 0.0% lib/MediaWords/Util/Python.pm
9
77.78
 0.0% lib/MediaWords/Util/Mail/Message/Templates/AuthActivationNeededMessage.pm
11
68.0
 -8.0% lib/MediaWords/Util/Annotator/NYTLabels.pm
11
68.0
 -8.0% lib/MediaWords/Util/Annotator/CLIFF.pm
11
95.65
 0.0% lib/MediaWords/KeyValueStore/PostgreSQL.pm
11
17.69
 0.0% lib/MediaWords/Controller/Login.pm
11
96.15
 0.0% lib/MediaWords/KeyValueStore/AmazonS3.pm
12
95.45
 0.0% lib/MediaWords/TM/GuessDate.pm
12
100.0
 0.0% lib/MediaWords/Job/TM/SnapshotTopic.pm
13
100.0
 0.0% lib/MediaWords/Crawler/Download/Feed/Syndicated.pm
14
19.59
 0.0% lib/MediaWords/DBI/Media.pm
15
95.83
 0.0% lib/MediaWords/Job/TM/MineTopic.pm
16
85.19
 0.0% lib/MediaWords/Feed/Parse.pm
18
96.15
 0.0% lib/MediaWords/Util/DateTime.pm
19
94.87
 0.0% lib/MediaWords/Util/Text.pm
23
26.36
 0.0% lib/MediaWords/DBI/Activities.pm
23
100.0
 0.0% lib/MediaWords/Util/Web/UserAgent.pm
25
60.87
 0.0% lib/MediaWords/Controller/Api/V2/Sentences.pm
27
80.35
 0.23% lib/MediaWords/Solr/WordCounts.pm
27
87.88
 0.0% lib/MediaWords/ActionRole/AbstractAuthenticatedActionRole.pm
29
87.5
 0.0% lib/MediaWords/Util/CSV.pm
30
100.0
 0.0% lib/MediaWords/Solr/TagCounts.pm
31
54.65
 0.0% lib/MediaWords/Solr/PseudoQueries.pm
33
62.69
 0.0% lib/MediaWords/TM.pm
36
79.25
 0.0% lib/MediaWords/DBI/ApiLinks.pm
36
94.8
 0.0% lib/MediaWords/Feed/Scrape.pm
37
60.26
 0.0% lib/MediaWords/Crawler/Downloads_Queue.pm
40
100.0
 0.0% lib/MediaWords/Controller/Api/V2/Feeds.pm
40
78.95
 0.0% lib/MediaWords/DBI/Stories/GuessDate.pm
41
36.81
 0.0% lib/MediaWords/TM/Model.pm
44
69.33
 0.0% lib/MediaWords/Util/Web/Cache.pm
45
93.85
 0.0% lib/MediaWords/Controller/Api/V2/Topics/Snapshots.pm
47
89.06
 0.0% lib/MediaWords/Controller/Api/V2/Tags.pm
48
69.47
 0.0% lib/MediaWords/Controller/Api/V2/Topics/Media.pm
48
64.29
 1.43% lib/MediaWords/DB/HandlerProxy.pm
65
70.91
 0.0% lib/MediaWords/Util/Facebook.pm
70
68.95
 0.0% lib/MediaWords/Controller/Api/V2/MC_REST_SimpleObject.pm
72
89.25
 0.0% lib/MediaWords/Crawler/Provider.pm
75
88.99
 0.0% lib/MediaWords/Controller/Api/V2/Stories.pm
80
79.23
 0.16% lib/MediaWords/Controller/Api/V2/Topics/Stories.pm
86
92.86
 0.0% lib/MediaWords/AbstractJob.pm
90
89.92
 0.0% lib/MediaWords/Crawler/Download/Feed/Univision.pm
101
59.17
 -4.33% lib/MediaWords/DBI/Stories.pm
111
86.79
 -0.55% lib/MediaWords/Controller/Api/V2/StoriesBase.pm
134
89.73
 0.0% lib/MediaWords/Solr.pm
136
70.87
 0.0% lib/MediaWords/Crawler/Engine.pm
167
96.39
 0.0% lib/MediaWords/Controller/Api/V2/Topics.pm
174
89.59
 0.0% lib/MediaWords/Controller/Api/V2/Media.pm
270
56.21
 0.0% lib/MediaWords/TM/Snapshot.pm
351
56.7
 0.0% lib/MediaWords/TM/Mine.pm
Jobs
ID Job ID Ran Files Coverage
1 5657.1 (MC_TEST_CHUNK=1) 341
57.54
 Travis Job 5657.1
2 5657.2 (MC_TEST_CHUNK=2) 341
51.69
 Travis Job 5657.2
3 5657.3 (MC_TEST_CHUNK=3) 383
52.82
 Travis Job 5657.3
4 5657.4 (MC_TEST_CHUNK=4) 338
56.0
 Travis Job 5657.4
Source Files on build 5657