wikimedia / parsoid / 2277

85%

push

travis-ci

<a href="https://github.com/wikimedia/parsoid/commit/c390b41ff">Reduce the batch size for pageprop requests

The default batch size is 50.  However, since redlinks are added
serially in a post-processing pass (T207279), requests call the batch api
directly rather than using the batcher, since they&#39;d otherwise sit idly
waiting for the batcher to make progress.

Although the number of titles in a query was split to match LIMIT_BIG1,
all queries were stuffed in batch, far surpassing the recommended batch
size.

This patch reduces the batch size for these requests to essentially 1,
since that&#39;s already getting info for LIMIT_BIG1 number of titles, but
allows for multiple requests to be made in parallel.

Fixes the consistent batching errors on the following and presumably
others.

~30k links
http://localhost:8000/fr.wikipedia.org/v3/page/html/Utilisateur%3AChico75%2Fpages_avec_pourcent/156246032

~40k links
http://localhost:8000/en.wiktionary.org/v3/page/html/User%3APengo%2Fobsolete_genus_list/49976305

Bug: T215537
Change-Id: I</a><a class="double-link" href="https://github.com/wikimedia/parsoid/commit/4498d5642">4498d5642</a>

9398 of 11811 branches covered (79.57%)

14814 of 17564 relevant lines covered (84.34%)

80802.46 hits per line