wikimedia / parsoid / 2311

85%

push

travis-ci

Add ability to splice a PHP transformer into the pipeline

* I've now tested this with the QuoteTransformer and ParagraphWrapper and
  all wt2html tests pass currently with this hybrid pipeline.

  In the process,
  - fixed a few bugs in these transformers (separate patch submitted)
  - fixed JSON string -> token generation code (separate patch submitted)
  - fixed token -> JSON string output (separate patch submitted).

* The pipeline factory looks for the presence of pipeline.yaml in the root
  directory, and if present, uses that config to replace JS transformers
  with PHP transformers.

* A similar mechanism for DOM transformations is coming in a followup.

* Once this is done, we could start running parser tests as more
  transformers get ported and would help catch a lot more bugs early.

* TODO:
  - Potential performance improvements. Right now, every transformer
    in every pipeline forks a new process. If there is a chain of
    transformers that are all going to run in PHP, we might be able
    to run the entire chain of transformations in one shot.

Change-Id: Iab8088d85

9419 of 11853 branches covered (79.47%)

14818 of 17575 relevant lines covered (84.31%)

81919.65 hits per line