• Home
  • Features
  • Pricing
  • Docs
  • Announcements
  • Sign In

tomasnorre / crawler / 43449756443
79%

Build:
DEFAULT BRANCH: main
Ran 13 Nov 2026 03:16PM UTC
Jobs 1
Files 52
Run time 1min
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst

13 Nov 2026 03:09PM UTC coverage: 67.299% (-4.0%) from 71.322%
43449756443

push

github

web-flow
!!! [FEATURE] Process the crawler queue with the TYPO3 message bus (#1322)

The crawler queue is no longer processed by the extension's own process
management. Each queue entry is dispatched as a CrawlUrlMessage to the
TYPO3 message bus (symfony/messenger) and crawled by CrawlUrlHandler in
a worker started with "typo3 messenger:consume".

Queue processing:
- Queue entries are still stored in tx_crawler_queue. The message only
  carries the queue id and is dispatched when the entry is added from the
  backend module, the crawler:buildQueue command or on page save.
- Scheduled entries are delayed with a DelayStamp.
- The Before/AfterQueueItemAddedEvent are dispatched by the handler.
- Re-crawling from the log module dispatches a forced message.

Priority crawling:
- Three Doctrine transports crawler_high, crawler and crawler_low.
- The transport is chosen by the sitemap_priority of the page (EXT:seo),
  re-crawls from the log module use the high priority transport.
- Run the worker with "messenger:consume crawler_high crawler crawler_low"
  to crawl high priority pages first.
- If the routing of CrawlUrlMessage is changed, e.g. to the synchronous
  "default" transport, the routing is respected.

Breaking changes:
- The crawler:processQueue command, the process backend module, the
  process status AJAX route and the table tx_crawler_process are removed,
  together with the process related extension settings.
- Removed classes: Crawler, ProcessService, ProcessRepository, the
  Process models, cleaners and manager, the Sleeper helpers, HookUtility,
  BackendModuleLinkService, AfterQueueItemAddedEventListener,
  Domain\Model\Configuration, Domain\Model\Queue, Value\CrawlAction,
  CrawlerObjectException and TimeStampException.
- Removed methods: CrawlerController::readUrl(), readUrlFromArray() and
  the deprecated drawURLs_PIfilter(), as well as the process related
  methods of QueueRepository.
- The extension requires symfony/messenger and psr/event-dispatc... (continued)

74 of 91 new or added lines in 10 files covered. (81.32%)

6 existing lines in 1 file now uncovered.

1278 of 1899 relevant lines covered (67.3%)

4.99 hits per line

Uncovered Changes

Lines Coverage ∆ File
10
80.45
-1.69% Classes/Controller/CrawlerController.php
4
0.0
0.0% Classes/Controller/Backend/BackendModuleCrawlerLogController.php
2
0.0
0.0% Classes/Controller/Backend/AbstractBackendModuleController.php
1
0.0
0.0% Classes/Controller/Backend/BackendModuleStartCrawlingController.php

Coverage Regressions

Lines Coverage ∆ File
6
0.0
-100.0% Classes/Controller/Backend/Helper/UrlBuilder.php
Jobs
ID Job ID Ran Files Coverage
1 43449756443.1 13 Nov 2026 03:10PM UTC 52
67.3
GitHub Action Run
Source Files on build 43449756443
  • Tree
  • List 52
  • Changed 7
  • Source Changed 0
  • Coverage Changed 7
Coverage ∆ File Lines Relevant Covered Missed Hits/Line
  • Back to Repo
  • 6beda1a9 on github
  • Prev Build on main (#43405165794)
  • Next Build on main (#43461080850)
STATUS · Troubleshooting · Open an Issue · Sales · Support · CAREERS · ENTERPRISE · START FREE TRIAL · SCHEDULE DEMO
ANNOUNCEMENTS · TWITTER · TOS & SLA · Supported CI Services · What's a CI service? · Automated Testing

© 2026 Coveralls, Inc