open-contracting / kingfisher-collect

93%

main: 93%

LAST BUILD ON BRANCH 1163-links-spider-failure-case

branch: 1163-links-spider-failure-case

CHANGE BRANCH

x

Reset

• 1163-links-spider-failure-case
• 1000-australia-nsw-dates
• 1006-netherlands
• 1009-nigeria-nocopo-update
• 1013-honduras-oncae-update
• 1028-italy-ocid
• 1040-albania-kpp
• 1051-dominican-republic-update
• 1053-fix-zambia
• 1054-mexico-quien-es-quien-fixes
• 1056-moldova-errors
• 1058-filter-invalid
• 1059-mexico-plataforma-digital-nacional
• 1060-assam-cdl
• 1077-italy-ministry-of-transport
• 1080-kingfisher-process-update
• 1088-guatemala
• 1091-rwanda
• 1100-fix-nuevo-leon
• 1100-fix-nuevo-leon-infra
• 1103-chile-obras
• 1120-fix-peru
• 1125-mexico-aguascalientes
• 1127-italy-anac-fix
• 1144-stop-sending-fileerrors
• 1151-uk-fts-fix
• 1171-liberia
• 1172-tanzania
• 1179-portland
• 1180-brazil-medicamentos-transparentes
• 1187-update-dr-dgcp
• 125-update_honduras_scrapers
• 126-comment
• 126-deploy
• 154-fix-buenos-aires
• 277-store-files-extension
• 279-add-sentry-logging
• 283-last-release-date
• 292-treq
• 297-kingfisher-process-integration-doc
• 307-remove-fileinfos
• 312-pluck-max-bytes
• 329-data-types
• 337-index-spider
• 346-add-date-args
• 346-add-date-filters
• 346-date
• 346-moldova
• 346-updates
• 347-add_docstrings
• 347-add_docstrings_2
• 348-poland
• 349-upgrade-scrapy
• 375-chile-bulk-fix
• 376-colombia-bulk-use-zipspider
• 378-paraguay-date-until
• 380-ocds-version-used
• 391-mexico
• 395-non-unique-files-warning
• 399_australia_pagination
• 403-json-schema-validate
• 405_EuropeanDynamicsSpider
• 407-periodic-spider
• 412-links-spider
• 412-update-links-spider
• 414-honduras
• 415-update-colombia
• 418-ecuador-spider
• 419-moldova-mtender
• 423-update-indonesia-doc
• 426-scotland-proactis
• 429-update_oncae_sample
• 430-fix-colombia
• 434-fix-paraguay
• 439-new-portugal
• 441-same-collection-feature
• 443-mexico-nuevo-leon
• 444-uruguay-date-parameters
• 446-paraguay-until-date
• 452-mexico-inai-portal
• 457-date-format-class-variable
• 464-remove-unused-data-types
• 465-mexico-inai-docs
• 468-fix-scotland
• 470-querystring-params
• 472-dominican_republic
• 475-budeshi
• 477-kyrgyzstan
• 478-extract-get-parameter
• 486-item-type-stats
• 489-update_ecuador
• 490-csv-bolivia
• 490-fix-domincan-republic
• 493-nicaragua-solid-waste
• 494-india
• 502-fix-portugal
• 507-zaragoza_spider
• 508_ecuador
• 513-update-date-required-spiders
• 517_refactor
• 519_costa_rica_poder_judicial
• 528-kosovo-spider
• 530-signals
• 536-test-kingfisher-process
• 538-zabuni
• 539-italy
• 545-portugal-bug
• 545-portugal-fix
• 545-update-portugal
• 546-pakistan
• 549_positive_initiative
• 550_kyrgyz_republic
• 552-update-nigeria
• 556-include-reference-to-colab
• 561-replace-year
• 562_zaragoza
• 569-update-chile
• 576-peru-compras
• 579-document-middlewares
• 585-canada-buyandsell-links
• 588-update-uk-fts
• 590-rar-zip-spider
• 591-remove-moldova-mtender
• 592-uk-1e9999-values
• 594-update-uganda
• 595-afghanistan
• 599-remove-retry-colombia
• 603-kingfisher-process-middleware-ng
• 604-data-type-fixes
• 606-compressedfiles-close
• 608-file-item-to-str
• 610-update-honduras-cost
• 612-uk-429-errors
• 616-mexico_quien_es_quien
• 618-py-warnings
• 620-big-files-spider
• 622_mexico
• 623-mexico-nuevo-leon
• 626_nigeria_budeshi
• 628-skip-pluck
• 640-moldova-urls
• 649-argentina-buenos-aires-fix
• 651-mexico-plataforma-nacional
• 659-extension-signals
• 661_tender_base
• 662-mexico-apf
• 666_mexico_nuevo_leon
• 668-australia-date-args
• 672-kingfisher-process-error
• 673-indonesia
• 673_indonesia_opentender
• 674-slovenia
• 679-duplicated-compressedfiles
• 682-validation-pipeline
• 691-mexico-yucatan
• 693-honduras-iaip
• 694_quebec
• 696_uruguay_historical
• 698-nuevo-leon-error
• 702_moldova
• 703_georgia_bulk_downloads
• 706_mexico_izai
• 706_mexico_izai_2
• 714_slovenia_bulk_downloads_documentation
• 721_croatia
• 727_mexico_idaip
• 728-concatenated-json-support
• 735_mexico_quien_es_quien
• 738-nigeria-null-releases
• 739_mexico_quien_es_quien_records
• 740-files-directory
• 742_kaduna_state
• 746-nigeria-ebonyi
• 747-mexico-IACIP
• 749-path-params-filter
• 751_ghana
• 752-update_shcp
• 760-inai-base-class
• 761_edo_state
• 763-mexico-veracruz
• 766-nigeria-cross-river
• 767_anambra_state
• 769-nigeria-abia
• 776-mexico-infoem
• 779-update_mexico_shcp
• 785-kyrgyz-spider
• 788-kenya-makueni
• 794-retry-badzip
• 796-digiwhist_base
• 797-rename-spiders
• 802-git-version
• 805-gombe-state
• 807-oaxaca
• 808-quintana-roo
• 809-cotai
• 815-nigeria-base-class
• 816-docs-updates
• 818-mexico-infocdmx
• 819-update-inai
• 821-civic-data-lab
• 822-italy
• 823-ani
• 831-ekiti-state
• 832-pika-logger
• 837-uganda
• 838_mexico_quien_es_quien_records
• 84-sample-mode
• 840-mexico-itaip
• 841-mexico-ceaip
• 845-base-spider-separate-files
• 851-oyo-state
• 852-enugu-state
• 86-armenia
• 861-change-default-to-skip-checks
• 864-nuevo-leon-records
• 864-nuevo-leon-releases
• 867-italy
• 868-exceptions-logging
• 868-spider-initialization-error
• 874_buenos_aires
• 880-sercop
• 882-paraguay-dncp
• 882-paraguay-fix
• 882_paraguay_dncp
• 882_paraguay_dncp_2
• 888-india_civic_data_lab
• 901-nigeria_ebonyi_state
• 909-peru_compras
• 913-honduras
• 917-uk_contracts_finder
• 917-uk_contracts_finder-3
• 921-dominican-republic
• 924-osun-state
• 931-plateau-state
• 934-ecuador-api
• 936-file-store-logs
• 937-output-location
• 938-sefin-api
• 941-resize-record-packages
• 942-improve-root-path-middleware
• 946-wales
• 949-nigeria-lagos-state
• 950-nigeria-kano
• 957-anambra
• 962-panama-dgcp-fix
• 968-update-uk-contracts-finder
• 972-mexico-apf
• 976-mexico-pdn
• 982-panama-bulk-fix
• 986-dominican-republic
• 988-remove-dr-bulk
• 992-germany
• 994-peru-osce
• 995-pydantic
• NG_kingfisher-process_integration
• add-tests
• add-ukraine
• add-version-to-package
• albania-historical
• async-publisher
• build-request
• change-qs-approach
• check-publication-format-doc
• command-sample
• consistent-class-attributes
• crawlall-specific-spiders
• database-custom-table-name
• database-store
• database-store-extension
• dataclasses
• delete-unavailable
• dependabot/github_actions/actions/cache-3
• dependabot/github_actions/actions/checkout-3
• dependabot/github_actions/actions/checkout-4
• dependabot/github_actions/actions/checkout-5
• dependabot/github_actions/actions/setup-python-3
• dependabot/github_actions/actions/setup-python-4
• dependabot/github_actions/actions/setup-python-5
• dependabot/github_actions/actions/setup-python-6
• dependabot/pip/pip-25.2
• dependabot/pip/requests-2.32.4
• dependabot/pip/setuptools-78.1.1
• dependabot/pip/urllib3-1.26.18
• dependabot/pip/urllib3-2.5.0
• dependabot/pip/wheel-0.38.1
• digiwhist
• docs-updates
• dryrun
• ecuador-bulk-fix
• extensions-are-instantiated-per-crawler
• failed-files-store-final-message
• fix-chile
• fix-chile-compra
• fix-chile-data-error-pagination
• fix-france
• fix-incremental-file-names
• fix-json-schema-validation-for-scrapyd
• fix-max-bytes
• fix-nepal_dhanghadi
• fix-poland_digiwhist
• fix-uk
• fix_costa_rica_records_scraper
• import-noqa
• incremental-support-compile-from-records
• incremental-updates
• kosovo-update
• kyrgyz-date-filter
• lapsed-spiders
• latestreleasedate-pipeline
• main
• master
• nigeria-budeshi
• no-synchronous-collection-file
• ocds-version
• panama-dgcp-961
• paraguay
• peru-osce
• pluck
• pre-commit-ci-update-config
• rabbitmq-queue
• relative-path-kingfisher-process
• remove-broken-lapsed
• remove-broken-spiders
• remove-gombe
• remove-inai
• remove-kingfisher-prefix
• remove-lapsed
• remove-old-data-types
• remove-old-spiders
• remove-pakistan
• remove-sinaloa-ceaip
• request-helpers
• required-fields
• rootpathmiddleware-limit
• rwanda-bulk
• sample_mode_directory_name
• scrapy-items
• simplify-indonesia_bandung
• simplify-pluck
• southafrica
• test-windows-macos
• twisted-failure
• uk-fts-keep-class-variables
• update-chile-incremental
• update-docs
• update-spider-template
• upgrade-jsonschema
• zaragoza_caveats

Build # 15543359004

Build Type

Pull #1166

github

Committed by yolile

Commit Message

LinksSpider: clarify error cause

Pull Request Pull Request #1166: feat: add special case for malformed JSONs in LinksSpider

Run Details

8 of 8 new or added lines in 1 file covered. (100.0%)

1469 of 1586 relevant lines covered (92.62%)

0.93 hits per line