MITLibraries / slingshot

84%

master: 93%

LAST BUILD ON BRANCH buffered-io

branch: buffered-io

CHANGE BRANCH

x

Reset

• buffered-io
• 0.2.1
• 0.2.2
• 0.3.0
• 0.3.1
• 2to3
• add-download
• adr
• auth
• aws
• bag_dir
• batch-solr
• boto-session
• bumpversion
• cli
• cli-docs
• db-options
• dependabot/pip/cryptography-3.2
• dependabot/pip/ecdsa-0.13.3
• dependabot/pip/jinja2-2.11.3
• dependabot/pip/py-1.10.0
• dependabot/pip/pyyaml-5.4
• dependabot/pip/rsa-4.1
• dependabot/pip/rsa-4.7
• deploy
• deps
• docker
• dockerignore
• docs
• exception-bug
• failure-#9
• fgdc-acl
• fgdc-keywords
• fgdc-test
• fgdc-title
• fgdc-uri
• fgdc-xml
• fix-content-type
• fix-quoting
• fix-region
• flake8
• flatten-zip
• flush-logs
• format-exc
• geoserver-adr
• geoserver-auth
• geotiff
• image-type
• init-geoserver
• int-tests
• issue-#13
• logging-#8
• marc
• marc-status
• master
• metadata
• mf-changes
• minio
• multipart
• multiple-layers
• namespace
• no-tiff
• ogc-url
• overwrite-bag
• pg-load
• pg-shapereader
• pipenv-changes
• pipenv-script
• pipenv-sys
• pipfile
• publish-all
• python-version
• raster
• record-refactor
• reindex
• rel
• rel-0.4
• rel-0.5
• rel-0.7.0
• rel-0.8
• remove-ogre
• remove-reqmts
• rename-record
• s3
• s3-marc
• schema
• security
• shapereader
• single-layer-pub
• skip-existing
• skip-loaded
• solr-commit
• streamzip
• threadsafe-session
• tiff-dir
• tiff-url
• traceback
• uni
• update-deps
• update-version
• upgrade-pip
• use-json
• uuid-unicode
• v0.2.0
• v0.2.1
• v0.2.2
• v0.3.0
• v0.3.1
• v0.4.0
• v0.5.0
• v0.5.1
• v0.6.0
• v0.7.0
• v0.8.0
• v0.9
• v0.9.0
• zipped-submission

Build # 379

Build Type

Pull #110

travis-ci

Committed by web-flow

Commit Message

Use io.BufferedReader for Postgres COPY

This fixes a few problems with the S3IO wrapper. These changes make it
possible to use the `io.BufferedReader` for the different files in the
Shapefile when loading into Postgres. Memory usage should now be fully
capped and largely controlled by the number of worker threads and size
of the `S3_BUFFER_SIZE` constant.

Pull Request Pull Request #110: Use io.BufferedReader for Postgres COPY

Run Details

11 of 11 new or added lines in 2 files covered. (100.0%)

650 of 776 relevant lines covered (83.76%)

0.84 hits per line