135
95%

Ran 06 Dec 2019 10:42AM UTC

Jobs 2

Files 35

Run time 2min

Badge

Embed ▾

pending completion

Build # 135

Build Type

push

travis-ci

Committed by

web-flow

Commit Message

Obtain account and container names from provided path in Azure Blob Storage. (#55)

* Use Azure Blob path to obtain container and account name.

When accessing Azure Blob Storage, currently we require users to provide
the `container` and `account` names as separate parameters even though
they can be found in the provided data path.

With this change it is not require to explicitly set additional
`AZURE_ACCOUNT_NAME` and `AZURE_CONTAINER_NAME` properties, these values
are obtained from `BUCKET_PATH` value.

For example, the new import statement:

```
IMPORT INTO RETAIL.SALES_POSITIONS
FROM SCRIPT ETL.IMPORT_PATH WITH
  BUCKET_PATH          = 'wasbs://<AZURE_CONTAINER_NAME>@<AZURE_ACCOUNT_NAME>.blob.core.windows.net/data/orc/*'
  AZURE_SAS_TOKEN      = '<AZURE_SAS_TOKEN>'
  DATA_FORMAT          = 'ORC'
  PARALLELISM          = 'nproc()';
```

Previously users had to set additional two properties:

```
IMPORT INTO RETAIL.SALES_POSITIONS
FROM SCRIPT ETL.IMPORT_PATH WITH
  BUCKET_PATH          = 'wasbs://<AZURE_CONTAINER_NAME>@<AZURE_ACCOUNT_NAME>.blob.core.windows.net/data/orc/*'
  DATA_FORMAT          = 'ORC'
  AZURE_ACCOUNT_NAME   = '<AZURE_ACCOUNT_NAME>'
  AZURE_CONTAINER_NAME = '<AZURE_CONTAINER_NAME>'
  AZURE_SAS_TOKEN      = '<AZURE_SAS_TOKEN>'
  PARALLELISM          = 'nproc()';
```

Fixes #50.

Run Details

804 of 823 relevant lines covered (97.69%)

1.95 hits per line

Jobs

ID	Job ID	Ran	Files	Coverage
3	135.3 (RELEASE=false)	06 Dec 2019 10:42AM UTC	0	97.69	Travis Job 135.3
4	135.4 (RELEASE=true)	06 Dec 2019 10:44AM UTC	0	97.69	Travis Job 135.4

Source Files on build 135

Detailed source file information is not available for this build.

exasol / cloud-storage-etl-udfs / 135
95%

README BADGES
x

Markdown

Textile

RDoc

HTML

Rst

Jobs

Source Files on build 135

exasol / cloud-storage-etl-udfs / 135 95%

README BADGES x

Markdown

Textile

RDoc

HTML

Rst

Jobs

Source Files on build 135

exasol / cloud-storage-etl-udfs / 135
95%

README BADGES
x