treasure-data / digdag

86%

master: 12%

LAST BUILD ON BRANCH per-engine-pool-name

branch: per-engine-pool-name

CHANGE BRANCH

x

Reset

• per-engine-pool-name
• add-workflows-rest
• attempt-limit
• avoid-localparam-override
• bintray
• bundle-moment-js
• checked-limit-exceeded-errors
• cli-no-http-content-logging
• config-scope
• coveralls
• dano/bigquery-operators
• dano/bintray-fix-git-hash
• dano/cli-disable-enable-schedule-command
• dano/cli-windows-fix-selfupdate
• dano/disable-enable-schedule
• dano/handle-td-conf-parsing-failure
• dano/mail-secrets
• dano/move-archiving-to-server
• dano/s3-wait-handle-netsplits
• dano/s3-wait-operator
• dano/secrets-remove-access-limit
• dano/secure-mail-config
• dano/td-handle-netsplits-during-result-download
• dano/td-more-netsplit-handling
• dano/td-retry-on-5xx
• dano/td-retry-redux
• dano/td-wait-handle-netsplits
• dano/td_table_export-secret-s3-access-keys
• dano/windows-cli-handle-space-in-path
• disable-enable-schedule-rest-change
• docs-td-new-ops
• eval-local-config
• example-with-moment
• exclude_toplevel_param_in_pg_op
• fix-prismjs-parsing
• http-timeout-params
• master
• not-found-on-unknown-method
• operator-context
• override-params-fix
• parsing-nested-config
• privileged-vars
• refactor-webpack-config
• remove-console-log
• remove-td-requirement
• reset-params
• rest-id-to-string
• save-ci-memory
• server-module
• success-shortcircuit
• switch-to-standard-linting
• template-supports-objects
• ui-add-workflows-page
• update-flow
• use-upsert
• v0.8.15
• v0.8.16
• v0.8.17

Exporting pool_name options for each engine

Treasure Data jobs can have pool_name option. Resource pools for Hive
and Presto are two isolated resources. So following example may not
work:

```
_export:
  td:
    database: abc
    pool_name: my_poc_presto_pool

+task1:
  td>: query1.sql
  engine: presto

+task2:
  td>: query2.sql
  engine: hive
```

This works:

```
_export:
  td:
    database: abc
    presto_pool_name: my_poc_presto_pool
    hive_pool_name: my_poc_hive_pool

+task1:
  td>: query1.sql
  engine: presto

+task2:
  td>: query2.sql
  engine: hive
```