Dataset not found (asia-northeast1)

[ashishtilara]

Environments

• fluentd version: fluent/fluentd:v1.1.0
• plugin version: fluent-plugin-bigquery-1.2.0

Expected Behavior

The dataset is created in asia-northeast1, I cannot find a way to specify the location so I assume the plugin is trying to push to default region.

Actual Behavior

failed to flush the buffer, and hit limit for retries. dropping all chunks in the buffer queue. retry_times=0 records=7 error_class=Fluent::BigQuery::UnRetryableError error="notFound: Not found: Dataset <PROJECT>:<DATASET>"

Log (if you have)

2018-08-15 00:53:08 +0000 [error]: #0 job.load API project_id="<PROJECT>" dataset="<DATASET>" table="<TABLE>" code=404 message="notFound: Not found: Dataset river-<PROJECT>:<DATASET>" reason=nil
2018-08-15 00:53:08 +0000 [error]: #0 failed to flush the buffer, and hit limit for retries. dropping all chunks in the buffer queue. retry_times=0 records=7 error_class=Fluent::BigQuery::UnRetryableError error="notFound: Not found: Dataset <PROJECT>:<DATASET>"
  2018-08-15 00:53:08 +0000 [error]: #0 /usr/lib/ruby/gems/2.4.0/gems/fluent-plugin-bigquery-1.2.0/lib/fluent/plugin/bigquery/writer.rb:195:in `rescue in create_load_job'
  2018-08-15 00:53:08 +0000 [error]: #0 /usr/lib/ruby/gems/2.4.0/gems/fluent-plugin-bigquery-1.2.0/lib/fluent/plugin/bigquery/writer.rb:128:in `create_load_job'
  2018-08-15 00:53:08 +0000 [error]: #0 /usr/lib/ruby/gems/2.4.0/gems/fluent-plugin-bigquery-1.2.0/lib/fluent/plugin/out_bigquery.rb:453:in `block in load'
  2018-08-15 00:53:08 +0000 [error]: #0 /usr/lib/ruby/gems/2.4.0/gems/fluent-plugin-bigquery-1.2.0/lib/fluent/plugin/out_bigquery.rb:485:in `block in create_upload_source'
  2018-08-15 00:53:08 +0000 [error]: #0 /usr/lib/ruby/gems/2.4.0/gems/fluent-plugin-bigquery-1.2.0/lib/fluent/plugin/out_bigquery.rb:484:in `open'
  2018-08-15 00:53:08 +0000 [error]: #0 /usr/lib/ruby/gems/2.4.0/gems/fluent-plugin-bigquery-1.2.0/lib/fluent/plugin/out_bigquery.rb:484:in `create_upload_source'
  2018-08-15 00:53:08 +0000 [error]: #0 /usr/lib/ruby/gems/2.4.0/gems/fluent-plugin-bigquery-1.2.0/lib/fluent/plugin/out_bigquery.rb:452:in `load'
  2018-08-15 00:53:08 +0000 [error]: #0 /usr/lib/ruby/gems/2.4.0/gems/fluent-plugin-bigquery-1.2.0/lib/fluent/plugin/out_bigquery.rb:446:in `_write'
  2018-08-15 00:53:08 +0000 [error]: #0 /usr/lib/ruby/gems/2.4.0/gems/fluent-plugin-bigquery-1.2.0/lib/fluent/plugin/out_bigquery.rb:340:in `write'
  2018-08-15 00:53:08 +0000 [error]: #0 /usr/lib/ruby/gems/2.4.0/gems/fluentd-1.1.0/lib/fluent/plugin/output.rb:1094:in `try_flush'
  2018-08-15 00:53:08 +0000 [error]: #0 /usr/lib/ruby/gems/2.4.0/gems/fluentd-1.1.0/lib/fluent/plugin/output.rb:1319:in `flush_thread_run'
  2018-08-15 00:53:08 +0000 [error]: #0 /usr/lib/ruby/gems/2.4.0/gems/fluentd-1.1.0/lib/fluent/plugin/output.rb:439:in `block (2 levels) in start'
  2018-08-15 00:53:08 +0000 [error]: #0 /usr/lib/ruby/gems/2.4.0/gems/fluentd-1.1.0/lib/fluent/plugin_helper/thread.rb:78:in `block in thread_create'