Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Exclude Matching Not Working as Expected #253

Closed
wesseljt opened this issue Oct 4, 2023 · 2 comments
Closed

Exclude Matching Not Working as Expected #253

wesseljt opened this issue Oct 4, 2023 · 2 comments

Comments

@wesseljt
Copy link

wesseljt commented Oct 4, 2023

When using an exclude match in my cicd env everything is getting excluded even tables I did not specify.

When running in the cicd env I would expect to see product_lines and product_lines2 but not customer_addr. Instead 0 tables are selected and everything is exlcuded.

# Env = cicd

- name: tap-postgres--rds
  load_schema: test
  select:
  - "!public-customer_addr.*"        
  config:
    start_date: ${N_HOURS_AGO} 
    host: postgres.qa.host.com
    password: ${TAP_POSTGRES__RDS_PW}



#Extractor in .yml (meltano.yml) (not env specific)

  - name: tap-postgres--rds
    inherit_from: tap-postgres
    variant: meltanolabs
    pip_url: git+https://github.com/MeltanoLabs/tap-postgres.git
    config:
      user: user
      database: test
    select:
    - public-customer_addr.*
    - public-product_lines.*
    - public-product_lines2.*

I have tested this with the sqlserver (buzzcutnorman version) tap and it works as expected.

@wesseljt
Copy link
Author

wesseljt commented Oct 4, 2023

correction - same behavior is happening with sqlserver. Maybe that is part of the design and you can't override like I am attempting here?

@wesseljt
Copy link
Author

wesseljt commented Oct 4, 2023

I don't think this is a bug - going to post something in slack to discuss a feature

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Archived in project
Development

No branches or pull requests

1 participant