Skip to content

twitter_comments: new stream to extract comments #37

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 3 commits into
base: master
Choose a base branch
from

Conversation

c200bzh
Copy link
Contributor

@c200bzh c200bzh commented Jun 16, 2025

Related to https://github.com/status-im/data-docs/issues/54

Creation of a new stream to extract comments under our tweets.

We are filtering out response by our own accounts and retweets.
We are looking at answers on the tweets created on the last 2 days by default (this can be changed in Airbyte parameters).

Working Airbyte extractions for Logos account

@c200bzh c200bzh requested a review from a team June 16, 2025 11:50
@c200bzh c200bzh self-assigned this Jun 16, 2025
@c200bzh c200bzh added the connector Issue data extraction label Jun 16, 2025
@c200bzh c200bzh changed the title tweeter_comments: new stream to extract comments twiter_comments: new stream to extract comments Jun 16, 2025
@c200bzh c200bzh changed the title twiter_comments: new stream to extract comments twitter_comments: new stream to extract comments Jun 16, 2025
apentori
apentori previously approved these changes Jun 16, 2025
Copy link
Collaborator

@apentori apentori left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good, just it would be better to setup the filtered list as a parameter.

Why filter it in Airbyte and not DBT ?
Making it in DBT would allow us to have the data, which could always be usefull. Wdyt ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
connector Issue data extraction
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants