Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

dag to scrape and save the current ridership URL from the NTD portal #3545

Merged
merged 18 commits into from
Nov 26, 2024
Merged

dag to scrape and save the current ridership URL from the NTD portal #3545

merged 18 commits into from
Nov 26, 2024

Commits on Nov 26, 2024

  1. dag to scrape the current ridership URL from the NTD portal

    @charlie-costanzo
    charlie-costanzo committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    51db7d0 View commit details
    Browse the repository at this point in the history

  2. fix naming and add some descriptions

    @charlie-costanzo
    charlie-costanzo committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    d455622 View commit details
    Browse the repository at this point in the history

  3. reconfigured airflow dag setup for dependencies and special handling

    @charlie-costanzo
    charlie-costanzo committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    1483a30 View commit details
    Browse the repository at this point in the history

  4. test storing variables in xcoms

    @charlie-costanzo
    charlie-costanzo committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    a9be8a7 View commit details
    Browse the repository at this point in the history

  5. cleaned up imports

    @charlie-costanzo
    charlie-costanzo committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    d475762 View commit details
    Browse the repository at this point in the history

  6. rebase

    @charlie-costanzo
    charlie-costanzo committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    e7dd9d4 View commit details
    Browse the repository at this point in the history

  7. remove and reorganize some lingering and unnecessary code and test

    @charlie-costanzo
    charlie-costanzo committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    33069ca View commit details
    Browse the repository at this point in the history

  8. linter not working

    @charlie-costanzo
    charlie-costanzo committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    c2dd5c5 View commit details
    Browse the repository at this point in the history

  9. refactor lambda for flake8

    @charlie-costanzo
    charlie-costanzo committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    0c4e243 View commit details
    Browse the repository at this point in the history

  10. flake8 config change

    @charlie-costanzo
    charlie-costanzo committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    d9d8025 View commit details
    Browse the repository at this point in the history

  11. flake8 config change again

    @charlie-costanzo
    charlie-costanzo committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    67c0345 View commit details
    Browse the repository at this point in the history

  12. create function of url finder

    @charlie-costanzo
    charlie-costanzo committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    160c2ba View commit details
    Browse the repository at this point in the history

  13. add comment for flake8 suppression

    @charlie-costanzo
    charlie-costanzo committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    de8286e View commit details
    Browse the repository at this point in the history

  14. accidentally pushed copy file

    @charlie-costanzo
    charlie-costanzo committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    7120ef6 View commit details
    Browse the repository at this point in the history

  15. suppress whitespace after colon error

    @charlie-costanzo
    charlie-costanzo committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    bb53d45 View commit details
    Browse the repository at this point in the history

  16. last pass at configuration changes

    @charlie-costanzo
    charlie-costanzo committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    04e2177 View commit details
    Browse the repository at this point in the history

  17. suppress whitespace after colon error

    @charlie-costanzo
    charlie-costanzo committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    6afce23 View commit details
    Browse the repository at this point in the history

  18. remove testing comments, clean up changed files

    @charlie-costanzo
    charlie-costanzo committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    7eefb94 View commit details
    Browse the repository at this point in the history