Skip to content

Commit

Permalink
test13
Browse files Browse the repository at this point in the history
  • Loading branch information
@lsh0107
lsh0107 committed Jan 6, 2024
1 parent 4953cfb commit 213b3dd
Show file tree
Hide file tree
Showing 46 changed files with 1,644 additions and 0 deletions.
Binary file added dags/__pycache__/HelloWorld.cpython-37.pyc
View file
Binary file not shown.
Binary file added dags/__pycache__/HelloWorld_v2.cpython-37.pyc
View file
Binary file not shown.
0 docker-compose.yaml → docker-compose.test.yaml
View file
File renamed without changes.
197 changes: 197 additions & 0 deletions logs/dag_processor_manager/dag_processor_manager.log
View file

Large diffs are not rendered by default.

32 changes: 32 additions & 0 deletions logs/scheduler/2024-01-06/HelloWorld.py.log
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,32 @@
[2024-01-06T09:11:10.548+0000] {processor.py:153} INFO - Started process (PID=84) to work on /opt/airflow/dags/HelloWorld.py
[2024-01-06T09:11:10.548+0000] {processor.py:743} INFO - Processing file /opt/airflow/dags/HelloWorld.py for tasks to queue
[2024-01-06T09:11:10.550+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:11:10.549+0000] {dagbag.py:538} INFO - Filling up the DagBag from /opt/airflow/dags/HelloWorld.py
[2024-01-06T09:11:10.577+0000] {processor.py:753} INFO - DAG(s) dict_keys(['HelloWorld']) retrieved from /opt/airflow/dags/HelloWorld.py
[2024-01-06T09:11:10.688+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:11:10.688+0000] {manager.py:504} INFO - Created Permission View: can edit on DAG:HelloWorld
[2024-01-06T09:11:10.694+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:11:10.694+0000] {manager.py:504} INFO - Created Permission View: can read on DAG:HelloWorld
[2024-01-06T09:11:10.700+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:11:10.700+0000] {manager.py:504} INFO - Created Permission View: can delete on DAG:HelloWorld
[2024-01-06T09:11:10.700+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:11:10.700+0000] {dag.py:2690} INFO - Sync 1 DAGs
[2024-01-06T09:11:10.707+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:11:10.707+0000] {dag.py:2711} INFO - Creating ORM DAG for HelloWorld
[2024-01-06T09:11:10.714+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:11:10.714+0000] {dag.py:3441} INFO - Setting next_dagrun for HelloWorld to 2024-01-05T02:00:00+00:00, run_after=2024-01-06T02:00:00+00:00
[2024-01-06T09:11:10.723+0000] {processor.py:175} INFO - Processing /opt/airflow/dags/HelloWorld.py took 0.177 seconds
[2024-01-06T09:11:41.730+0000] {processor.py:153} INFO - Started process (PID=164) to work on /opt/airflow/dags/HelloWorld.py
[2024-01-06T09:11:41.731+0000] {processor.py:743} INFO - Processing file /opt/airflow/dags/HelloWorld.py for tasks to queue
[2024-01-06T09:11:41.732+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:11:41.732+0000] {dagbag.py:538} INFO - Filling up the DagBag from /opt/airflow/dags/HelloWorld.py
[2024-01-06T09:11:41.743+0000] {processor.py:753} INFO - DAG(s) dict_keys(['HelloWorld']) retrieved from /opt/airflow/dags/HelloWorld.py
[2024-01-06T09:11:41.759+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:11:41.759+0000] {dag.py:2690} INFO - Sync 1 DAGs
[2024-01-06T09:11:41.773+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:11:41.773+0000] {dag.py:3441} INFO - Setting next_dagrun for HelloWorld to 2024-01-05T02:00:00+00:00, run_after=2024-01-06T02:00:00+00:00
[2024-01-06T09:11:41.782+0000] {processor.py:175} INFO - Processing /opt/airflow/dags/HelloWorld.py took 0.055 seconds
[2024-01-06T09:12:11.911+0000] {processor.py:153} INFO - Started process (PID=245) to work on /opt/airflow/dags/HelloWorld.py
[2024-01-06T09:12:11.912+0000] {processor.py:743} INFO - Processing file /opt/airflow/dags/HelloWorld.py for tasks to queue
[2024-01-06T09:12:11.913+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:12:11.913+0000] {dagbag.py:538} INFO - Filling up the DagBag from /opt/airflow/dags/HelloWorld.py
[2024-01-06T09:12:11.932+0000] {processor.py:753} INFO - DAG(s) dict_keys(['HelloWorld']) retrieved from /opt/airflow/dags/HelloWorld.py
[2024-01-06T09:12:11.950+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:12:11.950+0000] {dag.py:2690} INFO - Sync 1 DAGs
[2024-01-06T09:12:11.965+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:12:11.964+0000] {dag.py:3441} INFO - Setting next_dagrun for HelloWorld to 2024-01-05T02:00:00+00:00, run_after=2024-01-06T02:00:00+00:00
[2024-01-06T09:12:11.973+0000] {processor.py:175} INFO - Processing /opt/airflow/dags/HelloWorld.py took 0.068 seconds
[2024-01-06T09:12:42.625+0000] {processor.py:153} INFO - Started process (PID=334) to work on /opt/airflow/dags/HelloWorld.py
[2024-01-06T09:12:42.627+0000] {processor.py:743} INFO - Processing file /opt/airflow/dags/HelloWorld.py for tasks to queue
[2024-01-06T09:12:42.628+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:12:42.628+0000] {dagbag.py:538} INFO - Filling up the DagBag from /opt/airflow/dags/HelloWorld.py
[2024-01-06T09:12:42.646+0000] {processor.py:753} INFO - DAG(s) dict_keys(['HelloWorld']) retrieved from /opt/airflow/dags/HelloWorld.py
[2024-01-06T09:12:42.666+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:12:42.665+0000] {dag.py:2690} INFO - Sync 1 DAGs
[2024-01-06T09:12:42.680+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:12:42.680+0000] {dag.py:3441} INFO - Setting next_dagrun for HelloWorld to 2024-01-05T02:00:00+00:00, run_after=2024-01-06T02:00:00+00:00
[2024-01-06T09:12:42.689+0000] {processor.py:175} INFO - Processing /opt/airflow/dags/HelloWorld.py took 0.069 seconds
32 changes: 32 additions & 0 deletions logs/scheduler/2024-01-06/HelloWorld_v2.py.log
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,32 @@
[2024-01-06T09:11:10.550+0000] {processor.py:153} INFO - Started process (PID=85) to work on /opt/airflow/dags/HelloWorld_v2.py
[2024-01-06T09:11:10.551+0000] {processor.py:743} INFO - Processing file /opt/airflow/dags/HelloWorld_v2.py for tasks to queue
[2024-01-06T09:11:10.551+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:11:10.551+0000] {dagbag.py:538} INFO - Filling up the DagBag from /opt/airflow/dags/HelloWorld_v2.py
[2024-01-06T09:11:10.588+0000] {processor.py:753} INFO - DAG(s) dict_keys(['HelloWorld_v2']) retrieved from /opt/airflow/dags/HelloWorld_v2.py
[2024-01-06T09:11:10.688+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:11:10.688+0000] {manager.py:504} INFO - Created Permission View: can edit on DAG:HelloWorld_v2
[2024-01-06T09:11:10.694+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:11:10.694+0000] {manager.py:504} INFO - Created Permission View: can read on DAG:HelloWorld_v2
[2024-01-06T09:11:10.701+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:11:10.701+0000] {manager.py:504} INFO - Created Permission View: can delete on DAG:HelloWorld_v2
[2024-01-06T09:11:10.701+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:11:10.701+0000] {dag.py:2690} INFO - Sync 1 DAGs
[2024-01-06T09:11:10.707+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:11:10.707+0000] {dag.py:2711} INFO - Creating ORM DAG for HelloWorld_v2
[2024-01-06T09:11:10.714+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:11:10.714+0000] {dag.py:3441} INFO - Setting next_dagrun for HelloWorld_v2 to 2024-01-05T02:00:00+00:00, run_after=2024-01-06T02:00:00+00:00
[2024-01-06T09:11:10.723+0000] {processor.py:175} INFO - Processing /opt/airflow/dags/HelloWorld_v2.py took 0.175 seconds
[2024-01-06T09:11:41.731+0000] {processor.py:153} INFO - Started process (PID=165) to work on /opt/airflow/dags/HelloWorld_v2.py
[2024-01-06T09:11:41.732+0000] {processor.py:743} INFO - Processing file /opt/airflow/dags/HelloWorld_v2.py for tasks to queue
[2024-01-06T09:11:41.732+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:11:41.732+0000] {dagbag.py:538} INFO - Filling up the DagBag from /opt/airflow/dags/HelloWorld_v2.py
[2024-01-06T09:11:41.748+0000] {processor.py:753} INFO - DAG(s) dict_keys(['HelloWorld_v2']) retrieved from /opt/airflow/dags/HelloWorld_v2.py
[2024-01-06T09:11:41.761+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:11:41.761+0000] {dag.py:2690} INFO - Sync 1 DAGs
[2024-01-06T09:11:41.773+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:11:41.773+0000] {dag.py:3441} INFO - Setting next_dagrun for HelloWorld_v2 to 2024-01-05T02:00:00+00:00, run_after=2024-01-06T02:00:00+00:00
[2024-01-06T09:11:41.782+0000] {processor.py:175} INFO - Processing /opt/airflow/dags/HelloWorld_v2.py took 0.053 seconds
[2024-01-06T09:12:11.916+0000] {processor.py:153} INFO - Started process (PID=246) to work on /opt/airflow/dags/HelloWorld_v2.py
[2024-01-06T09:12:11.918+0000] {processor.py:743} INFO - Processing file /opt/airflow/dags/HelloWorld_v2.py for tasks to queue
[2024-01-06T09:12:11.919+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:12:11.919+0000] {dagbag.py:538} INFO - Filling up the DagBag from /opt/airflow/dags/HelloWorld_v2.py
[2024-01-06T09:12:11.940+0000] {processor.py:753} INFO - DAG(s) dict_keys(['HelloWorld_v2']) retrieved from /opt/airflow/dags/HelloWorld_v2.py
[2024-01-06T09:12:11.955+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:12:11.955+0000] {dag.py:2690} INFO - Sync 1 DAGs
[2024-01-06T09:12:11.967+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:12:11.967+0000] {dag.py:3441} INFO - Setting next_dagrun for HelloWorld_v2 to 2024-01-05T02:00:00+00:00, run_after=2024-01-06T02:00:00+00:00
[2024-01-06T09:12:11.975+0000] {processor.py:175} INFO - Processing /opt/airflow/dags/HelloWorld_v2.py took 0.062 seconds
[2024-01-06T09:12:42.631+0000] {processor.py:153} INFO - Started process (PID=335) to work on /opt/airflow/dags/HelloWorld_v2.py
[2024-01-06T09:12:42.632+0000] {processor.py:743} INFO - Processing file /opt/airflow/dags/HelloWorld_v2.py for tasks to queue
[2024-01-06T09:12:42.633+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:12:42.633+0000] {dagbag.py:538} INFO - Filling up the DagBag from /opt/airflow/dags/HelloWorld_v2.py
[2024-01-06T09:12:42.656+0000] {processor.py:753} INFO - DAG(s) dict_keys(['HelloWorld_v2']) retrieved from /opt/airflow/dags/HelloWorld_v2.py
[2024-01-06T09:12:42.671+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:12:42.671+0000] {dag.py:2690} INFO - Sync 1 DAGs
[2024-01-06T09:12:42.684+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:12:42.684+0000] {dag.py:3441} INFO - Setting next_dagrun for HelloWorld_v2 to 2024-01-05T02:00:00+00:00, run_after=2024-01-06T02:00:00+00:00
[2024-01-06T09:12:42.692+0000] {processor.py:175} INFO - Processing /opt/airflow/dags/HelloWorld_v2.py took 0.066 seconds
32 changes: 32 additions & 0 deletions logs/scheduler/2024-01-06/native_dags/example_dags/example_bash_operator.py.log
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,32 @@
[2024-01-06T09:11:13.084+0000] {processor.py:153} INFO - Started process (PID=117) to work on /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py
[2024-01-06T09:11:13.084+0000] {processor.py:743} INFO - Processing file /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py for tasks to queue
[2024-01-06T09:11:13.085+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:11:13.085+0000] {dagbag.py:538} INFO - Filling up the DagBag from /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py
[2024-01-06T09:11:13.096+0000] {processor.py:753} INFO - DAG(s) dict_keys(['example_bash_operator']) retrieved from /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py
[2024-01-06T09:11:13.151+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:11:13.151+0000] {manager.py:504} INFO - Created Permission View: can edit on DAG:example_bash_operator
[2024-01-06T09:11:13.156+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:11:13.155+0000] {manager.py:504} INFO - Created Permission View: can read on DAG:example_bash_operator
[2024-01-06T09:11:13.158+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:11:13.158+0000] {manager.py:504} INFO - Created Permission View: can delete on DAG:example_bash_operator
[2024-01-06T09:11:13.158+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:11:13.158+0000] {dag.py:2690} INFO - Sync 1 DAGs
[2024-01-06T09:11:13.164+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:11:13.164+0000] {dag.py:2711} INFO - Creating ORM DAG for example_bash_operator
[2024-01-06T09:11:13.170+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:11:13.170+0000] {dag.py:3441} INFO - Setting next_dagrun for example_bash_operator to 2024-01-05T00:00:00+00:00, run_after=2024-01-06T00:00:00+00:00
[2024-01-06T09:11:13.178+0000] {processor.py:175} INFO - Processing /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py took 0.096 seconds
[2024-01-06T09:11:43.279+0000] {processor.py:153} INFO - Started process (PID=206) to work on /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py
[2024-01-06T09:11:43.279+0000] {processor.py:743} INFO - Processing file /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py for tasks to queue
[2024-01-06T09:11:43.280+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:11:43.280+0000] {dagbag.py:538} INFO - Filling up the DagBag from /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py
[2024-01-06T09:11:43.293+0000] {processor.py:753} INFO - DAG(s) dict_keys(['example_bash_operator']) retrieved from /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py
[2024-01-06T09:11:43.311+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:11:43.311+0000] {dag.py:2690} INFO - Sync 1 DAGs
[2024-01-06T09:11:43.324+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:11:43.324+0000] {dag.py:3441} INFO - Setting next_dagrun for example_bash_operator to 2024-01-05T00:00:00+00:00, run_after=2024-01-06T00:00:00+00:00
[2024-01-06T09:11:43.333+0000] {processor.py:175} INFO - Processing /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py took 0.057 seconds
[2024-01-06T09:12:14.066+0000] {processor.py:153} INFO - Started process (PID=278) to work on /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py
[2024-01-06T09:12:14.067+0000] {processor.py:743} INFO - Processing file /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py for tasks to queue
[2024-01-06T09:12:14.067+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:12:14.067+0000] {dagbag.py:538} INFO - Filling up the DagBag from /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py
[2024-01-06T09:12:14.079+0000] {processor.py:753} INFO - DAG(s) dict_keys(['example_bash_operator']) retrieved from /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py
[2024-01-06T09:12:14.096+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:12:14.096+0000] {dag.py:2690} INFO - Sync 1 DAGs
[2024-01-06T09:12:14.108+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:12:14.108+0000] {dag.py:3441} INFO - Setting next_dagrun for example_bash_operator to 2024-01-05T00:00:00+00:00, run_after=2024-01-06T00:00:00+00:00
[2024-01-06T09:12:14.115+0000] {processor.py:175} INFO - Processing /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py took 0.051 seconds
[2024-01-06T09:12:44.765+0000] {processor.py:153} INFO - Started process (PID=367) to work on /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py
[2024-01-06T09:12:44.766+0000] {processor.py:743} INFO - Processing file /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py for tasks to queue
[2024-01-06T09:12:44.766+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:12:44.766+0000] {dagbag.py:538} INFO - Filling up the DagBag from /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py
[2024-01-06T09:12:44.777+0000] {processor.py:753} INFO - DAG(s) dict_keys(['example_bash_operator']) retrieved from /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py
[2024-01-06T09:12:44.794+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:12:44.794+0000] {dag.py:2690} INFO - Sync 1 DAGs
[2024-01-06T09:12:44.806+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:12:44.806+0000] {dag.py:3441} INFO - Setting next_dagrun for example_bash_operator to 2024-01-05T00:00:00+00:00, run_after=2024-01-06T00:00:00+00:00
[2024-01-06T09:12:44.814+0000] {processor.py:175} INFO - Processing /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py took 0.051 seconds
Loading

0 comments on commit 213b3dd

Please sign in to comment.