Skip to content

Commit

Permalink
test22
Browse files Browse the repository at this point in the history
  • Loading branch information
@lsh0107
lsh0107 committed Jan 6, 2024
1 parent 8f1d7e5 commit 1fd8f58
Show file tree
Hide file tree
Showing 44 changed files with 1,482 additions and 1 deletion.
1 change: 0 additions & 1 deletion dags/HelloWorld.py
View file
Original file line number Diff line number Diff line change
@@ -1,7 +1,6 @@
from airflow import DAG
from airflow.operators.python import PythonOperator
from datetime import datetime
import tensorflow


dag = DAG(
Expand Down
Binary file modified dags/__pycache__/HelloWorld.cpython-37.pyc
View file
Binary file not shown.
195 changes: 195 additions & 0 deletions logs/dag_processor_manager/dag_processor_manager.log
View file

Large diffs are not rendered by default.

63 changes: 63 additions & 0 deletions logs/scheduler/2024-01-06/HelloWorld.py.log
View file
Original file line number Diff line number Diff line change
Expand Up @@ -520,3 +520,66 @@ Traceback (most recent call last):
ModuleNotFoundError: No module named 'tensorflow'
[2024-01-06T09:47:04.087+0000] {processor.py:755} WARNING - No viable dags retrieved from /opt/airflow/dags/HelloWorld.py
[2024-01-06T09:47:04.104+0000] {processor.py:175} INFO - Processing /opt/airflow/dags/HelloWorld.py took 0.035 seconds
[2024-01-06T09:47:34.781+0000] {processor.py:153} INFO - Started process (PID=6148) to work on /opt/airflow/dags/HelloWorld.py
[2024-01-06T09:47:34.782+0000] {processor.py:743} INFO - Processing file /opt/airflow/dags/HelloWorld.py for tasks to queue
[2024-01-06T09:47:34.783+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:47:34.783+0000] {dagbag.py:538} INFO - Filling up the DagBag from /opt/airflow/dags/HelloWorld.py
[2024-01-06T09:47:34.793+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:47:34.791+0000] {dagbag.py:343} ERROR - Failed to import: /opt/airflow/dags/HelloWorld.py
Traceback (most recent call last):
File "/home/airflow/.local/lib/python3.7/site-packages/airflow/models/dagbag.py", line 339, in parse
loader.exec_module(new_module)
File "<frozen importlib._bootstrap_external>", line 728, in exec_module
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File "/opt/airflow/dags/HelloWorld.py", line 4, in <module>
import tensorflow
ModuleNotFoundError: No module named 'tensorflow'
[2024-01-06T09:47:34.793+0000] {processor.py:755} WARNING - No viable dags retrieved from /opt/airflow/dags/HelloWorld.py
[2024-01-06T09:47:34.811+0000] {processor.py:175} INFO - Processing /opt/airflow/dags/HelloWorld.py took 0.036 seconds
[2024-01-06T09:48:05.413+0000] {processor.py:153} INFO - Started process (PID=6230) to work on /opt/airflow/dags/HelloWorld.py
[2024-01-06T09:48:05.413+0000] {processor.py:743} INFO - Processing file /opt/airflow/dags/HelloWorld.py for tasks to queue
[2024-01-06T09:48:05.414+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:48:05.414+0000] {dagbag.py:538} INFO - Filling up the DagBag from /opt/airflow/dags/HelloWorld.py
[2024-01-06T09:48:05.418+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:48:05.418+0000] {dagbag.py:343} ERROR - Failed to import: /opt/airflow/dags/HelloWorld.py
Traceback (most recent call last):
File "/home/airflow/.local/lib/python3.7/site-packages/airflow/models/dagbag.py", line 339, in parse
loader.exec_module(new_module)
File "<frozen importlib._bootstrap_external>", line 728, in exec_module
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File "/opt/airflow/dags/HelloWorld.py", line 4, in <module>
import tensorflow
ModuleNotFoundError: No module named 'tensorflow'
[2024-01-06T09:48:05.419+0000] {processor.py:755} WARNING - No viable dags retrieved from /opt/airflow/dags/HelloWorld.py
[2024-01-06T09:48:05.429+0000] {processor.py:175} INFO - Processing /opt/airflow/dags/HelloWorld.py took 0.018 seconds
[2024-01-06T09:48:36.099+0000] {processor.py:153} INFO - Started process (PID=6310) to work on /opt/airflow/dags/HelloWorld.py
[2024-01-06T09:48:36.100+0000] {processor.py:743} INFO - Processing file /opt/airflow/dags/HelloWorld.py for tasks to queue
[2024-01-06T09:48:36.101+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:48:36.101+0000] {dagbag.py:538} INFO - Filling up the DagBag from /opt/airflow/dags/HelloWorld.py
[2024-01-06T09:48:36.114+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:48:36.112+0000] {dagbag.py:343} ERROR - Failed to import: /opt/airflow/dags/HelloWorld.py
Traceback (most recent call last):
File "/home/airflow/.local/lib/python3.7/site-packages/airflow/models/dagbag.py", line 339, in parse
loader.exec_module(new_module)
File "<frozen importlib._bootstrap_external>", line 728, in exec_module
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File "/opt/airflow/dags/HelloWorld.py", line 4, in <module>
import tensorflow
ModuleNotFoundError: No module named 'tensorflow'
[2024-01-06T09:48:36.115+0000] {processor.py:755} WARNING - No viable dags retrieved from /opt/airflow/dags/HelloWorld.py
[2024-01-06T09:48:36.130+0000] {processor.py:175} INFO - Processing /opt/airflow/dags/HelloWorld.py took 0.037 seconds
[2024-01-06T09:49:06.881+0000] {processor.py:153} INFO - Started process (PID=6399) to work on /opt/airflow/dags/HelloWorld.py
[2024-01-06T09:49:06.882+0000] {processor.py:743} INFO - Processing file /opt/airflow/dags/HelloWorld.py for tasks to queue
[2024-01-06T09:49:06.883+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:49:06.883+0000] {dagbag.py:538} INFO - Filling up the DagBag from /opt/airflow/dags/HelloWorld.py
[2024-01-06T09:49:06.888+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:49:06.888+0000] {dagbag.py:343} ERROR - Failed to import: /opt/airflow/dags/HelloWorld.py
Traceback (most recent call last):
File "/home/airflow/.local/lib/python3.7/site-packages/airflow/models/dagbag.py", line 339, in parse
loader.exec_module(new_module)
File "<frozen importlib._bootstrap_external>", line 728, in exec_module
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File "/opt/airflow/dags/HelloWorld.py", line 4, in <module>
import tensorflow
ModuleNotFoundError: No module named 'tensorflow'
[2024-01-06T09:49:06.889+0000] {processor.py:755} WARNING - No viable dags retrieved from /opt/airflow/dags/HelloWorld.py
[2024-01-06T09:49:06.902+0000] {processor.py:175} INFO - Processing /opt/airflow/dags/HelloWorld.py took 0.024 seconds
[2024-01-06T09:49:23.119+0000] {processor.py:153} INFO - Started process (PID=6417) to work on /opt/airflow/dags/HelloWorld.py
[2024-01-06T09:49:23.120+0000] {processor.py:743} INFO - Processing file /opt/airflow/dags/HelloWorld.py for tasks to queue
[2024-01-06T09:49:23.122+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:49:23.121+0000] {dagbag.py:538} INFO - Filling up the DagBag from /opt/airflow/dags/HelloWorld.py
[2024-01-06T09:49:23.142+0000] {processor.py:753} INFO - DAG(s) dict_keys(['HelloWorld']) retrieved from /opt/airflow/dags/HelloWorld.py
[2024-01-06T09:49:23.178+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:49:23.178+0000] {dag.py:2690} INFO - Sync 1 DAGs
[2024-01-06T09:49:23.188+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:49:23.188+0000] {dag.py:3441} INFO - Setting next_dagrun for HelloWorld to 2024-01-05T02:00:00+00:00, run_after=2024-01-06T02:00:00+00:00
[2024-01-06T09:49:23.198+0000] {processor.py:175} INFO - Processing /opt/airflow/dags/HelloWorld.py took 0.084 seconds
28 changes: 28 additions & 0 deletions logs/scheduler/2024-01-06/HelloWorld_v2.py.log
View file
Original file line number Diff line number Diff line change
Expand Up @@ -506,3 +506,31 @@
[2024-01-06T09:47:14.201+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:47:14.201+0000] {dag.py:2690} INFO - Sync 1 DAGs
[2024-01-06T09:47:14.213+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:47:14.213+0000] {dag.py:3441} INFO - Setting next_dagrun for HelloWorld_v2 to 2024-01-05T02:00:00+00:00, run_after=2024-01-06T02:00:00+00:00
[2024-01-06T09:47:14.222+0000] {processor.py:175} INFO - Processing /opt/airflow/dags/HelloWorld_v2.py took 0.061 seconds
[2024-01-06T09:47:44.891+0000] {processor.py:153} INFO - Started process (PID=6165) to work on /opt/airflow/dags/HelloWorld_v2.py
[2024-01-06T09:47:44.892+0000] {processor.py:743} INFO - Processing file /opt/airflow/dags/HelloWorld_v2.py for tasks to queue
[2024-01-06T09:47:44.893+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:47:44.893+0000] {dagbag.py:538} INFO - Filling up the DagBag from /opt/airflow/dags/HelloWorld_v2.py
[2024-01-06T09:47:44.916+0000] {processor.py:753} INFO - DAG(s) dict_keys(['HelloWorld_v2']) retrieved from /opt/airflow/dags/HelloWorld_v2.py
[2024-01-06T09:47:44.932+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:47:44.932+0000] {dag.py:2690} INFO - Sync 1 DAGs
[2024-01-06T09:47:44.945+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:47:44.945+0000] {dag.py:3441} INFO - Setting next_dagrun for HelloWorld_v2 to 2024-01-05T02:00:00+00:00, run_after=2024-01-06T02:00:00+00:00
[2024-01-06T09:47:44.953+0000] {processor.py:175} INFO - Processing /opt/airflow/dags/HelloWorld_v2.py took 0.067 seconds
[2024-01-06T09:48:15.516+0000] {processor.py:153} INFO - Started process (PID=6238) to work on /opt/airflow/dags/HelloWorld_v2.py
[2024-01-06T09:48:15.517+0000] {processor.py:743} INFO - Processing file /opt/airflow/dags/HelloWorld_v2.py for tasks to queue
[2024-01-06T09:48:15.518+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:48:15.518+0000] {dagbag.py:538} INFO - Filling up the DagBag from /opt/airflow/dags/HelloWorld_v2.py
[2024-01-06T09:48:15.541+0000] {processor.py:753} INFO - DAG(s) dict_keys(['HelloWorld_v2']) retrieved from /opt/airflow/dags/HelloWorld_v2.py
[2024-01-06T09:48:15.561+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:48:15.560+0000] {dag.py:2690} INFO - Sync 1 DAGs
[2024-01-06T09:48:15.575+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:48:15.575+0000] {dag.py:3441} INFO - Setting next_dagrun for HelloWorld_v2 to 2024-01-05T02:00:00+00:00, run_after=2024-01-06T02:00:00+00:00
[2024-01-06T09:48:15.584+0000] {processor.py:175} INFO - Processing /opt/airflow/dags/HelloWorld_v2.py took 0.072 seconds
[2024-01-06T09:48:46.200+0000] {processor.py:153} INFO - Started process (PID=6327) to work on /opt/airflow/dags/HelloWorld_v2.py
[2024-01-06T09:48:46.201+0000] {processor.py:743} INFO - Processing file /opt/airflow/dags/HelloWorld_v2.py for tasks to queue
[2024-01-06T09:48:46.202+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:48:46.202+0000] {dagbag.py:538} INFO - Filling up the DagBag from /opt/airflow/dags/HelloWorld_v2.py
[2024-01-06T09:48:46.223+0000] {processor.py:753} INFO - DAG(s) dict_keys(['HelloWorld_v2']) retrieved from /opt/airflow/dags/HelloWorld_v2.py
[2024-01-06T09:48:46.241+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:48:46.241+0000] {dag.py:2690} INFO - Sync 1 DAGs
[2024-01-06T09:48:46.257+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:48:46.257+0000] {dag.py:3441} INFO - Setting next_dagrun for HelloWorld_v2 to 2024-01-05T02:00:00+00:00, run_after=2024-01-06T02:00:00+00:00
[2024-01-06T09:48:46.268+0000] {processor.py:175} INFO - Processing /opt/airflow/dags/HelloWorld_v2.py took 0.071 seconds
[2024-01-06T09:49:17.025+0000] {processor.py:153} INFO - Started process (PID=6416) to work on /opt/airflow/dags/HelloWorld_v2.py
[2024-01-06T09:49:17.026+0000] {processor.py:743} INFO - Processing file /opt/airflow/dags/HelloWorld_v2.py for tasks to queue
[2024-01-06T09:49:17.026+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:49:17.026+0000] {dagbag.py:538} INFO - Filling up the DagBag from /opt/airflow/dags/HelloWorld_v2.py
[2024-01-06T09:49:17.038+0000] {processor.py:753} INFO - DAG(s) dict_keys(['HelloWorld_v2']) retrieved from /opt/airflow/dags/HelloWorld_v2.py
[2024-01-06T09:49:17.050+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:49:17.050+0000] {dag.py:2690} INFO - Sync 1 DAGs
[2024-01-06T09:49:17.061+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:49:17.061+0000] {dag.py:3441} INFO - Setting next_dagrun for HelloWorld_v2 to 2024-01-05T02:00:00+00:00, run_after=2024-01-06T02:00:00+00:00
[2024-01-06T09:49:17.069+0000] {processor.py:175} INFO - Processing /opt/airflow/dags/HelloWorld_v2.py took 0.046 seconds
28 changes: 28 additions & 0 deletions logs/scheduler/2024-01-06/native_dags/example_dags/example_bash_operator.py.log
View file
Original file line number Diff line number Diff line change
Expand Up @@ -499,3 +499,31 @@
[2024-01-06T09:47:00.808+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:47:00.808+0000] {dag.py:2690} INFO - Sync 1 DAGs
[2024-01-06T09:47:00.820+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:47:00.820+0000] {dag.py:3441} INFO - Setting next_dagrun for example_bash_operator to 2024-01-05T00:00:00+00:00, run_after=2024-01-06T00:00:00+00:00
[2024-01-06T09:47:00.828+0000] {processor.py:175} INFO - Processing /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py took 0.051 seconds
[2024-01-06T09:47:31.463+0000] {processor.py:153} INFO - Started process (PID=6131) to work on /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py
[2024-01-06T09:47:31.463+0000] {processor.py:743} INFO - Processing file /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py for tasks to queue
[2024-01-06T09:47:31.464+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:47:31.464+0000] {dagbag.py:538} INFO - Filling up the DagBag from /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py
[2024-01-06T09:47:31.477+0000] {processor.py:753} INFO - DAG(s) dict_keys(['example_bash_operator']) retrieved from /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py
[2024-01-06T09:47:31.498+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:47:31.498+0000] {dag.py:2690} INFO - Sync 1 DAGs
[2024-01-06T09:47:31.510+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:47:31.510+0000] {dag.py:3441} INFO - Setting next_dagrun for example_bash_operator to 2024-01-05T00:00:00+00:00, run_after=2024-01-06T00:00:00+00:00
[2024-01-06T09:47:31.520+0000] {processor.py:175} INFO - Processing /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py took 0.059 seconds
[2024-01-06T09:48:02.162+0000] {processor.py:153} INFO - Started process (PID=6213) to work on /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py
[2024-01-06T09:48:02.162+0000] {processor.py:743} INFO - Processing file /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py for tasks to queue
[2024-01-06T09:48:02.163+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:48:02.163+0000] {dagbag.py:538} INFO - Filling up the DagBag from /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py
[2024-01-06T09:48:02.174+0000] {processor.py:753} INFO - DAG(s) dict_keys(['example_bash_operator']) retrieved from /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py
[2024-01-06T09:48:02.191+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:48:02.191+0000] {dag.py:2690} INFO - Sync 1 DAGs
[2024-01-06T09:48:02.203+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:48:02.203+0000] {dag.py:3441} INFO - Setting next_dagrun for example_bash_operator to 2024-01-05T00:00:00+00:00, run_after=2024-01-06T00:00:00+00:00
[2024-01-06T09:48:02.211+0000] {processor.py:175} INFO - Processing /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py took 0.051 seconds
[2024-01-06T09:48:32.765+0000] {processor.py:153} INFO - Started process (PID=6302) to work on /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py
[2024-01-06T09:48:32.765+0000] {processor.py:743} INFO - Processing file /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py for tasks to queue
[2024-01-06T09:48:32.766+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:48:32.766+0000] {dagbag.py:538} INFO - Filling up the DagBag from /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py
[2024-01-06T09:48:32.777+0000] {processor.py:753} INFO - DAG(s) dict_keys(['example_bash_operator']) retrieved from /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py
[2024-01-06T09:48:32.794+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:48:32.794+0000] {dag.py:2690} INFO - Sync 1 DAGs
[2024-01-06T09:48:32.807+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:48:32.807+0000] {dag.py:3441} INFO - Setting next_dagrun for example_bash_operator to 2024-01-05T00:00:00+00:00, run_after=2024-01-06T00:00:00+00:00
[2024-01-06T09:48:32.815+0000] {processor.py:175} INFO - Processing /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py took 0.053 seconds
[2024-01-06T09:49:03.590+0000] {processor.py:153} INFO - Started process (PID=6391) to work on /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py
[2024-01-06T09:49:03.591+0000] {processor.py:743} INFO - Processing file /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py for tasks to queue
[2024-01-06T09:49:03.591+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:49:03.591+0000] {dagbag.py:538} INFO - Filling up the DagBag from /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py
[2024-01-06T09:49:03.603+0000] {processor.py:753} INFO - DAG(s) dict_keys(['example_bash_operator']) retrieved from /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py
[2024-01-06T09:49:03.621+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:49:03.621+0000] {dag.py:2690} INFO - Sync 1 DAGs
[2024-01-06T09:49:03.634+0000] {logging_mixin.py:137} INFO - [2024-01-06T09:49:03.634+0000] {dag.py:3441} INFO - Setting next_dagrun for example_bash_operator to 2024-01-05T00:00:00+00:00, run_after=2024-01-06T00:00:00+00:00
[2024-01-06T09:49:03.642+0000] {processor.py:175} INFO - Processing /home/airflow/.local/lib/python3.7/site-packages/airflow/example_dags/example_bash_operator.py took 0.053 seconds
Loading

0 comments on commit 1fd8f58

Please sign in to comment.