Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Be/#253 마감기한지난 채용공고 삭제 로직 구현 #260

Merged
merged 7 commits into from
Oct 5, 2023
Merged

Be/#253 마감기한지난 채용공고 삭제 로직 구현 #260

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
2562853
feat: 현재 시간을 기준으로 마감기한인 채용공고 삭제 로직 구현
baekhangyeol Oct 3, 2023
37b060c
fix: 중복처리 로직 global_utils에서 삭제
baekhangyeol Oct 5, 2023
8819852
feat: 스케줄러에 중복처리 로직 추가, 스케줄러 시간 00시로 수정
baekhangyeol Oct 5, 2023
5143959
fix: 마감기한 지난 채용공고 처리 로직 global_utils에서 삭제
baekhangyeol Oct 5, 2023
3c1a6f0
feat: 스케줄러에 중복처리 로직 추가, 스케줄러 시간 00시로 수정
baekhangyeol Oct 5, 2023
fa67ab5
Merge remote-tracking branch 'origin/BE/#253' into BE/#253
baekhangyeol Oct 5, 2023
5a1324d
fix: 채용공고 스케줄러는 3일에 한 번 실행, 마감기한지난 채용공고 삭제 스케줄러는 매일 실행하게 변경
baekhangyeol Oct 5, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion crawling_python/global_utils.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -31,4 +31,4 @@ def get_driver():
service = webdriver.ChromeService(executable_path=path)
driver = webdriver.Chrome(options=chrome_options, service=service)

return driver
return driver
18 changes: 16 additions & 2 deletions crawling_python/scheduler.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,8 +2,21 @@
import schedule
import subprocess

from crawling_python.global_utils import get_database_connect

kst = pytz.timezone('Asia/Seoul')

def delete_expired_data(today):
kst = pytz.timezone('Asia/Seoul')
connect = get_database_connect()
cursor = connect.cursor()

query = "DELETE FROM job WHERE expiration_date < %s"
cursor.execute(query, (today,))

connect.commit()
cursor.close()
connect.close()

def crawl_jobkorea():
subprocess.run(["python", "crawling_jobkorea.py"])
Expand All @@ -13,8 +26,9 @@ def crawl_saramin():
subprocess.run(["python", "crawling_saramin.py"])


schedule.every(3).days.at("06:00").do(crawl_saramin)
schedule.every(3).days.at("06:03").do(crawl_jobkorea)
schedule.every(3).days.at("00:00").do(crawl_saramin)
schedule.every(3).days.at("00:03").do(crawl_jobkorea)
schedule.every().day.at("00:05").do(delete_expired_data)

if __name__ == "__main__":
while True:
Expand Down
Loading