Toggle navigation
Toggle navigation
This project
Loading...
Sign in
방승일
/
mamuri-bot
Go to a project
Toggle navigation
Toggle navigation pinning
Projects
Groups
Snippets
Help
Project
Activity
Repository
Pipelines
Graphs
Issues
0
Merge Requests
0
Wiki
Snippets
Network
Create a new issue
Builds
Commits
Issue Boards
Authored by
유명현
2022-05-08 22:00:57 +0900
Browse Files
Options
Browse Files
Download
Email Patches
Plain Diff
Commit
909975318e6ee08af0efc0d51c8b774e93e427b6
90997531
1 parent
7231ab84
ADD Todo: check_duplication_item method
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
4 additions
and
0 deletions
daangn/daangn_crawl.py
daangn/daangn_crawl.py
View file @
9099753
...
...
@@ -3,6 +3,10 @@ from bs4 import BeautifulSoup
import
requests
import
json
# TODO: 크롤링한 데이터가 이미 서버에 있는지 확인하는 method 필요
def
check_duplication_item
(
item
):
return
def
save_json
(
parsed_items
):
with
open
(
'./sample.json'
,
'w'
)
as
f
:
json
.
dump
(
parsed_items
,
f
,
indent
=
2
,
ensure_ascii
=
False
)
...
...
Please
register
or
login
to post a comment