Skip to content

Commit

Permalink
Update internet.py
Browse files Browse the repository at this point in the history
  • Loading branch information
hlohaus authored Nov 15, 2024
1 parent 0f81b61 commit 9e4a63e
Showing 1 changed file with 0 additions and 2 deletions.
2 changes: 0 additions & 2 deletions g4f/gui/server/internet.py
Original file line number Diff line number Diff line change
Expand Up @@ -46,8 +46,6 @@ def set_text(self, text: str):

def scrape_text(html: str, max_words: int = None) -> str:
soup = BeautifulSoup(html, "html.parser")
for exclude in soup(["script", "style"]):
exclude.extract()
for selector in [
"main",
".main-content-wrapper",
Expand Down

0 comments on commit 9e4a63e

Please sign in to comment.