Skip to content

Commit

Permalink
More chars to slugify
Browse files Browse the repository at this point in the history
Added more characters to slugify function to fix issue puppeteer#25, querystrings in URLs break file-related functions.
  • Loading branch information
ReevesL committed Feb 11, 2019
1 parent 5935560 commit 8f52d59
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion crawlsite.js
Original file line number Diff line number Diff line change
Expand Up @@ -50,8 +50,9 @@ const OUT_DIR = process.env.OUTDIR || `output/${slugify(URL)}`;
const crawledPages = new Map();
const maxDepth = DEPTH; // Subpage depth to crawl site.

// Replaces characters from the URL which are illegal in a file path for working dir and saving screenshots.
function slugify(str) {
return str.replace(/[\/:]/g, '_');
return str.replace(/[\/:?*%|"<>. ]/g, '_');
}

function mkdirSync(dirPath) {
Expand Down

0 comments on commit 8f52d59

Please sign in to comment.