diff options
| author | Baitinq <[email protected]> | 2022-10-23 12:53:20 +0200 |
|---|---|---|
| committer | Baitinq <[email protected]> | 2022-10-23 12:53:23 +0200 |
| commit | ba7060f63a14c7dec0d40094f4533fb1ef070f90 (patch) | |
| tree | f8f6d6f6e5f137b4fe3d04dd5f86ec29e41b0aad /flake.nix | |
| parent | Crawler: Only crawl 2 urls per url (diff) | |
| download | OSSE-ba7060f63a14c7dec0d40094f4533fb1ef070f90.tar.gz OSSE-ba7060f63a14c7dec0d40094f4533fb1ef070f90.tar.bz2 OSSE-ba7060f63a14c7dec0d40094f4533fb1ef070f90.zip | |
Crawler: Remove prepending of https:// to each url
We now prepend it to the top-1000-urls list. This fixes crawled urls having two https://
Diffstat (limited to 'flake.nix')
0 files changed, 0 insertions, 0 deletions