diff options
| author | Baitinq <[email protected]> | 2022-10-20 01:53:38 +0200 |
|---|---|---|
| committer | Baitinq <[email protected]> | 2022-10-20 01:57:07 +0200 |
| commit | 610d08aec18e08a2bfa64d4043c103d04490a6c5 (patch) | |
| tree | 45b28e6d6a862405ecfa3b24c12ebfc77b8902b3 /crawler/Cargo.toml | |
| parent | Misc: Change to use "oxalica/rust-overlay" for the nix development shell (diff) | |
| download | OSSE-610d08aec18e08a2bfa64d4043c103d04490a6c5.tar.gz OSSE-610d08aec18e08a2bfa64d4043c103d04490a6c5.tar.bz2 OSSE-610d08aec18e08a2bfa64d4043c103d04490a6c5.zip | |
Crawler: Add skeleton crawler implementation
Starts by filling a queue with the top 1000 most visited sites. "Crawls" each one (empty fn), and blocks for new elements on the queue.
Diffstat (limited to 'crawler/Cargo.toml')
| -rw-r--r-- | crawler/Cargo.toml | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/crawler/Cargo.toml b/crawler/Cargo.toml index 7fbf8b9..ce2876a 100644 --- a/crawler/Cargo.toml +++ b/crawler/Cargo.toml @@ -6,6 +6,7 @@ edition = "2021" # See more keys and their definitions at https://doc.rust-lang.org/cargo/reference/manifest.html [dependencies] +blockingqueue = "0.1.1" [[bin]] name = "crawler" |