diff options
| author | Baitinq <manuelpalenzuelamerino@gmail.com> | 2022-10-20 01:53:38 +0200 |
|---|---|---|
| committer | Baitinq <manuelpalenzuelamerino@gmail.com> | 2022-10-20 01:57:07 +0200 |
| commit | 610d08aec18e08a2bfa64d4043c103d04490a6c5 (patch) | |
| tree | 45b28e6d6a862405ecfa3b24c12ebfc77b8902b3 /Cargo.lock | |
| parent | Misc: Change to use "oxalica/rust-overlay" for the nix development shell (diff) | |
| download | OSSE-610d08aec18e08a2bfa64d4043c103d04490a6c5.tar.gz OSSE-610d08aec18e08a2bfa64d4043c103d04490a6c5.tar.bz2 OSSE-610d08aec18e08a2bfa64d4043c103d04490a6c5.zip | |
Crawler: Add skeleton crawler implementation
Starts by filling a queue with the top 1000 most visited sites. "Crawls" each one (empty fn), and blocks for new elements on the queue.
Diffstat (limited to 'Cargo.lock')
| -rw-r--r-- | Cargo.lock | 9 |
1 files changed, 9 insertions, 0 deletions
diff --git a/Cargo.lock b/Cargo.lock index b9c356f..a8e1296 100644 --- a/Cargo.lock +++ b/Cargo.lock @@ -3,12 +3,21 @@ version = 3 [[package]] +name = "blockingqueue" +version = "0.1.1" +source = "registry+https://github.com/rust-lang/crates.io-index" +checksum = "763bb38f196c65b369c68796e6d15b83d7eb63c354f2ab7c03c13edd13f2c4ff" + +[[package]] name = "client" version = "0.1.0" [[package]] name = "crawler" version = "0.1.0" +dependencies = [ + "blockingqueue", +] [[package]] name = "indexer" |