about summary refs log tree commit diff
path: root/crawler/src (follow)
Commit message (Collapse)AuthorAgeFilesLines
* Crawler: Add skeleton crawler implementationBaitinq2022-10-201-0/+40
| | | | | Starts by filling a queue with the top 1000 most visited sites. "Crawls" each one (empty fn), and blocks for new elements on the queue.
* Misc: Separate OSSE into componentsBaitinq2022-10-191-0/+3
We now have a cargo workspace with the Crawler, Client and Indexer packages.