about summary refs log tree commit diff
path: root/crawler/Cargo.toml (follow)
Commit message (Expand)AuthorAgeFilesLines
* Crawler: Add loging with env_loggerBaitinq2022-11-061-0/+2
* Misc: Remove unneeded dependenciesBaitinq2022-10-301-1/+0
* Misc: Add local lib crate to share common structsBaitinq2022-10-301-0/+1
* Crawler: Use async ClientBaitinq2022-10-251-1/+1
* Crawler: Shuffle crawled urlsBaitinq2022-10-251-1/+2
* Crawler: Parse urls with the "url" crateBaitinq2022-10-251-0/+1
* Crawler: Change blockingqueue to channelsBaitinq2022-10-231-1/+1
* Crawler: Implement basic async functionalityBaitinq2022-10-221-0/+1
* Crawler: Add basic indexer communicationBaitinq2022-10-211-1/+2
* Crawler: Remove duplicate parsed urlsBaitinq2022-10-201-0/+1
* Crawler: Add basic html parsing and link-followingBaitinq2022-10-201-0/+2
* Crawler: Add skeleton crawler implementationBaitinq2022-10-201-0/+1
* Misc: Separate OSSE into componentsBaitinq2022-10-191-0/+12