index
:
OSSE
this commit
levshtein
master
ngrams_indexer
Overly Simple Search Engine :)
about
summary
refs
log
tree
commit
diff
log msg
author
committer
range
path:
root
/
crawler
(
follow
)
Commit message (
Expand
)
Author
Age
Files
Lines
*
Crawler: Add loging with env_logger
Baitinq
2022-11-06
2
-15
/
+14
*
Indexer: Switch back to not serving frontend with actix
Baitinq
2022-11-05
1
-1
/
+1
*
Indexer+Frontend: Integrate with actix
Baitinq
2022-11-05
1
-1
/
+1
*
Misc: Cargo fmt
Baitinq
2022-10-30
1
-6
/
+6
*
Crawler: Set 4 as the maximum "crawl depth"
Baitinq
2022-10-30
1
-0
/
+1
*
Crawler: Accept max_queue_size as an argument for crawler()
Baitinq
2022-10-30
1
-3
/
+5
*
Frontend: Move app-specific code to app.rs
Baitinq
2022-10-30
1
-0
/
+1
*
Misc: Remove unneeded dependencies
Baitinq
2022-10-30
1
-1
/
+0
*
Misc: Add local lib crate to share common structs
Baitinq
2022-10-30
2
-7
/
+2
*
Crawler+Indexer+Frontend: Rename structs to follow logical relations
Baitinq
2022-10-29
1
-2
/
+2
*
Crawler: Only accept HTTP_STATUS_CODE: 200 as success in crawl_url()
Baitinq
2022-10-28
1
-3
/
+4
*
Misc: Add TODOs
Baitinq
2022-10-28
1
-1
/
+0
*
Crawler: Replace String::from with .to_string()
Baitinq
2022-10-27
1
-3
/
+6
*
Crawler: Fix bad error handling with match handling
Baitinq
2022-10-25
1
-6
/
+9
*
Crawler: Use async Client
Baitinq
2022-10-25
2
-7
/
+12
*
Crawler: Shuffle crawled urls
Baitinq
2022-10-25
2
-4
/
+4
*
Crawler: Add "correct" error handling
Baitinq
2022-10-25
1
-21
/
+23
*
Crawler: Parse urls with the "url" crate
Baitinq
2022-10-25
2
-25
/
+25
*
Crawler: Add crawled url filter
Baitinq
2022-10-24
1
-1
/
+8
*
Crawler: Set queue size to 2222
Baitinq
2022-10-24
1
-1
/
+1
*
Crawler+Indexer: Rust cleanup
Baitinq
2022-10-23
1
-3
/
+2
*
Crawler: Replace println! with dbg!
Baitinq
2022-10-23
1
-7
/
+7
*
Crawler: Remove prepending of https:// to each url
Baitinq
2022-10-23
2
-1006
/
+1006
*
Crawler: Only crawl 2 urls per url
Baitinq
2022-10-23
1
-0
/
+6
*
Crawler: Change blockingqueue to channels
Baitinq
2022-10-23
2
-12
/
+12
*
Crawler: Implement basic async functionality
Baitinq
2022-10-22
2
-39
/
+46
*
Crawler: Add basic indexer communication
Baitinq
2022-10-21
2
-11
/
+48
*
Crawler: Add Err string in the craw_url method
Baitinq
2022-10-20
1
-3
/
+3
*
Crawler: Add indexer interaction skeleton
Baitinq
2022-10-20
1
-1
/
+5
*
Crawler: Wrap crawl response in Result type
Baitinq
2022-10-20
1
-18
/
+23
*
Crawler: Normalise relative urls
Baitinq
2022-10-20
1
-2
/
+17
*
Crawler: Remove duplicate parsed urls
Baitinq
2022-10-20
2
-0
/
+4
*
Crawler: Add basic html parsing and link-following
Baitinq
2022-10-20
2
-9
/
+36
*
Crawler: Add skeleton crawler implementation
Baitinq
2022-10-20
3
-0
/
+1042
*
Misc: Separate OSSE into components
Baitinq
2022-10-19
2
-0
/
+15