diff options
author | Baitinq <manuelpalenzuelamerino@gmail.com> | 2022-10-28 19:24:58 +0200 |
---|---|---|
committer | Baitinq <manuelpalenzuelamerino@gmail.com> | 2022-10-28 19:25:01 +0200 |
commit | e5291cab1b2d1b6a01164b9bbb31d812062e6e66 (patch) | |
tree | 02a42a70a97718f78781a2e0395c91521c96ac09 /frontend | |
parent | Frontend: Refactor search_word_in_db() to not need explicit lifetimes (diff) | |
download | OSSE-e5291cab1b2d1b6a01164b9bbb31d812062e6e66.tar.gz OSSE-e5291cab1b2d1b6a01164b9bbb31d812062e6e66.tar.bz2 OSSE-e5291cab1b2d1b6a01164b9bbb31d812062e6e66.zip |
Indexer: Add website title and description to the CrawledResource
We now parse the HTML and extract the title and description of the site.
Diffstat (limited to 'frontend')
-rw-r--r-- | frontend/Cargo.toml | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/frontend/Cargo.toml b/frontend/Cargo.toml index 106b818..23acba2 100644 --- a/frontend/Cargo.toml +++ b/frontend/Cargo.toml @@ -14,3 +14,4 @@ gloo-net = "0.2" serde = { version = "1.0", features = ["derive", "rc"] } wasm-bindgen-futures = "0.4" itertools = "0.10.5" +scraper = "0.12.0" |