History

Denis Nutiu 5da87b8e2a add scrapper TODO: tie stream name to post title		2025-01-04 18:25:40 +02:00
..
docker	update Dockerfiles: install system ca certs	2025-01-04 18:16:13 +02:00
src	add scrapper TODO: tie stream name to post title	2025-01-04 18:25:40 +02:00
Cargo.toml	handle signals using signal-hook	2024-12-26 19:34:56 +02:00
readme.md	update readme.md	2024-12-26 13:30:35 +02:00

Scrapper

The scrapper component is used as a CLI for scrapping.

It has hardcoded websites to scrape and information. The information is published on the specified Redis Streams topic.