Commit graph

26 commits

Author SHA1 Message Date
76e00991d9 add bot crate 2024-12-27 11:10:48 +02:00
a371faf03d add container_name for scraper 2024-12-26 23:33:27 +02:00
f70a9041ed handle signals using signal-hook 2024-12-26 19:34:56 +02:00
291d84dfd0 update Dockerfile 2024-12-26 19:05:33 +02:00
e4c2752335 add docker-compose.yaml for synology deployment 2024-12-26 19:02:51 +02:00
904b45659a add .idea to docker ignore 2024-12-26 17:14:17 +02:00
Denis-Cosmin NUTIU
9c413fae59 update readme.md 2024-12-26 13:30:35 +02:00
Denis-Cosmin NUTIU
351f0ae08e refactor RedisService for generic use 2024-12-26 13:21:50 +02:00
Denis-Cosmin NUTIU
eaca4769a0 extract redis into the infrastructure crate 2024-12-26 13:21:00 +02:00
Denis-Cosmin NUTIU
303d8d303e extract posts into a separate crate 2024-12-26 12:33:37 +02:00
Denis-Cosmin NUTIU
7a3e69d572 Dockerize scrapper using cargo-chef 2024-12-25 20:22:19 +02:00
Denis-Cosmin NUTIU
2dc963a915 fix redis tests & add clean-up 2024-12-25 12:42:51 +02:00
Denis-Cosmin NUTIU
44b1c180e9 add redis tests 2024-12-25 12:28:19 +02:00
Denis-Cosmin NUTIU
2d8bd3e6ea add docker compose for local testing 2024-12-25 11:47:41 +02:00
1eaee1d7df add readme.md 2024-12-23 17:19:48 +02:00
9a3d65b26d fix redis streams publishing 2024-12-23 15:15:11 +02:00
48bc873881 log publish error 2024-12-23 15:02:39 +02:00
4b421c6d4b fix is_post_seen 2024-12-23 15:01:27 +02:00
1bd19eff20 add publish log 2024-12-23 14:58:03 +02:00
02ab5ecaa6 implement redis streams publishing 2024-12-23 14:56:58 +02:00
1f386fd002 change scraping job to be run every 60 minutes 2024-12-23 13:57:34 +02:00
71f97c0763 use workspaces 2024-12-23 13:56:10 +02:00
c3440a66c0 add graceful shutdown and refactor code 2024-12-21 17:10:08 +02:00
99d91ba303 Use clokwerk for scheduling 2024-12-21 16:24:31 +02:00
1212120a91 implement g4 media scraping 2024-12-20 23:12:24 +02:00
bcf2b083e7 initial commit 2024-12-17 16:28:57 +02:00