Commit graph

13 commits

Author SHA1 Message Date
Denis-Cosmin NUTIU
351f0ae08e refactor RedisService for generic use 2024-12-26 13:21:50 +02:00
Denis-Cosmin NUTIU
eaca4769a0 extract redis into the infrastructure crate 2024-12-26 13:21:00 +02:00
Denis-Cosmin NUTIU
303d8d303e extract posts into a separate crate 2024-12-26 12:33:37 +02:00
Denis-Cosmin NUTIU
7a3e69d572 Dockerize scrapper using cargo-chef 2024-12-25 20:22:19 +02:00
Denis-Cosmin NUTIU
2dc963a915 fix redis tests & add clean-up 2024-12-25 12:42:51 +02:00
Denis-Cosmin NUTIU
44b1c180e9 add redis tests 2024-12-25 12:28:19 +02:00
9a3d65b26d fix redis streams publishing 2024-12-23 15:15:11 +02:00
48bc873881 log publish error 2024-12-23 15:02:39 +02:00
4b421c6d4b fix is_post_seen 2024-12-23 15:01:27 +02:00
1bd19eff20 add publish log 2024-12-23 14:58:03 +02:00
02ab5ecaa6 implement redis streams publishing 2024-12-23 14:56:58 +02:00
1f386fd002 change scraping job to be run every 60 minutes 2024-12-23 13:57:34 +02:00
71f97c0763 use workspaces 2024-12-23 13:56:10 +02:00