nederlandskie

Commit Graph

Author	SHA1	Message	Date
Aleksei Voronov	6f8c86d815	Switch cursor-related messages to debug level Otherwise it's too noisy	2023-10-07 18:27:25 +02:00
Aleksei Voronov	883d02e328	Extract and print out the time of the commit Useful for visibility for when we inevitably fall behind in processing	2023-10-02 16:59:31 +02:00
Aleksei Voronov	4a08a283d2	Properly handle errors in post indexer and profile classifier Reconnect to Bluesky in the indexer Don't exit the classifier just because we couldn't fetch profiles	2023-10-02 16:34:22 +02:00
Aleksei Voronov	fadf882a1f	Formatting and clippy	2023-09-24 20:27:51 +02:00
Aleksei Voronov	658996d5d5	Delete posts from the database when they are deleted from bluesky	2023-09-23 20:29:56 +02:00
Aleksei Voronov	dd33333649	Rewrite streaming processing in a more sane way And also add support for likes and follows	2023-09-23 20:25:26 +02:00
Aleksei Voronov	aa17ece012	Fix clippy lints Nothing major here tbh	2023-09-22 17:15:48 +02:00
Aleksei Voronov	e95c4923d6	Add some untested version of publishing a feed Also adjust names of different env vars, and also adjust setup instructions	2023-09-22 13:33:13 +02:00
Aleksei Voronov	5128bf9d4a	Refactor streaming stuff Now we call the processor once per commit, and it's also now a commit processor, not an operation processor, so that we can update the cursor properly	2023-09-22 12:37:10 +02:00
Aleksei Voronov	901c4b6e97	Make Algo.should_index_post a fallible async function, for maximum extensibility We may want to perform some more complicated operations here in the future	2023-09-21 13:31:27 +02:00
Aleksei Voronov	93c4979c71	Keep subscription state in order to not lose messages This isn't a good way to do it though, because opreations processor is only called for each operation, so we end up not updating the cursor as often as we realistically should be. I'll refactor this slightly later	2023-09-21 12:33:17 +02:00
Aleksei Voronov	62b00ceed7	Replace random print statements with proper logging setup	2023-09-21 11:22:18 +02:00
Aleksei Voronov	f4ee482ce7	Use Arcs to pass stuff around to avoid dealing with lifetimes And also implement proper language detection through lingua-rs, because Bluesky's detection is really bad	2023-09-21 10:36:47 +02:00
Aleksei Voronov	14b9f846da	Refactor things Make the overall design a little more flexible if one wants to easily implement multiple feeds, and also kinda closer to the original template provided by Bluesky devs	2023-09-16 21:07:00 +02:00
Aleksei Voronov	944be0cd5a	Convert into more modern Rust module structure And also use re-exports liberally for shorter imports	2023-09-16 17:21:18 +02:00
Aleksei Voronov	227118dfb1	Rename PostSaver into PostIndexer, which is a better name	2023-09-16 17:16:01 +02:00

16 Commits