Commit Graph

16 Commits

Author SHA1 Message Date
Aleksei Voronov aa17ece012 Fix clippy lints
Nothing major here tbh
2023-09-22 17:15:48 +02:00
Aleksei Voronov e95c4923d6 Add some untested version of publishing a feed
Also adjust names of different env vars, and also adjust setup instructions
2023-09-22 13:33:13 +02:00
Aleksei Voronov 5128bf9d4a Refactor streaming stuff
Now we call the processor once per commit, and it's also now
a commit processor, not an operation processor, so that we can
update the cursor properly
2023-09-22 12:37:10 +02:00
Aleksei Voronov 901c4b6e97 Make Algo.should_index_post a fallible async function, for maximum extensibility
We may want to perform some more complicated operations here in the future
2023-09-21 13:31:27 +02:00
Aleksei Voronov c02bded6f8 Formatting 2023-09-21 13:28:22 +02:00
Aleksei Voronov 2fd1474647 Don't crash when unable to classify a profile due to some random problem
Random problems include: deleted profiles.

Also always wait 10 seconds between runs, we don't need to do it so often
2023-09-21 13:25:36 +02:00
Aleksei Voronov 93c4979c71 Keep subscription state in order to not lose messages
This isn't a good way to do it though, because opreations processor is only called for each operation,
so we end up not updating the cursor as often as we realistically should be.

I'll refactor this slightly later
2023-09-21 12:33:17 +02:00
Aleksei Voronov 62b00ceed7 Replace random print statements with proper logging setup 2023-09-21 11:22:18 +02:00
Aleksei Voronov f4ee482ce7 Use Arcs to pass stuff around to avoid dealing with lifetimes
And also implement proper language detection through lingua-rs,
because Bluesky's detection is really bad
2023-09-21 10:36:47 +02:00
Aleksei Voronov 14b9f846da Refactor things
Make the overall design a little more flexible if one wants
to easily implement multiple feeds, and also kinda closer to
the original template provided by Bluesky devs
2023-09-16 21:07:00 +02:00
Aleksei Voronov fb17aa3e6a Formatting 2023-09-16 17:40:07 +02:00
Aleksei Voronov 944be0cd5a Convert into more modern Rust module structure
And also use re-exports liberally for shorter imports
2023-09-16 17:21:18 +02:00
Aleksei Voronov 227118dfb1 Rename PostSaver into PostIndexer, which is a better name 2023-09-16 17:16:01 +02:00
Aleksei Voronov b4250e12cd Serve the feed, according to all the Atproto endpoints 2023-09-16 17:13:57 +02:00
Aleksei Voronov 832bdf6e92 Simplify lifetimes
I think I may have overdone it with lifetime-per-dependency, I doubt that'll ever become necessary
2023-09-07 19:06:39 +02:00
Aleksei Voronov 9d3cd75db9 Refactor things a little
Split into proper domain components, and 3rd party service glue
2023-09-07 19:02:36 +02:00