Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve Retrieval For Our Feed Algorithms - Walk the graph to find members to add to our lists #6

Closed
jlewi opened this issue Nov 4, 2024 · 0 comments · Fixed by #13

Comments

@jlewi
Copy link
Owner

jlewi commented Nov 4, 2024

Our feed algorithms are pretty simple

  1. Retrieve the posts for all members in a list
  2. Include posts with matching keywords

We can easily improve this by programmatically discovering who to include. A good place to start would be
by writing an algorithm that

  1. Takes a set of seed accounts
  2. Walks the graph one degree (i.e. people they follow or people that follow them)
  3. Apply some criterion to those list of people to decide whether to add them to the list
    • e.g. Fetch some of their posts and see if they include any of the keywords defined for that community

I'm not sure whether it makes more sense to start with looking at people the seeds follow or people that follow the seeds.
Assuming they are both equally easy to retrieve then I think starting with looking at followers of a given account might be better.

The reason is I think within communities there are "hubs" that everyone follows. For example, in devops/platform engineering I think kelseyhightower.com is one of the first accounts everyone follows. He has ~20K followers. So my conjecture those 20K followers provides high coverage of the devops community on bluesky.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
1 participant