Hacker GitHub

← All repos

twitter/the-algorithm

View on GitHub ↗ ★ 73,994 Scala

Source code for the X Recommendation Algorithm

116 mentions on Hacker News by 104 people: 20 stories, 96 comments · first 2022-04-25 · latest 2026-10-19

Mentions per year 116 mentions · busiest year 2023 (78)
20082026
  1. …recommendation algorithm has long since been completely open sourced. It's available right here: https://github.com/twitter/the-algorithm
  2. …what they want the system to show them? For example, this suggestion I posted on the Twitter algo https://github.com/twitter/the-algorithm/issues/1363
  3. …this suggestion to Twitter, I doubt they will use it, but it is currently ranked 4th by up votes. https://github.com/twitter/the-algorithm/issues/1363
    comment by 13years · 2023-04-11 · in Substack Notes Launched
  4. For the folks not logged into Github (who won't be able to search): https://github.com/twitter/the-algorithm/blob/138bb519975407... https://github.com/twitter/the-algorithm/blob/138bb519975407... https://github.com/twitter/the-algorithm/blo…
  5. ▲ 2
    Tweepcred
    story by tosh · 2023-04-04 · 0 comments
  6. ▲ 2
    Twitter – Algorithm Manipulation via mass blocks
    story by Trouble_007 · 2023-04-03 · 1 comment
  7. …in the actual techniques being employed: Twitter repo + relevant visibility tweaking code at: https://github.com/twitter/the-algorithm/tree/main/visibilit... Still reading through it myself, but if I'm properly distilling the gist out of…
  8. …entity for misinformation, PolicyInViolation.AbusePolicyUkraineCrisisMisinformation ; source: https://github.com/twitter/the-algorithm/blob/7f90d0ca342b92... .
  9. It is in the original repo: https://github.com/twitter/the-algorithm/blob/main/visibilit... The problem is, the branch 'main' and its contents will change over time, so GP linked to a 'permalink' of the exact commit hash instead.
  10. If someone curious here is the line on GitHub: https://github.com/twitter/the-algorithm/blob/7f90d0ca342b92... UPD: here is link to main branch without specific commit. Line is still there, it's not some fake or something:…
  11. A feature proposal to put you in control of the algorithm https://github.com/twitter/the-algorithm/issues/1363
    comment by 13years · 2023-04-02 · in Twitter's Recommendation Algorithm
  12. …Speaking about Ukraine, it seems to be literally a Twitter policy violation ... https://github.com/twitter/the-algorithm/blob/main/visibilit...
    comment by WinstonSmith84 · 2023-04-02 · in Twitter's Recommendation Algorithm
  13. ▲ 4
    Twitter “For you” content should be by user preference customizable
    story by 13years · 2023-04-02 · 2 comments
  14. I think they have a bug here here: https://github.com/twitter/the-algorithm/blob/7f90d0ca342b92... Code: ( "has_gte_10k_favs", _.getOrElse(EarlybirdFeature, None).exists(_.favCountV2.exists(_ >= 1000))), Should be: ( "has_gte_10k_favs",…
    comment by d_sc · 2023-04-01 · in Twitter's Recommendation Algorithm
  15. …-> HatefulHighRecall, ... s.SpaceSafetyLabelType.UkraineCrisisTopic -> UkraineCrisisTopic, https://github.com/twitter/the-algorithm/blob/ec83d01dcaebf3...
    comment by amq · 2023-04-01 · in Twitter's Recommendation Algorithm
  16. How do you infer that is what is happening? This comment would seem to contradict https://github.com/twitter/the-algorithm/blob/7f90d0ca342b92...
  17. ▲ 25
    Twitter scrubbing Elon, Republican, Democrat code references on GitHub
    story by donohoe · 2023-04-01 · 16 comments
  18. ▲ 1
    Twitter algorithm code on GitHub
    story by Anon84 · 2023-04-01 · 0 comments
  19. Maybe; twitter/the-algorithm/issues : https://github.com/twitter/the-algorithm/issues
  20. Seems random. This file has both 2 and 4: https://github.com/twitter/the-algorithm/blob/main/trust_and...
    comment by xdennis · 2023-04-01 · in Twitter's Recommendation Algorithm
  21. …in Rust [1] and this pull request which simplifies the algorithm to a single c file [2]. [1] https://github.com/twitter/the-algorithm/issues?q=is%3Aissue... [2] https://github.com/twitter/the-algorithm/pull/712
    comment by hotpathdev · 2023-04-01 · in Twitter's Recommendation Algorithm
  22. ▲ 3
    Navi: High-Performance Machine Learning Serving Server in Rust
    story by antimora · 2023-04-01 · 1 comment
  23. Weights on different metrics. From https://github.com/twitter/the-algorithm/blob/ec83d01dcaebf3... private def getLinearRankingParams: ThriftRankingParams = { ThriftRankingParams( `type` = Some(ThriftScoringFunctionType.Linear), minScore =…
    comment by sudo_navendu · 2023-04-01 · in Twitter's Recommendation Algorithm
  24. …'the claim' has now suddenly turned into a fact. [0] [1] This also didn't age well at all. [0] https://github.com/twitter/the-algorithm [1] https://github.com/twitter/the-algorithm-ml
  25. So uh... they use BigQuery and here's the dataset https://github.com/twitter/the-algorithm/blob/main/ann/src/m...
    comment by evantahler · 2023-04-01 · in Twitter's Recommendation Algorithm
  26. Oh god... The MR's opened today are the craziest ones ever. https://github.com/twitter/the-algorithm/pulls?q=is%3Apr+is%... They made my morning
    comment by anshumankmr · 2023-04-01 · in Twitter's Recommendation Algorithm
  27. Well that didn't age well... [0][1] [0] https://github.com/twitter/the-algorithm [1] https://github.com/twitter/the-algorithm-ml
  28. Yup, they removed it. https://github.com/twitter/the-algorithm/commit/ec83d01dcaeb... Here's what Musk said: > But we are deleting this bs. I only learned about it now! Will be gone by tomorrow. https://twitter.com/elonmusk/status/164190813…
    comment by tric · 2023-03-31 · in Twitter's Recommendation Algorithm
  29. ▲ 2
    fix: Better recommendations on Twitter timeline (PR)
    story by cunidev · 2023-03-31 · 0 comments
  30. Also this: https://github.com/twitter/the-algorithm/pull/160
    comment by adharmad · 2023-03-31 · in Twitter's Recommendation Algorithm
  31. Just removed https://github.com/twitter/the-algorithm/commit/ec83d01dcaeb...
    comment by maccam912 · 2023-03-31 · in Twitter's Recommendation Algorithm
  32. …a separate PR? Other PRs are similarly creative, like the one called “blue tick for all accounts”: https://github.com/twitter/the-algorithm/pull/357
    comment by thih9 · 2023-03-31
  33. `if (sourceUserId.isDefined || sourceUserId.isDefined) Some(true)` https://github.com/twitter/the-algorithm/blob/main/timeliner...
    comment by jml2 · 2023-03-31 · in Twitter's Recommendation Algorithm
  34. Aside from the spam PRs, there is actually one PR that fixes a bug: https://github.com/twitter/the-algorithm/pull/242/files
    comment by hrpnk · 2023-03-31 · in Twitter's Recommendation Algorithm
  35. Well, sounds like this pull request doesn't get merged. https://github.com/twitter/the-algorithm/pull/234
    comment by Calzifer · 2023-03-31 · in Twitter's Recommendation Algorithm
  36. …dSnapshot(SocialgraphUnfollowsScalaDataset, sc), FeatureName.NumUnfollows, endTs) .filter(_.age < 90) https://github.com/twitter/the-algorithm/blob/main/src/scala...
    comment by HellsMaddy · 2023-03-31 · in Twitter's Recommendation Algorithm
  37. …of that infrastructure aren’t really relevant and is a notable portion of their secret sauce. https://github.com/twitter/the-algorithm/tree/main/src/java/...
    comment by cmckn · 2023-03-31 · in Twitter's Recommendation Algorithm
  38. I thought it was an april fools joke when I saw this: https://github.com/twitter/the-algorithm/blob/main/ci/ci.sh Like a dig at the code quality.
    comment by stusmall · 2023-03-31 · in Twitter's Recommendation Algorithm
  39. …perhaps just for this extract. Sorting it now results in a different order than the commit. [1]: https://github.com/twitter/the-algorithm/blob/7f90d0ca342b92...
    comment by etc_passwd · 2023-03-31 · in Twitter's Recommendation Algorithm
  40. there may be a hint of which elections were of interest: https://github.com/twitter/the-algorithm/blob/7f90d0ca342b92...
    comment by pledess · 2023-03-31 · in Twitter's Recommendation Algorithm
  41. I think the relevant part of the code is in this other repo: https://github.com/twitter/the-algorithm Not sure if it has what you were looking for (and maybe you already checked this repo, too!), but it's more relevant than the linked repo…
    comment by mardifoufs · 2023-03-31 · in Twitter's Recommendation Algorithm
  42. …platform that we do not ship changes \* that negatively impacts one group over others. \* From: https://github.com/twitter/the-algorithm/blob/7f90d0ca342b92...
    comment by jaywalk · 2023-03-31 · in Twitter's Recommendation Algorithm
  43. ▲ 2
    Twitter algo source with full compiler-accurate code nav
    story by beyang · 2023-03-31 · 0 comments
  44. It's reassuring to know that billion dollar tech companies write CI exactly like I do: https://github.com/twitter/the-algorithm/blob/main/ci/ci.sh Permalink: https://github.com/twitter/the-algorithm/blob/7f90d0ca342b92...
    comment by koolba · 2023-03-31 · in Twitter's Recommendation Algorithm
  45. …"author_is_power_user", "author_is_democrat", and "author_is_republican" labels are for [1]. [1]: https://github.com/twitter/the-algorithm/blob/main/home-mixe...
    comment by tech234a · 2023-03-31 · in Twitter's Recommendation Algorithm
  46. ▲ 1
    https://github.com/twitter/the-algorithm/search?q=elon
    story by idiomaticrust · 2023-03-31 · 0 comments
  47. This is one: https://github.com/twitter/the-algorithm/issues/121 Search for Elon gives this: https://github.com/twitter/the-algorithm/search?q=Elon&type=
    comment by ano-ther · 2023-03-31 · in Twitter's Recommendation Algorithm
  48. Perhaps that's related to this line. Though perhaps this is just used for observing metrics. https://github.com/twitter/the-algorithm/blob/7f90d0ca342b92...
    comment by Chinjut · 2023-03-31 · in Twitter's Recommendation Algorithm
  49. …metrics[0], so Team Red people see more Team Red content and vice versa. Nothing nefarious. [0] https://github.com/twitter/the-algorithm/blob/7f90d0ca342b92...
    comment by krapp · 2023-03-31 · in Twitter's Recommendation Algorithm
  50. I answered my own question https://github.com/twitter/the-algorithm/blob/7f90d0ca342b92... "This method reduces the page rank of users who have a low number of followers but a high number of followings."
    comment by pram · 2023-03-31 · in Twitter's Recommendation Algorithm