badjware
/
the-algorithm
mirror of https://github.com/twitter/the-algorithm.git
1
0
Fork 0
Code Releases Activity

Compare commits

base: badjware:63a868c458fc67c06567c41eb2b537c2d78fa819
Branches Tags
badjware:main
...
compare: badjware:5bc1705210b776311facc9df3622df956154de3f
Branches Tags
badjware:main

2 Commits
63a868c458 ... 5bc1705210

Author SHA1 Message Date
BAI Research 5bc1705210
Merge 918fa11ab2 into 72eda9a24f 2024-07-10 02:07:03 -05:00
Richard Baxter 918fa11ab2 extend accountLevelShadowbanMaxTime to (false) spam reports 2024-07-10 17:06:31 +10:00
1 changed files with 1 additions and 0 deletions
Show Stats Expand all files Collapse all files

1
src/scala/com/twitter/interaction_graph/scio/agg_negative/InteractionGraphNegativeJob.scala
View File

@ -78,6 +78,7 @@ object InteractionGraphNegativeJob extends ScioBeamJob[InteractionGraphNegativeO
readSnapshot(FlockReportAsSpamEdgesScalaDataset, sc),
FeatureName.NumReportAsSpams,
endTs)
.filter(_.age < accountLevelShadowbanMaxTime)
// we only keep unfollows in the past X days due to the huge size of this dataset,
// and to prevent permanent "shadow-banning" in the event of accidental unfollows.