badjware
/
the-algorithm
mirror of https://github.com/twitter/the-algorithm.git
1
0
Fork 0
Code Releases Activity
the-algorithm/science/search/ingester/config
History
twitter-team ef4c5eb65e Twitter Recommendation Algorithm 
Please note we have force-pushed a new initial commit in order to remove some publicly-available Twitter user information. Note that this process may be required in the future.
 		2023-03-31 17:36:31 -05:00
..
README.md Twitter Recommendation Algorithm 2023-03-31 17:36:31 -05:00
pipeline-indexer.userupdates.xml Twitter Recommendation Algorithm 2023-03-31 17:36:31 -05:00
pipeline-ingester.protected.xml Twitter Recommendation Algorithm 2023-03-31 17:36:31 -05:00
pipeline-ingester.realtime.xml Twitter Recommendation Algorithm 2023-03-31 17:36:31 -05:00
pipeline-ingester.realtime_cg.xml Twitter Recommendation Algorithm 2023-03-31 17:36:31 -05:00

README.md

Ingester Configs

This directory contains pipeline configurations for the tweet ingesters (realtime, protected and realtime_cg) and the user-updates ingester. The pipeline configurations define an ordered sequence of stages that the tweet or user update goes through before reaching Earlybird. Source code for the various stages referenced in the configs can be found at src/java/com/twitter/search/ingester/pipeline/twitter.