badjware
/
the-algorithm
mirror of https://github.com/twitter/the-algorithm.git
1
0
Fork 0
Code Releases Activity
the-algorithm/unified_user_actions
History
twitter-team 23fa75d406 [Medium][UUA] Clean up BCE in UUA 
This is to clean up the BCE adapters and services in UUA since BCE no longer exists.
 		2023-04-28 10:29:20 -05:00
..
adapter/src [Medium][UUA] Clean up BCE in UUA 2023-04-28 10:29:20 -05:00
client/src Open-sourcing Unified User Actions 2023-04-14 16:45:37 -05:00
enricher Open-sourcing Unified User Actions 2023-04-14 16:45:37 -05:00
graphql Open-sourcing Unified User Actions 2023-04-14 16:45:37 -05:00
kafka/src Open-sourcing Unified User Actions 2023-04-14 16:45:37 -05:00
scripts Open-sourcing Unified User Actions 2023-04-14 16:45:37 -05:00
service [Medium][UUA] Clean up BCE in UUA 2023-04-28 10:29:20 -05:00
thrift/src Open-sourcing Unified User Actions 2023-04-14 16:45:37 -05:00
.gitignore Open-sourcing Unified User Actions 2023-04-14 16:45:37 -05:00
BUILD.bazel Open-sourcing Unified User Actions 2023-04-14 16:45:37 -05:00
README.md Open-sourcing Unified User Actions 2023-04-14 16:45:37 -05:00

README.md

Unified User Actions (UUA)

Unified User Actions (UUA) is a centralized, real-time stream of user actions on Twitter, consumed by various product, ML, and marketing teams. UUA reads client-side and server-side event streams that contain the user's actions and generates a unified real-time user actions Kafka stream. The Kafka stream is replicated to HDFS, GCP Pubsub, GCP GCS, GCP BigQuery. The user actions include public actions such as favorites, retweets, replies and implicit actions like bookmark, impression, video view.

Components

  • adapter: transform the raw inputs to UUA Thrift output
  • client: Kafka client related utils
  • kafka: more specific Kafka utils like customized serde
  • service: deployment, modules and services