skip to Main Content

I need to stream live tweets from twitter API and then analyse them. I should use kafka to get tweets or spark streaming directly or both ?

2

Answers


  1. Depending on your language of choice I would use one of the libraries listed here: https://developer.twitter.com/en/docs/developer-utilities/twitter-libraries. Which ever you choose, you will be using statuses/filter in the Twitter API, so get familiar with the doc here: https://developer.twitter.com/en/docs/tweets/filter-realtime/api-reference/post-statuses-filter.html

    Login or Signup to reply.
  2. You can use Kafka Connect to ingest tweets, and then Kafka Streams or KSQL to analyse them. Check out this article here which describes exactly this.

    Login or Signup to reply.
Please signup or login to give your own answer.
Back To Top
Search