Fiery-snap : a micro-architecture system for collecting OSINT on Twitter.

Fiery-snap : a micro-architecture system for collecting OSINT on Twitter.

Fiery-snap is a componentized scrapper/processor that leverages Python micro services to transform data for analysis. Simply put each little service reads data from a set of 1 or more queues, performs some operation on the data, and then puts it into the outbound queue for additional operations.

Current implementation details
– The current implementation reads Twitter user timelines and attempts to extract common artifacts (e.g. domains, hashes, URLs, URIs, and potential URLs). This current implementation has three main components (discussed below) that can be run in a series docker instances, remote services, or all locally.

Fiery-snap

Dependencies:
+ Python 2.7 and pip installed.
+ Twitter API keys (see: https://apps.twitter.com/)

Usage:

Source: https://github.com/deeso