Gnip Full-Archive Search Videos


The following set of videos explore the Full-Archive Search API and how to integrate with it. In this series we start by introducing the API and core search concepts. We then work with the ‘Counts’ endpoint to discover the number of Tweets associated with a query, and demonstrate how the API can be used to refine PowerTrack rules in a ‘look before you leap’ fashion. Next, the API is used to collect an entire dataset associated with a refined PowerTrack rule.

If you want to dive in, here is the link to the complete Full-Archive Video Series Playlist.


Introduction to Full-Archive Search  

Provides an overview of the Full-Archive Search API, as well as benefits of and potential use-cases for the Full-Archive Search API.

Core Search Concepts  

A discussion of search fundamentals, time and date conventions, and pagination with ‘next’ tokens.

What’s New  

A discussion of new details that Full-Archive Search introduces, including new pagination details, new PowerTrack Operators, new response data, and Tweet metadata that is current as of request time.

New Matching Behavior  

Important differences in how Full-Archive Search will match Tweets.

Making Count Requests  

Explores how to make Count requests, and discusses why Counts are so useful and the basis of many use-cases. In this video we start exercising the API by exploring a data story about the drought in the Western US.

Using Counts To Refine Rules  

Using the Counts endpoint we refine our PowerTrack rule to narrow our focus to drought Tweets with photos and videos. We exercise the API using an example client, demonstrating how to paginate over many month of data.

Making Data Requests  

After refining our PowerTrack rule with the Counts endpoint, we begin making Data requests. In this video we collect the most recent 100 Tweets that mention the keyword ‘drought.’ We then discuss how ‘next’ tokens are used to collect large Tweet datasets.

Requesting Complete DataSet  

Using our refined PowerTrack rule and ‘next’ tokens, we retrieve an entire year of California ‘drought’ Tweets with photos or videos.