Storing Tweets and Summarising

So in the last update we had a program that listened to twitter and then displayed all the tweets that matched the search terms. Now at that point it want much better than going to twitter and searching for all of your search terms and reading, and I dont know about you but I don’t think I have time to read 1000’s of tweets a day (on a randomly chosen test day I got 45,162 tweets that matched my search terms)

So I have made a few more changes to the code so that it outputs the tweets to a few files and collates the results.

The output files are stored in a directory tree sorted by date eg YYYY/MM/DD/results, and saves one file containing all the tweets, a folder with individual files for each seach term, a folder for files containing tweets which match two or search terms, and finally two files that summarise the results, telling you how many tweets matched each term and pair of terms.

Now to try and get the code to email me when its done for the day.

Share This:

Leave a Reply

Your email address will not be published. Required fields are marked *