I need to find/code a command line tool that store tweets metadata in real time a bit like flocker.outliers.es but on the terminal. I want to be able to trigger the command when new #socialmedia storms arise with the ultimate ability to save the data on the GEXF format file so I can import it back to Gephi/Neo4j or other #Dataviz tools. The next step would be to make this code able to detect new social media storms or "moments" and start storing metadata when any particular #hashtag rise above a certain thresholds. the idea is that not always you find yourself at the beginning of a social media storm. the code need to be able to detect in some measure possible storms and store the data for later analysis.
another feature would be to have a nice dashboard to browse & visualize the stored #datasets using #Linkurious - of course this tool would need to be able to dive into the Twitter API to realize all these possibilities but we all know Twitter constant limitations on using it's API, so I was wondering about the possibilities to use "web scrapping" instead of API methods and bypass over-limitations by Twitter like going back in time more then X days or more then X Tweets. I'm not sure what would be the best language to go ahead with this idea, but maybe NodeJS or Python ?