Crowd sensing of weather conditions and traffic congestion based on data mining in social networks

In recent years, the growing prevalence of social networks makes it possible to utilize human users as sensors to inspect city environment and human activities. Consequently, valuable insights can be gained by applying data mining techniques to the data generated through social networks. In this work, a practical approach to combine data mining techniques with statistical analysis is proposed to implement crowd sensing in a smart city. A case study to analyze the relationship between weather conditions and traffic congestion in Beijing based on tweets posted on Sina Weibo platform is presented to demonstrate the proposed approach. Following the steps of raw dataset pre-processing, target dataset processing and statistical data analysis, analytic corpus containing tweets related to different weather conditions, traffic congestion and human outdoor activity is selected to test causal relationships by Granger Causality Test. The mediation analysis is also implemented to verify human outdoor activity as a mediator variable significantly carrying the influence of good weather to traffic congestion. The result demonstrates that outdoor activity serves as a mediator transmitting the effect of good weather on traffic congestion.