Social Machine Observatory

Social Machine Observatory

The purpose of this project is to develop a core platform and a set of associated technologies to support observation, analysis, and visualisation of social machine activity. To fulfil this ambition, we have drawn together existing Web standards and recent advances in big data technologies (e.g. Storm). At the core of the Social Machine Observatory is the Web Observatory platform which orchestrates several components for data ingestion, integration, storage, and streaming.

The platform, which is part of a multi-site network of Social Machines observatories, allows for social machine researchers to capture and share data on the Web, and to reuse this data to build analytical applications and visualisations. Furthermore, the network of Web Observatories allows for multi-institute data querying and access. The project work has lead to several research contributions, including methods for data integration and re-streaming in real-time, and methods for data storage and retrieval in the context of collecting large scale social Web data.

We have also been working with several other institutes including RPI (USA) in order to establish the Web Observatory Schema.org Metadata schema, which is an extension of the widely used data metadata vocab.

Publications
Siow, E., Wang X., & Tiropanis T. (2016).  Facilitating data-driven innovation using VOICE observatory infrastructure. Proceedings of the Workshop on Data-Driven Innovation on the Web - {DDI} {\textquotesingle}16.
De Roure, D., Hooper C., Page K. R., Tarte S., & Willcox P. (2015).  Observing Social Machines Part 2. Proceedings of the {ACM} Web Science Conference on {ZZZ} - {WebSci} {\textquotesingle}15.
Tinati, R., Wang X., Brown I., Tiropanis T., & Hall W. (2015).  A Streaming Real-Time Web Observatory Architecture for Monitoring the Health of Social Machines. Proceedings of the 24th International Conference on World Wide Web - {WWW} {\textquotesingle}15 Companion.
Brown, I., Harris L., & Hall W. (2015).  DNA. Proceedings of the {ACM} Web Science Conference on {ZZZ} - {WebSci} {\textquotesingle}15.
Luczak-Roesch, M. (2015).  INCROWD.
Tinati, R., Wang X.., Tiropanis T., & Hall W. (2015).  Building a Real-Time Web Observatory. IEEE Internet Computing. 19, 36-45.
Tinati, R., Tiropanis T., Hall W., De Roure D., & Shadbolt N. (2014).  Web Observatory.
Tiropanis, T., Hall W., Hendler J., & de Larrinaga C. (2014).  The Web Observatory: A Middle Layer for Broad Data. Big Data. 2, 129–133.
De Roure, D., Hooper C., Meredith-Lobay M., Page K. R., Tarte S., Cruickshank D., et al. (2013).  Observing social machines part 1. Proceedings of the 22nd International Conference on World Wide Web - {WWW} {\textquotesingle}13 Companion.