Web Evolution and Web Science
The Web Observatory: A Middle Layer for Broad Data
The Web Observatory project is a global effort that is being led by the Web Science Trust, its network of WSTnet laboratories, and the wider Web Science community. The goal of this project is to create a global distributed infrastructure that will foster communities exchanging and using each other’s web-related datasets as well as sharing analytic applications for research and business web applications.
It will provide the means to observe the digital planet, explore its processes, and understand their impact on different sectors of human activity.
The project is creating a network of separate web observatories, collections of datasets and tools for analyzing data about the Web and its use, each with their own use community. This allows researchers across the world to develop and share data, analytic approaches, publications related to their datasets, and tools.
The network of web observatories aims to bridge the gap that currently exists between big data analytics and the rapidly growing web of “broad data,” making it difficult for a large number of people to engage with them.
Read the full paper here
The Web Science Observatory
The Web Science Observatory (or simply the Web Observatory) has been a key concept in the development of tools to help us understand how the Web develops in concert with human input. The project seeks to enable the sharing of data sets globally to allow for complex and nuanced analysis of Web interactions that may not be possible for individual research groups. Industry has strongly taken up the Web Observatoy concept with companies offering deep anlaysis to governments and corporations that can pay for them. The question remains whether the public will be equally served by sharing data for the common good.
Tiropanis, Thanassis, Hall, Wendy, Shadbolt, Nigel, De Roure, David, Contractor, Noshir and Hendler, Jim (2013) The Web Science Observatory. IEEE Intelligent Systems, 28 (2), 100-104.
Broad Data: Exploring the emerging web of data
Watch Jim Hendler’s talk about broad data below