Visually exploring gigabyte datasets in real time – Big Data
For more articles select from Category from the footer.
What is “Big?”How much is “Big”?
Data in a form which cannot be represented in databases are known as Unstructured/Semi-structured data. A collection of a huge set of such data which conventional software is unable to capture, manage and process in a stipulated amount of time is known as “BIG DATA”. It is not an exact term it is characterized by accumulation of exponential unstructured data. It describes data sets which are large and raw which conventional relational databases are unable to analyze.
Now ‘how much is BIG’, it is a moving target size which is increasing as the day passes. Currently in 2012 it is represented by few dozen terabytes to many petabytes of data in a single data set . We also think it also depends on the context in which it is used. For example size of sets would vary if we compare astronomical data with data collected from an online feedback.
Mobile devices, remote sensing technologies, software logs, cameras, microphones, radio-frequency identification, wireless sensors, weather satellites and sensors, scientific experiments , social networks,
internet text and documents, Internet search indexing, call detail records, astronomy, atmospheric science, genomics, biogeochemical, biological, and other complex and often interdisciplinary scientific research, military surveillance, medical records, photography archives, video archives, and large-scale e-commerce, all contribute. As more and more sensors, mobile devices, cameras etc are added into the network/system as more number of people share photos, music etc, as more number of netizens join social networks the size increases