In August 2015, Big Data moved beyond the Gartner's Emerging Cycle Hype rankings and made a big splash on the world's technology trends.

If you do not fully understand or miss important information about Big Data technology, this article will help you update the most detailed information about everything you need to know about Big Data technology.

 

Big Data - What does it mean?

As defined by Gartner: “Big Data is an information asset, which has a large amount of data, high speed and diverse data, requiring new technologies to handle effectively to bring making effective decisions, uncovering hidden elements in data and optimizing data processing”

Let's dig deeper and understand this in a simpler way.

The term "Big Data" is a very large set of data that conventional computing techniques cannot handle. The term "Big Data" refers not only to data but also to the data organization structure, related tools and technologies.

The advancement of technology, the introduction of new channels of communication such as social networks and more advanced new technology devices poses challenges for different industries to find other ways to handle data.

From its creation until the end of 2003, the world only had about 5 billion gigabytes of data. The same amount of data was created in just 2 days in 2011. By 2013, this amount of data was generated every 10 minutes. Therefore, it is not surprising that 90% of the world's data is now generated in the last few years.

All of this data was extremely useful but it was neglected before the term "Big Data" came into being.

Pro tip: Learn about Big Data technology and you can get into the big data science industry. Certifications that can assist you are: Big Data professional training certification or in technologies like Impala, Cassandra, Spark and Scala.

Main sources of Big Data:

Data black box: this is data generated by aircraft, including jets and helicopters. This data black box includes information generated by the crew's voice, audio recordings and flight information.

Data from social media channels: These are data created and developed by like social media sites like Twitter, Facebook, Instagram, Pinterest and Google+.

Stock transaction data: This is data from the stock market for the decision to buy and sell stocks made by customers.

Electricity data: this is data generated by electricity. It includes specific information from the intersection points of the information nodes used.

Traffic data: this data includes vehicle capacity and vehicle patterns, availability and distance traveled by each vehicle.

Search device data: this is data generated by search engines and this is also Big Data's largest data source. Search engines have extremely large databases where they can find the data they need.

In addition, Bernard Marr, a Big Data expert and analyst, has put together a list of 20 reputable Big Data sources that people can access for free on the site. Here are some examples:

Data.gov - where everyone is free to access all US Government data including information ranging from climate to criminals in custody.

Data.gov.uk - similar place of the British Government. Here, people can gather metadata on all British books and publications since 1950.

There is also the US Census Bureau - which includes valuable information such as population, geography and other data. Similarly is the European Union open repository, which includes census data from European Union organizations, and one of our favorites is Facebook. The FB charts provide us with information and the interface of the application, after accessing the public information provided by the users. In Health care, that is Healthdata.gove of the US and Social and Health Care Information Center, from the UK

Google Trends public data sets, Google Finance, Amazon Web Services, are similar examples.