Current issues
in use of Big Data on the Internet

Overview of this page

This page starts with a description of the need for a world in which it truly is possible to use Big Data on the Internet and some current issues that need to be addressed first.

The advantages of the Internet (for uses other than Big Data)

Today it is possible to use a wide range of data from around the world via the Internet. The Internet has made our lives and industry much more efficient, convenient, and comfortable.

The Internet offers functions such as the following.

  • It can be used from anyplace in the world

It connects the whole world together and can be used from PCs and smartphones.

  • It makes it possible to use a wide range of data types

It can be used with text, tables, graphics, music, video, and more.

  • It can be used to combine a number of types of data

Data provided by a variety of services can be combined together on a client terminal for display on a single screen. In addition, functions from multiple services can be combined together on a client terminal to provide them as a new service (service mashup).

  • Data is distributed individually around the world.

Anybody can set up a server freely.

 

Ideal form:
Ability to use Big Data on the Internet

If it were possible to use Big Data on the Internet like other types of data, it would contribute to considerable advances in our lives and industry by being able to use an extremely diverse range of data.

  • Numerous types of data can be used combined together.

The ability to process and use combinations of Big Data provided by various servers.

  • Data can be independently distributed around the world.

Anybody can set up a Big Data server freely, and it can be used from anywhere in the world. Charging and encryption can be conducted for only the portions used.

  • Servers can handle multiple simultaneous users from around the world

Capable of handling heavy access while reducing processing load at data centers.

 

Current issue:
Current status of Internet use of Big Data

Technical issues with Big Data

As described above, there are high expectations for use of  Big Data on the Internet as a next-generation technology.

However, unlike text and graphics Big Data involves the following technical challenges:

  • Difficult of transmission over the Internet due to the large volume of data

While the speeds of the Internet have increased greatly, it still takes a long time to transmit the massive volumes of Big Data.

In addition, transfer of large volumes of Big Data involves high licensing fees.

  • Due to the large volumes of data, searching and other processing involves heavy loads.

With an ordinary database system, processing times lengthens rapidly as the volume of data increases.

Also, large-scale hardware configurations are required because when users around the world access a database the amount of processing it must handle intensifies.

  • Merging data and other processing takes a long time due to the large size of the data.

It is extremely important to use Big Data effectively by merging two or more sources of Big Data together. At present, this requires taking the Big Data to one place, merging it, and then processing it. The larger the volume of data, the longer it takes to transfer it and the longer the merge takes.

Expectations for use of Big Data

Efforts are beginning to publish and promote use of the numerous types of Big Data held by various governments, public agencies, and businesses. However, use is not advancing much due to the lack of efficient ways of publishing such data.

It should be possible to use Big Data freely and efficiently via the Internet just like other types of data.

Today, what is needed is technology that would enable the following uses:

– The ability to use Big Data from anyplace in the world from a client anyplace in the world.
– Low charges for use and telecommunications, and low costs for setup and operation of Big Data servers.
– The ability to search and process a  number of different sources of Big Data together.
– Processing on the side of the user’s client terminal rather than that of the service provider (light degree of processing on the server side).
– Charging only for the volumes of data used instead of licensing or selling a single source of Big Data as a whole.

If it were possible to exchange Big Data on the Internet in this way, then it should be possible to move ahead into a new era in which the Big Data held by governments, public agencies, and companies can be used effectively around the world through publishing it (free or at a charge) on the Internet.

Solution:
Zap-Over Technology solves this issue with Big Data

To make it truly feasible to use Big Data on the Internet, Turbo Data Laboratories has developed Zap-Over Technology, which solves the above issue and makes use of Big Data on the Internet possible.

To next page: <Technical description of Zap-Over Technology>