Please note that JavaScript and style sheet are used in this website,
Due to unadaptability of the style sheet with the browser used in your computer, pages may not look as original.
Even in such a case, however, the contents can be used safely.

  1. Home
  2. Press Releases
  3. NEC develops big data software technology that enables real-time processing

NEC develops big data software technology that enables real-time processing at world-class speed

*** For immediate use December 3, 2013

Tokyo, December 3, 2013 - NEC Corporation (NEC; TSE: 6701) has developed a big data software technology that enables real-time processing at world-class speed and at a low cost.

The new technology will speed up analysis of big data to enable prompt use of analysis results (for risk aversion based on prediction and forecasting, etc.).

There are increasing expectations towards the utilization of big data for a wide range of purposes, including the instantaneous analysis of digitized text and numerical information, as well as voice, image and other complex, diverse, and large-scale information used for optimizing management and reducing risks. However, digitizing large-scale image data and conducting precise and elaborate calculations, for example, involve a high level of computational complexity and require a large amount of time, thereby calling for expensive dedicated systems in order to conduct processing in real time.

To address this problem, NEC developed a new software technology (*1) for more effectively utilizing generic many-core servers (*2), which are suitable for high-speed processing. The new software technology enables (1) efficient parallelization of application programs that implement analytical processing and (2) uniform distribution of parallelized processing into multiple processor cores. This technology thus realizes much faster processing compared to conventional systems, at low cost and without the need for dedicated systems.

To verify the benefits of this new technology, NEC applied the technology in processing that involves detecting individuals from an image showing several hundred persons using a many-core server (*3) composed of more than 100 processor cores. The test showed that processing which conventionally required a few minutes could be completed in less than one second, indicating that processing speed can be increased by more than 100 times with the use of the technology.

The following are key features of the new software technology:

  1. NEC-developed parallelization technology for many-core servers
    Applying the program-parallelization technology NEC has nurtured in the development of vector-type supercomputers, it developed a new technology for easily converting unparalleled programs into programs suitable for parallel processing. This has enabled the allocation of programs that were previously only possible to allocate into a few processor cores into more than 100 processor cores within generic many-core servers, thereby realizing drastic improvement in processing speed.

  2. Load-distribution technology for maximizing server capacity
    NEC developed a technology to instantly distribute disparities in processing load that arise between processor cores during parallel processing. Hierarchical load control for automatically transferring processing from high-load processors to those with low load makes it possible to maximize the capacity of generic many-core servers.

Going forward, NEC will continue to research and develop software technologies and to actively pursue the development of new methods for utilizing big data.



(*1) Offered as a library for use by program developers

(*2) Server equipped with tens to hundreds of processors

(*3) Two Intel (R) Xeon Phi (TM) core processors built into NEC Express5800/HR120b-1

About NEC Corporation
NEC Corporation is a leader in the integration of IT and network technologies that benefit businesses and people around the world. By providing a combination of products and solutions that cross utilize the company's experience and global resources, NEC's advanced technologies meet the complex and ever-changing needs of its customers. NEC brings more than 100 years of expertise in technological innovation to empower people, businesses and society.  For more information, visit NEC at

NEC is a registered trademark of NEC Corporation. All Rights Reserved. Other product or service marks mentioned herein are the trademarks of their respective owners. (C)2013 NEC Corporation.