uiux
Regular
Implementing Neural Network Algorithms on Neuromorphic Processors
Description:
TECHNOLOGY AREA(S): Air Platform
OBJECTIVE: Deploy Deep Neural Network algorithms on near-commercially available Neuromorphic or equivalent Spiking Neural Network processing hardware.
DESCRIPTION: Biological inspired Neural Networks provide the basis for modern signal processing and classification algorithms. Implementation of these algorithms on conventional computing hardware requires significant compromises in efficiency and latency due to fundamental design differences. A new class of hardware is emerging that more closely resembles the biological Neuron/Synapse model found in Nature and may solve some of these limitations and bottlenecks. Recent work has demonstrated significant performance gains using these new hardware architectures and have shown equivalence to converge on a solution with the same accuracy [Ref 1].The most promising of the new class are based on Spiking Neural Networks (SNN) and analog Processing in Memory (PiM), where information is spatially and temporally encoded onto the network. A simple spiking network can reproduce the complex behavior found in the Neural Cortex with significant reduction in complexity and power requirements [Ref 2]. Fundamentally, there should be no difference between algorithms based on Neural Network and current processing hardware. In fact, the algorithms can easily be transferred between hardware architectures [Ref 4]. The performance gains, application of neural networks and the relative ease of transitioning current algorithms over to the new hardware motivates the consideration of this topic.Hardware based on Spiking Neural Networks (SNN) are currently under development at various stages of maturity. Two prominent examples are the IBM True North and the INTEL Loihi Chips, respectively. The IBM approach uses conventional CMOS technology and the INTEL approach uses a less mature memrisistor architecture. Estimated efficiency performance increase is greater than 3 orders of magnitude better than state of the art Graphic Processing Unit (GPUs) or Field-programmable gate array (FPGAs). More advanced architectures based on an all-optical or photonic based SNN show even more promise. Nano-Photonic based systems are estimated to achieve 6 orders of magnitude increase in efficiency and computational density; approaching the performance of a Human Neural Cortex. The primary goal of this effort is to deploy Deep Neural Network algorithms on near-commercially available Neuromorphic or equivalent Spiking Neural Network processing hardware. Benchmark the performance gains and validate the suitability to warfighter application.Work produced in Phase II may become classified. Note: The prospective contractor(s) must be U.S. owned and operated with no foreign influence as defined by DoD 5220.22-M, National Industrial Security Program Operating Manual, unless acceptable mitigating procedures can and have been implemented and approved by the Defense Counterintelligence and Security Agency (DCSA). The selected contractor and/or subcontractor must be able to acquire and maintain a secret level facility and Personnel Security Clearances. This will allow contractor personnel to perform on advanced phases of this project as set forth by DCSA and NAVAIR in order to gain access to classified information pertaining to the national defense of the United States and its allies; this will be an inherent requirement. The selected company will be required to safeguard classified material IAW DoD 5220.22-M during the advanced phases of this contract.
PHASE I:
Develop an approach for deploying Neural Network algorithms and identify suitable hardware, learning algorithm framework and benchmark testing and validation methodology plan. Demonstrate performance enhancements and integration of technology as described in the description above. The Phase I effort will include plans to be developed under Phase II.
PHASE II:
Transfer government furnished algorithms and training data running on a desktop computing environment to the new hardware environment. An example algorithm development frame for this work would be TensorFlow. Some modification of the framework and/or algorithms may be required to facilitate transfer. Some optimization will be required and is expected to maximize the performance of the algorithms on the new hardware. This optimization should focus on throughput, latency, and power draw/dissipation. Benchmark testing should be conducted against these metrics. Develop a transition plan for Phase III.It is probable that the work under this effort will be classified under Phase II (see Description section for details).
PHASE III:
Optimize algorithm and conduct benchmark testing. Adjust algorithms as needed and transition to final hardware environment. Successful technology development could benefit industries that conduct data mining and high-end processing, computer modeling and machine learning such as manufacturing, automotive, and aerospace industries.
KEYWORDS: Neural Networks, Neuromorphic, Processor, Algorithm, Spiking Neurons, Machine Learning
References:
1. Ambrogio, S., Narayanan, P., Tsai, H., Shelby, R., Boybat, I., Nolfo, C., . . . Burr, G. “Equivalent-Accuracy Accelerated Neural-Network Training Using Analogue Memory.” Nature, June 6, 2018, pp. 60-67. https://www.nature.com/articles/s41586-018-0180-5
2. Izhikevich, E. “Simple Model of Spiking Neurons.” IEEE Transactions on Neural Networks, 2003, pp. 1569-1572. https://ieeexplore.ieee.org/document/1257420
3. Diehl, P., Zarrella, G., Cassidy, A., Pedroni, B. & Neftci, E. “Conversion of Artificial Recurrent Neural Networks to Spiking Neural Networks for Low-Power Neuromorphic Hardware.” Cornell University, 2016. https://arxiv.org/abs/1601.04187
4. Esser, S., Merolla, P., Arthur, J., Cassidy, A., Appuswamy, R., Andreopoulos, A., . . . Modha, D. “Convolutional Networks for Fast, Energy-Efficient Neuromorphic Computing.” IBM Research: Almaden, May 24, 2016. https://arxiv.org/pdf/1603.08270.pdf
5. Department of Defense. National Defense Strategy 2018. United States Congress. https://dod.defense.gov/Portals/1/Documents/pubs/2018-National-Defense-Strategy-Summary.pdf
---
3/17/2022 Press Release - BHTech wins Phase II SBIR Award for Implementing Neural Network Algorithms on Neuromorphic Processors
The generation of real-time insights for the warfighter is an increasingly important area of interest, especially due to the growth of Electronic Warfare challenges. These insights require faster processors and smarter models that can be deployed at the edge in low Size, Weight and Power (SWaP)...
xcelaero.com
BHTech wins Phase II SBIR Award for Implementing Neural Network Algorithms on Neuromorphic Processors
The generation of real-time insights for the warfighter is an increasingly important area of interest, especially due to the growth of Electronic Warfare challenges. These insights require faster processors and smarter models that can be deployed at the edge in low Size, Weight and Power (SWaP) configurations. Traditional von-Neumann based computing architectures are challenged by the complex learning models, low power budget and real-time needs of the warfighter. To mitigate this limitation, BHTech has proposed to the United States Navy an implementation strategy using neuromorphic processors to accommodate modern SWaP and performance requirements of the warfighter.
Bascom Hunter Technologies has recently been awarded a Phase 2 Navy SBIR award for BHTech’s proposal on implementing neural network algorithms on neuromorphic processors.
During phase 1, BHTech has demonstrated in the superior performance of photonic based neurons within Continuous Neuromorphic Computing architectures for both electronic and hybrid-photonic hardware. In Phase 2, we will extend that work to create designs for a Neuromorphic Toolbox of solutions providing Electronic, Spiking Electronic and Hybrid Photonic hardware for Neural Network topologies. The Phase 2 Option will develop these designs into benchtop prototypes. The Phase 2 Option will also include the development of a VPX Neuromorphic Hardware that is HOST compatible. In Phase 3 we will be looking at optimizing solutions for the Navy and creating deployable Neuromorphic Hardware. This will be based on the Neuromorphic Hardware Toolbox that was started in Phase 2 as well as the development of BASE (Bascom Hunter’s AI Software Environment), which will aid the rapid migration of machine learning algorithms from Desktop Computing Systems to Edge Computing modules.
Neuromorphic Processors provide a realistic solution to obtaining real-time insights for the warfighter by leveraging an architecture that more closely resembles the Human Brain and are better suited to run Neural Network models. Our toolbox approach allows the best hardware architectures to be matched with the best software solutions, enabling the rapid conversion of cutting-edge technology into ruggedized, modular hardware. Our Hardware and Software Toolboxes will bring immediate benefits to warfighters in the Navy and beyond by extracting actionable insights in real-time at the edge (eliminating the latency problem when processing in the cloud). One application is the real-time identification of Radio Frequency (RF) emitters using Neuromorphic processors operating via trained Neural Networks.
Originally discovered by @Quatrojos ..
epartment of Defense
