Cognitive Computing R&D Group   Leadership & Business Experience  Overview

• For 2 years, Bill pioneered neuroscience-inspired innovations at Motorola, Inc.    He organized and led all-volunteer meetings to discuss the emerging "connectionist/neural network" R&D field. • Next, Bill convinced the highest Motorola management to begin a fully funded R&D group called NNDG. • For over 9 years, Bill Led and managed the NNDG. • Initially NNDG had 4 employees (i.e. the best contributors from his all-volunteer group). • Eventually, NNDG had 8 employees reporting to Bill. • Bill's typical NNDG  budget was about $1 Million per year.   (Bill's group reliably came in at, or under, budget).   • Keywords: Founder, Organizer, Leader, Manager, Fiscal Responsibility, Hiring, Products, Profits, Patents, Presentations, and Demonstrations.

Significance of this Accomplishment

• Highly successful CorDex product.  ($40 Million "spin-off") • Saved Motorola millions of dollars, by finding the root cause of semiconductor intermittent yield dips.  • Over 25 Patents Issued. • Introduced thousands of Motorolans to many neuroscience-inspired technologies (See list below). • NNDG influenced the fuzzy logic instructions included in Motorola processors (such as the Motorola/Freescale 68HC12) as well as the "AltiVec" floating point and integer SIMD (Single Instruction Multiple Data) instruction sets.

Skills Transferable to Your Projects:

Leadership / Management • Bill founded, led and managed the entire NNDG for over nine years. Theory / R&D         • Neural / Connectionist Networks:               • Self-Organizing Maps (SOM)  -Batch -Online -TreeSOM -CASOM -LISSOM               • Learning Vector Quantization (LVQ)               • Backpropagation (BP)  -Conjugate Gradient  -Momentum  -Bagging  -Through Time  -By Perturbation                • Adaptive Resonance Theory (ART)  -1  -2   -2A -3   -etc.               • Hopfield Neural Network (HOP)               • Boltzman machine  (BZM)               • Radial Basis Functions (RBF)               • Bidirectional Associative Memory (BAM)  -Discrete  -Continuous               • Support Vector Machines (SVM)               • Time Delay Neural Networks (TDNN)  -NetTalk               • Temporal Difference Learning (TD)  -TD-Gammon               • Q-learning (QL)               • Blind Source Separation (BSS)               • Independent Component Analysis (ICA)               • Growing Neural Gas (Gas), (GNG)               • Spiking Neural Networks (SNN)               • Bayesian Belief Network (BBN)         • Fuzzy Logic               • (with various definitions for conjunctions)                        • Hidden Markov Models (HMM)               • Non-hierarchical               • Hierarchical               Software • Bill Led NNDG's creation of Motorola's in-house connectionist simulator, and its many simulations such as:               • Speech Recognition               • Cursive Handwriting Recognition               • Machine Vision               • Data Mining • Bill created an original disciplined graphical schematic representation for nearly all types of neural networks.     Hardware • Bill Led NNDG's creation of custom CMOS chips and a system of 2000 processors.  NNDG influenced the fuzzy logic instructions included in Motorola processors (such as the Motorola/Freescale 68HC12) as well as the AltiVec floating point and integer SIMD instruction sets.

Patents

Issued  Patents:  More than 25. Current Owner: Motorola, Inc. Licensing availability: (Please contact Motorola). Contact Info: motorolaventures@motorola.com

Future Opportunities

By pushing beyond the current state-of-the-art, there are these opportunities: • While NNDG had to learn popular neural networks, it focused primarily on realistic principles from neuroscience. • Today, those realistic principles are paying off: There is currently a resurgence in "neural networks" such as those described in the recent book On Intelligence : (Hierarchical, Spatiotemporal, Predictive, and Neocortex-like).   • Future Opportunities in this cognitive computing field are nicely summarized by this quote:       “If you invent a breakthrough in        artificial intelligence, so machines can        learn, that is worth 10 Microsofts.”  - Bill Gates, New York Times, 1/03/2004

Links to related material

• Motorola/Freescale AltiVec floating point and integer SIMD instruction sets. • Motorola/Freescale 68HC12 • Motorola Labs - (formerly Motorola Physical Science Research Labs -PSRL)    NNDG was one of the PSRL Labs.