Artificial neural network

<nowiki>red neuronal artificial; Neuronowy nec; Gervitauganet; Rangkaian neural buatan; изкуствена невронна мрежа; rețea neurală artificială; اصطناعی عصبی جالکار; Tambajotra nerônina; Umelá neurónová sieť; штучна нейронна мережа; 人工神經網絡; 人工神经网络; Sunʼiy neyron tarmoqlari; artefarita neŭra reto; umělá neuronová síť; Vještačke neuronske mreže; কৃত্রিম নিউরাল নেটওয়ার্ক; réseau de neurones artificiels; umjetna neuronska mreža; Mạng nơ-ron nhân tạo; mākslīgais neironu tīkls; вештачка неурална мрежа; rede neural artificial; 人工神经网络; kunstig nevralt nettverk; nevralt nettverk; Süni Neyron Şəbəkələr; artificial neural network; شبكة عصبونية اصطناعية; 人工神經網絡; mesterséges neurális hálózat; Neurona-sare artifizial; rede neural artificial; искусственная нейронная сеть; Kapchisqa ankucha llika; künstliches neuronales Netz; líonra néarach; شبکه عصبی مصنوعی; 人工神經網絡; kunstigt neuralt netværk; ხელოვნური ნეირონული ქსელი; ニューラルネットワーク; Rete neural artificial; רשת עצבית מלאכותית; Artificiale neuronum rete; कृत्रिम तंत्रिका नेटवर्क; 人工神经网络; neuroverkko; Արհեստական Ջղաբջիջային Ցանց; செயற்கை நரம்பணுப் பிணையம்; rete neurale artificiale; tehisnärvivõrk; โครงข่ายประสาทเทียม; 人工神经网络; rede neural artificial; 인공 신경망; artificiellt neuronnät; вештачка невронска мрежа; Dirbtinis neuroninis tinklas; umetna nevronska mreža; Jîn-kang sîn-keng bāng-lō͘; 人工神經網絡; Արհեստական ​​նյարդային ցանց; Jaringan saraf tiruan; sieć neuronowa; കൃത്രിമ നാഡീവ്യൂഹം; kunstmatig neuraal netwerk; 人工神經網路; ଆର୍ଟିଫିସିଆଲ ନ୍ୟୁରାଲ ନେଟୱର୍କ; xarxa neuronal artificial; Yapay sinir ağları; rede neural artificial; కృత్రిమ నాడీ జీవ కణజాల వల; τεχνητό νευρωνικό δίκτυο; штучная нэўронная сетка; modello matematico ispirato ai neuroni biologici; modèle de calcul inspiré des neurones biologiques; математическая модель, построенная по принципу организации и функционирования биологических нейронных сетей; ankucha llika; Netz aus künstlichen Neuronen; modelo computacional usado em aprendizagem de máquina, baseado em funções hierárquicas conectadas; ierīce, kas paredzēta smadzeņu darbības modelēšanai; 模仿生物神經網路結構和功能的數學模型或計算模型; 主に機械学習で用いられる、人間の脳神経を模したモデルの一種; modelo computacional usado em aprendizagem de máquina, baseado em funções hierárquicas conectadas; מודל מתמטי חישובי; kunstig etterligning av biologisk nervevev fra hjernen eller det sensoriske system; υπολογιστικό μοντέλο στην μορφή κυκλώματος διασυνδεδεμένων κόμβων (παρομοιάζοντας τους βιολογικούς νευρώνες) που χρησιμοποιείται στην επίλυση προβλημάτων στον χώρο της υπολογιστικής νοημοσύνης; paradigma d'aprenentatge i processament automàtic; computational model used in machine learning, based on connected, hierarchical functions; 기계학습과 인지과학에서 생물학의 신경망에서 영감을 얻은 알고리즘; modelo computacional usado na aprendizaxe automática, baseado en funcións xerárquicas conectadas; modelo computacional; výpočetní model používaný ve strojovém učení; koneoppimisessa käytetty laskennanmalli; Redes Neuronales; Redes de neuronas; Redes Neurales; Redes neuronales artificiales; Neural Network; red neural artificial; redes neurales artificiales; redes fondes; rede neural simulada; rede neural estática; rede neural; XN; XNA; xarxa neuronal; KAL; Artiphisiyal ankucha llika; ANN; Ankucha llika; artificial neural networks; künstliche neuronale Netzwerke; líonra néarógach; شبکه‌های عصبی; 人工智慧网路; 類神經網路; 协同神经网络; 神经网络; 人工神经网络; neuralt netværk; ニューラル・ネットワーク; ニューロ; ニューラルネット; 人工ニューラルネットワーク; 神経細胞網; ニューラルネットワークモデル; 神経回路網; רשת קישרית; 人工神經網路; 神經網路; न्यूरल नेटवर्क; ఏ ఎన్ ఎన్; ఆర్టీఫిషియల్ న్యూరల్ నెట్వర్క్; 인공신경망; neuronová síť; rete neurale; ANN; reti neurali; réseaux de neurones; réseau de neurones; reseau de neurones; réseau neuronique; réseau de neuronnes; artificial Neural Network; réseau de neurone; reseau de neurones artificiels; réseaux neuroniques; réseaux neuronaux; réseau neuronal; réseau de neurones artificiel; neuronal network; réseau neuronal artificiel; närvivõrk; Mạng nơron nhân tạo; artificial neural network; ANN; неурална мрежа; umetno živčno omrežje; umetno nevralno omrežje; Artificial neural network; 神经网络; Neural network; ข่ายงานประสาทเทียม; เครือข่ายประสาทเทียม; 神经网络; kunstig nevralt nettverk; Artificial neural networks; ANN; neural network; connectionist system; connectionist systems; deep nets; Simulated Neural Network; Static Neural Network; SNN; Synergetic Neural Network; Neural Networks, Computer; neural net; artificial neural networks; Jaringan Syaraf Tiruan; Artificial Neural Network; Neuroniniai tinklai; rede neural; rede neuronal; rede neuronal artificial; нейронна мережа; штучні нейронні мережі; RNAs; RNA; rede neural; الشبكات العصبونية الاصطناعية; شبكات عصبية اصطناعية; الشبكات العصبية الإصطناعية; شبكات عصبونيه اصطناعيه; الشبكات العصبية الاصطناعية; νευρωνικό δίκτυο; искусственные нейронные сети; нейросеть; искусственная нейросеть; ИНС; нейронная сеть</nowiki>

artificial neural network 

computational model used in machine learning, based on connected, hierarchical functions
Upload media
Wikipedia  Wikibooks  Wikiversity
Pronunciation audio
Instance of	specialty field of study
Subclass of	neural network discriminative model
Facet of	artificial intelligence machine learning
Has part(s)	neuron layer loss function optimizer artificial neuron
Different from	biological neural network
Authority file  Q192776 GND ID: 4226127-2 Library of Congress authority ID: sh90001937 NDL Authority ID: 01165604 NL CR AUT ID: ph115443 BabelNet ID: 00057388n National Library of Israel J9U ID: 987007551192405171 Reasonator Scholia Wikidocumentaries KML file Search depicted

English: An artificial neural network (ANN) is an interconnected group of artificial neurons that uses a mathematical or computational model for information processing based on a connectionist approach to computation.

Structure

Neurons in artificial neural networks are generally structured in layers, each layer holding several neurons. This structure can be quite different.

Three different structures are shown here:

• 
  Neural network with one layer (without description).
• 
  Neural network with one layer (english description).
• 
  Neural network with one layer (German description).

• 
  Neural network with two layers (english description).

• 
  Neural network with one recurrent layer (without description).
• 
  Neural network with one recurrent layer (english description).
• 
  Neural network with one recurrent layer (German description).

• 
  Threshold outsourced as a bias neuron.

Neuron

A artificial neural network is build from several Neurons. A Neuron can be drawn in the following way:

• 
  Artificial neuron (without description).
• 
  Artificial neuron (english description).
• 
  Artificial neuron (German description).
• 
  Artificial neuron (French description).
• 
  Artificial neuron (without description).

Activation functions

Neurons can have different activation functions.

Three different functions are described here:

Hard limit function

A neuron with a hard limit function

$\varphi ^{\mbox{hlim}}(v)={\begin{cases}1&{\mbox{for }}v\geq 0\\0&{\mbox{for }}v<0\end{cases}}$

Piecewise linear function

$\varphi ^{\mbox{pwl}}(v)={\begin{cases}1&{\mbox{for }}v\geq {\frac {1}{2}}\\v+{\frac {1}{2}}&{\mbox{for }}-{\frac {1}{2}}<v<{\frac {1}{2}}\\0&{\mbox{for }}v\leq -{\frac {1}{2}}\end{cases}}$

Sigmoid function

A sigmoid function is also called a McCulloch-Pitts Model. can have a variable slope parameter $a$

$\varphi _{a}^{\mbox{sig}}(v)={\frac {1}{1+\exp(-av)}}.$

• 
  Hard limit activation function.
• 
  Piecewise linear activation function.
• 
  Sigmoid function with slope $a=5$.
• 
  Radial base activation function.
• 
  Hyperbolic tangens activation function.

Specific types

Recurrent neural networks

• 
  Recurrent neural network (RNN) and its unfold version
• 
  A diagram for a one-unit Long Short-Term Memory (LSTM)
• 
  A diagram for a one-unit Gated Recurrent Unit (GRU)

Elman Networks

Elman Networks are special artificial neural networks which have a memory and thus are able to represent time in an implicit way.

• 
  Elman Network without description.
• 
  Elman Network with english description.
• 
  Elman Network with german description.

Time Delay Neural Networks

Time Delay Neural Networks (TDNNs) are special artificial neural networks which receive input over several time steps. Time is represented in an explicit way. The image shows an two-layer TDNN with neuron activations.

• 
  TDNN without description.
• 
  TDNN with english description.
• 
  TDNN with german description.

See also

• Network diagram