Notes
  • AI
    • Bayesian
      • Complexity Theory
        • Constraint Satisfaction Problem
          • Cryptography
            • Data Science
              • Data
                • Data Visualization
                  • Database
                    • Dimensionality Reduction
                      • Machine Learning
                        • Classification
                          • Clustering
                            • Decision Tree
                              • Deep Learning
                                • Ensemble
                                  • Evaluation
                                    • Explainable AI
                                      • Feature Engineering
                                        • Natural Language Processing
                                          • Neural Networks
                                            • Activation Function
                                              • Convolutional Neural Network
                                                • Encoder
                                                  • Feature Selection
                                                    • Fuzzy
                                                      • General
                                                        • Adaptive Linear Unit
                                                        • Hidden Layer
                                                        • Multilayer Perceptron
                                                        • Perceptron
                                                        • Pooling
                                                        • Softmax
                                                      • Models
                                                        • Pruning
                                                          • Regularisation
                                                            • Weight Update
                                                              • Attention
                                                              • Attention Is All You Need
                                                              • Feed-forward Neural Network
                                                              • Neural Network
                                                              • Thomas Bayes (Best Solution)
                                                              • Universal Approximation Theorem
                                                              • William Occam (Best Model)
                                                            • Outlier
                                                              • Random Forest
                                                                • SVM
                                                                  • Time Series
                                                                    • Attribute Selection Method
                                                                    • Automatic Concept-Hierarchy Generation
                                                                    • Basis Function Expansion
                                                                    • Classification
                                                                    • Complexity vs. Generalization Error
                                                                    • Custom Loss Function for Linear Regression in Python
                                                                    • Decision Boundary
                                                                    • Decision List
                                                                    • Double Descent
                                                                    • Empirical Loss
                                                                    • Forest-RC
                                                                    • Generalization Loss
                                                                    • Grid Search
                                                                    • Heuristic Search
                                                                    • Kernel Trick
                                                                    • Learning Curve
                                                                    • Lineare Regression per Hand ausrechnen
                                                                    • Loss Function
                                                                    • Machine Learning
                                                                    • Majority Voting
                                                                    • Maximum Margin Separator
                                                                    • ML Pipeline
                                                                    • Model Deployment
                                                                    • Model Selection
                                                                    • Model Training
                                                                    • Nearest Neighbors Algorithm
                                                                    • Nested Cross Validation
                                                                    • Norm Loss
                                                                    • Normalization
                                                                    • Normalization by decimal scaling
                                                                    • Numerosity Reduction
                                                                    • One-Hot-Encoding
                                                                    • Online Learning
                                                                    • Optimization of a Linear Model
                                                                    • Overfitting
                                                                    • Overfitting and Underfitting
                                                                    • Performance Monitoring
                                                                    • Presidio
                                                                    • Quantile Regression
                                                                    • Randomized Search
                                                                    • Reconstruction Loss
                                                                    • Regression
                                                                    • Reinforcement Learning
                                                                    • Semi-Supervised Learning
                                                                    • Sequence To Sequence Model
                                                                    • Singular Value Decomposition
                                                                    • Sparsity
                                                                    • Stratified K-Fold Corss Validation
                                                                    • Stratified Sampling
                                                                    • Supervised Learning
                                                                    • Support Vector Machine
                                                                    • Train Validation Split
                                                                    • U-shaped Learning
                                                                    • Underfitting
                                                                    • Unsupervised Learning
                                                                  • Bias
                                                                  • Binning
                                                                  • Contingency table for binary data
                                                                  • Correlation Analysis
                                                                  • Cross-Industry Standard Process for Data Mining
                                                                  • Data Cleaning
                                                                  • Data Compression
                                                                  • Data Discretization
                                                                  • Data Ingestion
                                                                  • Data Integration
                                                                  • Data Mining in the ML and Statistics Community
                                                                  • Data Preparation
                                                                  • Data Profiling
                                                                  • Data Quality
                                                                  • Data Reduction
                                                                  • Data Segregation
                                                                  • Data Transformation
                                                                  • Gaussian Mixture Expectation Maximization
                                                                  • Gewichteter Mittelwert
                                                                  • Histogram Analysis
                                                                  • Log-Likelihood
                                                                  • Metriken
                                                                  • Min-Max Normalization
                                                                  • Sample
                                                                  • Sampling
                                                                  • Simple Matching Coefficient
                                                                • Decision Theory
                                                                  • Distances
                                                                    • Fourier Transform
                                                                      • Frequent Item
                                                                        • Graph
                                                                          • Information Theory
                                                                            • Knowledge Representation
                                                                              • Logic
                                                                                • Markov
                                                                                  • Mathematics
                                                                                    • media
                                                                                      • Optimization
                                                                                        • Other
                                                                                          • Pattern Recognition
                                                                                            • Search
                                                                                              • Sort
                                                                                                • Statistics
                                                                                                  • INDEX
                                                                                                  • MOC - Introduction to Statistics and Statistical Programming
                                                                                                  • MOC - Stochastische Modellbildung
                                                                                                  Navigation

                                                                                                  • All tags
                                                                                                  • #Algorithmus(48)
                                                                                                  • #Algorithmus, codesnippet, code, js, Python(1)
                                                                                                  • #E(1)
                                                                                                  • #Gemischt-ganzzahlige(1)
                                                                                                  • #MOC(8)
                                                                                                  • #P-hard(1)
                                                                                                  • #bachelor(1)
                                                                                                  • #code(1)
                                                                                                  • #codesnippet, code, js, programmingassignment(5)
                                                                                                  • #codesnippet, code, programmingassignment, js(1)
                                                                                                  • #confirm(1)
                                                                                                  • #data(1)
                                                                                                  • #datascience(1)
                                                                                                  • #excalidraw(11)
                                                                                                  • #infovislearn(2)
                                                                                                  • #keep(2)
                                                                                                  • #lnsexam(1)
                                                                                                  • #note(2)
                                                                                                  • #note, datascience, keep(1)
                                                                                                  • #paper(1)
                                                                                                  • #programmingassignment(4)
                                                                                                  • #question(4)
                                                                                                  • #todo(21)
                                                                                                  • #uebung(1)

                                                                                                  • Classification
                                                                                                  • Binary Classification
                                                                                                  • Perceptron

                                                                                                  • Perceptron
                                                                                                  • Activation Function
                                                                                                  • Loss Function
                                                                                                  • Gradient Descent

                                                                                                  Local graph
                                                                                                  1. Data Science /
                                                                                                  2. Machine Learning /
                                                                                                  3. Neural Networks /
                                                                                                  4. General /
                                                                                                  5. Adaptive Linear Unit

                                                                                                  Adaptive Linear Unit

                                                                                                  Similar to a Perceptron with the main difference being that we introduce an Activation Function in front of the threshold function.

                                                                                                  We calculate the error based on the Activation Function output and not on the threshold function output.

                                                                                                  Also it uses a Loss Function that is being minimized by a Gradient Descent algorithm.