Interactive model
Build a hinge
A line with a change in slope at a movable threshold
The chart updates as the threshold and slope change are adjusted.
The blue segment is the added ReLU term. The black line is the resulting curve.
Threshold
2.0
Slope change
1.2
Starting slope
0.5
Before threshold
0.5
After threshold
1.7