Approximating the Heaviside step function & its derivative with sigmoids
Top: Smooth approximations to
H(x) = 0 (x < 0), 1 (x > 0)
using
sigmoid(x; σ) = 1 / (1 + e^{-σ x})
for σ = 1 (orange), 2 (green), 4 (red), 8 (purple). Larger σ → sharper step.
Bottom: Their derivatives
d/dx [sigmoid] = σ ⋅ sigmoid(x; σ) ⋅ (1 − sigmoid(x; σ))
which converge to the Dirac delta δ(x) as σ → ∞.
This Enables gradient-based optimization in neural networks and physics simulations where the true step function is non-differentiable.
Apparently a lot of you think I’m bad at my job and get paid too much for it.
The truth is, you’re engaging and growing my account and I get paid in chick-fila-a gift vouchers.
Solana Perps
Apple’s two-year-old partnership with OpenAI has become strained, according to people familiar with the matter, with the AI startup failing to see the expected benefits from the deal and now preparing possible legal action. @markgurman reports
Apple’s $AAPL two-year partnership with OpenAI has become strained
OpenAI has reportedly failed to see the expected benefits from the deal and now preparing possible legal action - Bloomberg