EfficientNet-B0 with stochastic depth and classifier dropout — forward, graph, faithfulness #
EfficientNetFullB0 and EfficientNetFullB0Eval state the sixteen-block net without its two
regularisers; the *drop* / *do* artifacts render them. This file states both forwards WITH
them, as the renderer (enetFwdChain) emits them, and proves the typed graphs denote them:
- stochastic depth (
sd, the%dp<i>inputs) — a per-example scaledropPathon the residual BRANCH, before the skip add, at the nine blocks that carry a skip (b3 b5 b7 b8 b10 b11 b13 b14 b15, the renderer'senetDropIdxs[2, 4, 6, 7, 9, 10, 12, 13, 14], block-indexed); - classifier dropout (
cd, the%doinput) — a per-elementdropoutbetween the GAP and the dense, width 1280 at every class count.
Each is Optional, as the renderer's sd / cd flags are: none renders no node, so one
statement covers efficientnet_drop_fwd (sd only), efficientnet_do_fwd (cd only) and
efficientnetin_dropdo_fwd (both), and their _eval twins at inference BatchNorm.
efficientnetFwdGraphBFullDrop_faithful/efficientnetFwdGraphBFullEvalDrop_faithful— the graph denotes the forward, at every mask;efficientnetForwardBFullDrop_none/…_ones— with no site, or at the all-ones masks the driver passes at eval, the forward ISefficientnetForwardBFull(likewise the eval twins). The identity is exact: the keep probability is folded into the mask (Training/DropPath).
The residual-block-with-drop and the dropout head are text-guarded against the renderer in
Codegen/FwdGraphTextTies at training BatchNorm (the eval graphs carry the three-block eval
graph's SSA names, as EfficientNetFullB0Eval records). These artifacts are f32. The train steps'
backward through the drop sites is outside this statement, as it is outside
EfficientNetStepTieG.
Drop-path at a site that may be absent: none is the identity.
Equations
- Proofs.dropPathOpt N n none = id
- Proofs.dropPathOpt N n (some s) = Proofs.dropPath N n s
Instances For
Dropout at a site that may be absent: none is the identity.
Equations
Instances For
At the all-ones scale drop-path is the identity.
At the all-ones mask dropout is the identity.
A residual MBConv6 block with its drop site: the scale on the branch, then the skip add
(eFwd's placement).
Equations
- One or more equations did not get rendered due to their size.
Instances For
The head with classifier dropout: 1×1 conv-bn-swish → GAP → dropout → dense.
Equations
- One or more equations did not get rendered due to their size.
Instances For
mbResidDropW at inference BatchNorm.
Equations
- One or more equations did not get rendered due to their size.
Instances For
headDoFwdB at inference BatchNorm.
Equations
- One or more equations did not get rendered due to their size.
Instances For
EfficientNet-B0 with stochastic depth and classifier dropout at training BatchNorm:
efficientnetForwardBFull with sd's nine per-example scales on the skip blocks' branches
(site k = the k-th of b3 b5 b7 b8 b10 b11 b13 b14 b15) and cd's mask before the
classifier.
Equations
- One or more equations did not get rendered due to their size.
Instances For
At the all-ones masks the forward is efficientnetForwardBFull, exactly — the masks the
driver passes to the forward artifacts.
efficientnetForwardBFullDrop at inference BatchNorm.
Equations
- One or more equations did not get rendered due to their size.
Instances For
At the all-ones masks the inference forward is efficientnetForwardBFullEval, exactly.
A dropPathB node when the site is rendered, nothing otherwise.
Equations
- Proofs.StableHLO.dropPathOptG mN none x✝ = x✝
- Proofs.StableHLO.dropPathOptG mN (some s) x✝ = Proofs.StableHLO.SHlo.dropPathB mN s x✝
Instances For
A dropoutB node when the site is rendered, nothing otherwise.
Equations
- Proofs.StableHLO.dropoutOptG mN none x✝ = x✝
- Proofs.StableHLO.dropoutOptG mN (some m) x✝ = Proofs.StableHLO.SHlo.dropoutB mN m x✝
Instances For
Residual MBConv6 with its drop site: mbResidGraphB with dropPathOptG on the branch
before the addVB — the node sequence eFwd … (drop := some i) emits.
Equations
- One or more equations did not get rendered due to their size.
Instances For
With no drop site it is mbResidGraphB.
The graph with its drop site as a weight-bundle wrapper.
Equations
- One or more equations did not get rendered due to their size.
Instances For
Head with classifier dropout: headGraphB with dropoutOptG between the GAP and the
dense, its mask the input mN (the renderer's is doName).
Equations
- One or more equations did not get rendered due to their size.
Instances For
mbResidDropGraphB at inference BatchNorm (mbResidGraphBEval's nodes).
Equations
- One or more equations did not get rendered due to their size.
Instances For
The inference graph with its drop site as a weight-bundle wrapper.
Equations
- One or more equations did not get rendered due to their size.
Instances For
headGraphBDo at inference BatchNorm (headGraphBEval's nodes).
Equations
- One or more equations did not get rendered due to their size.
Instances For
The B0 forward graph with stochastic depth and classifier dropout — the typed form of
efficientnet_drop_fwd / efficientnet_do_fwd / efficientnetin_dropdo_fwd: each skip
block's drop site reads %dp<i> at its BLOCK index i, the classifier dropout %do.
Equations
- One or more equations did not get rendered due to their size.
Instances For
The inference twin — the typed form of efficientnet_drop_fwd_eval / efficientnet_do_fwd_eval.
Equations
- One or more equations did not get rendered due to their size.