← back

Sparse Inter-Layer Dependencies of Transformer FFN Neurons

Feedforward network (FFN) blocks account for a large fraction of the parameters and computation in Transformer architectures, yet their internal structure remains difficult to interpret due to the additive superposition induced by the resid

https://arxiv.org/abs/2607.11990v1 ↗
Thesis fit
Good fit

Within your typical scope; diligence still required.

Edit thesis
In your usual scope
Idea match None

How close the company’s idea is to your thesis statement

Sector ai

Overlap with sectors you care about

Geography Unknown

Location unknown — scores 0

Your thesis: “We back exceptional technical founders building AI-first products and infrastructure, deploying $100K checks within 24 hours.”

Founder → stable Traction → stable Idea vs market ↓ declining
Generate memo
Add / edit details

Correct facts used on the next screening or memo.

Similar baseline plays (YC · idea space)

deepsilicon · Inactive
Software and hardware to run neural networks faster and cheaper
founders not scraped yet
Baud · Active
AI chips for ultra-fast model training and inference
Well Principled · Active
The neural engine for autonomous robots
founders not scraped yet
Reduced Energy Microsystems · Inactive
Building the lowest-power silicon for embedded deep learning and…
founders not scraped yet
PowerMatrix · Active
Efficient and compact power supply for AI hardware
founders not scraped yet