← back

Long-Context Fine-Tuning with Limited VRAM

Parameter-efficient fine-tuning reduces model and optimizer memory, but dense attention still makes long training sequences expensive. We combine Hierarchical Global Attention (HGA) with segment-wise backpropagation and tiered KV storage. O

https://arxiv.org/abs/2607.15105v1 ↗
Thesis fit
Good fit

Within your typical scope; diligence still required.

Edit thesis
In your usual scope
Idea match Light

How close the company’s idea is to your thesis statement

Sector ai

Overlap with sectors you care about

Geography Unknown

Location unknown — scores 0

Your thesis: “We back exceptional technical founders building AI-first products and infrastructure, deploying $100K checks within 24 hours.”

Founder → stable Traction → stable Idea vs market ↓ declining
Generate memo
Add / edit details

Correct facts used on the next screening or memo.

Activity & evidence

Similar baseline plays (YC · idea space)

Compresr · Active
LLM context compression for better accuracy
founders not scraped yet
Dragoneye · Active
Custom video detection models in less than 5 minutes
founders not scraped yet
Cloudglue · Active
The video context layer for AI.
founders not scraped yet
Strong Compute · Active
10x-1000x faster compute for Neural Network training
founders not scraped yet
deepsilicon · Inactive
Software and hardware to run neural networks faster and cheaper
founders not scraped yet