← back

PROBE: Benchmarking Code Generation in Large Language Models

Large Language Models (LLMs) are increasingly being used in everyday software engineering tasks, particularly in automated code generation. Despite their widespread adoption, these models remain far from perfect, making systematic and fair

https://arxiv.org/abs/2607.13820v1 ↗
Thesis fit
Good fit

Within your typical scope; diligence still required.

Edit thesis
In your usual scope
Idea match Light

How close the company’s idea is to your thesis statement

Sector llm, ai

Overlap with sectors you care about

Geography Unknown

Location unknown — scores 0

Your thesis: “We back exceptional technical founders building AI-first products and infrastructure, deploying $100K checks within 24 hours.”

Founder → stable Traction → stable Idea vs market → stable
Generate memo
Add / edit details

Correct facts used on the next screening or memo.

Similar baseline plays (YC · idea space)

Compresr · Active
LLM context compression for better accuracy
founders not scraped yet
Ollama · Active
Get up and running with large language models.
founders not scraped yet
Langfuse · Acquired
Open source LLM engineering platform
founders not scraped yet
LiteLLM · Active
Call every LLM API like it's OpenAI [100+ LLMs]
founders not scraped yet
Datacurve · Active
Frontier coding data for training and evaluating LLMs
founders not scraped yet