← back

Project Kaleidoscope: Contextual, Human-Aligned Evaluation for Real-World AI App

Evaluations (Evals) are a deployment bottleneck for real-world AI applications: public benchmarks rarely match a team's users, context, or policies, and human review is often tedious to scale. Motivated by our work with AI applications in t

https://arxiv.org/abs/2607.14673v1 ↗
Thesis fit
Good fit

Within your typical scope; diligence still required.

Edit thesis
In your usual scope
Idea match Moderate

How close the company’s idea is to your thesis statement

Sector ai

Overlap with sectors you care about

Geography Unknown

Location unknown — scores 0

Your thesis: “We back exceptional technical founders building AI-first products and infrastructure, deploying $100K checks within 24 hours.”

Founder → stable Traction → stable Idea vs market → stable
Generate memo
Add / edit details

Correct facts used on the next screening or memo.

Similar baseline plays (YC · idea space)

Baserun · Active
Observability and evaluation platform for LLM apps.
founders not scraped yet
Instance · Active
Automated evals for robot policies
Ellipsis · Active
AI code reviews & bug fixes
founders not scraped yet
LLM Stats · Active
Independent AI evaluations lab
founders not scraped yet