Good Start Labs - AI Model Training & Evaluation 〜 With Games

Source: original

Train and evaluate AI models with games

Simulations that measure and improve your models' key capabilities: Long-horizon reasoning, tool use, enterprise functionality, and more.

Get in touch

Trusted by

CohereArceeOpenAI

TRAIN

Improve models with reinforcement learning environments

Key PartnerArcee

Partnered with Arcee to support the training, evaluation, and data sourcing efforts of the Trinity model family.

Diplomacy map visualization showing strategic connections between territories representing multi-agent AI training environments

LIVE FEEDBACK

Make your AI better by having it learn from real people

Bad Cards

Our Bad Cards agent runs 20,000+ games weekly, getting live human feedback.

Bad Cards' 2 million+ users easily add AI agents to games with their friends.

Live feedback visualization showing human and agent interaction traces with data bars representing feedback collected across multiple evaluation cards

EVALUATE

Measure what traditional benchmarks miss

Tested across thousands of simulated scenarios covering long-term reasoning, tool use, negotiation, theory of mind, and honesty to better understand the personality of a model.

OpenAICohere

We evaluated GPT-5 ahead of release to inform model decisions. We identified high steerability and prompt sensitivity, enabling OpenAI to provide instructions on how to prompt GPT-5 and a prompt optimizer.

Evaluate visualization showing model performance metrics with risks identified across games played

LEADERBOARDS

See where top AI models rank in our games

200,000+

Matches played

Public

Open, transparent leaderboards

DiplomacyHumor

Last updated: 2026-1-15Last updated: 2026-01-15

Overall Performance

How quickly and how often does it win?

Rank| Model| Organization| Score

Loading...

See More

Published research

Advancing the field of AI training through games

Opening the Door: Democratizing Diplomacy

Accepted to NeurIPS workshop. We created the first Diplomacy environment where even small models can play full games. Our goal was to give people tools to understand how different AI models make decisions.

Read Research Paper

AI Diplomacy: Towards Understanding AI

We launched our first project AI Diplomacy. Different models revealed their true character: some betrayed without hesitation, while others, like Claude, chose principles over victory. We made AI behavior visible through Diplomacy, for 45,000 unique Twitch viewers, many experiencing AI for the first time.

Read Article

Interested in collaborating?

Connect with us

Get in touch

Ready to improve your models?

Talk to us about using our game environments for evaluation, training data, or RL environments.

[email protected]

We typically respond within 48 hours

Name *

Email *

Company

Website

What are you reaching out about? *Select an optionImproving AI modelsGetting AI live in gamesCollaborating on researchOther

Anything else?

Send Message