Implement User Feedback Collection on Estimates

Gather user feedback on estimate accuracy and helpfulness to improve the models and strategies over time.

Earl St Sauver 3 months ago

Create public Evals page to show how estimates perform over time

Earl St Sauver 3 months ago

Expose public API

We’d like to expose a public API that others can use to generate estimates of their tasks.

Earl St Sauver 3 months ago

API

Import Codebase Context

It should be possible to give our estimator engine a snapshot of the codebase to get a sense of how development is. - We could pull git timelines to get a sense of feature velocity. Obviously not perfect, because it doesn’t account for other demands on dev time, but does show a lot of information about feature shipping speed/number of bugs/test coverage etc. - We could generate a periodic summary of how complicated/documented/well tested/easy it is to make changes in a given codebase to try and build some norms on how changing a part of the codebase is.

Earl St Sauver 3 months ago

Eng

Chat with Estimate in Context

It should be possible to chat with an estimate when it feels weird/wrong/off. If you feel like something is off, or you want to have a discussion with it, or update context, it should be possible to chat with it and updated it to get a result that more aligns with your expectations.

Earl St Sauver 3 months ago

Calibration/norms for teams

Teams should be able to provide calibration data to get estimates that better match their likely results. Different teams/environments execute at different speeds/have different development requirements. Someone vibe-coding is going to have a very different speed then a regulated environment coding in an air gapped world with legal and risk review etc.

Earl St Sauver 3 months ago

Github Integration for importing issues

Users should be able to import github issues easily to get an estimate, and updates should be posted to Github issues.

Earl St Sauver 3 months ago

Jira Integration

Users with an account/subscription should be able to @tag an issue without having a custom/enterprise account needed.

Earl St Sauver 3 months ago

Public

Create account system for users and organizations

There’s a number of down stream changes that depend on organizations being able to have relatively stable integrations against their accounts. A number of the better integrations/longer term calibration ideas need this to be lifted to the public site to work.

Earl St Sauver 3 months ago

Public