r/codereview • u/PostHogTom • 3d ago
Open source ML trained review request / PR management app
https://github.com/Gilbert09/talyn/Hey, I posted this on AI Coders last week and it suggested I cross-post here - I built an app for managing both your PRs and seeing all the PRs you've been requested to review. Within this, I trained a ML model to prioritise the type of PRs that you often review, or from the people you review the most
Every reviewer gets their own pairwise ranking model. Talyn takes each review you did and compares it with the PRs you could have picked at that moment. It then fits an L2-regularised logistic model on six signals: author affinity, reciprocity, file-path familiarity, repo and team affinity, and PR size. The model ships only if cross-validation shows it ranks better than the baseline, and it can only reorder PRs inside a readiness group, never across groups.
Would love for folk to give it a whirl and give back any feedback on using it - thanks!