Skip to content

Optimize AI reviews #448

@Gusarich

Description

@Gusarich

Currently they take up to 2h in worst cases. This is bad for DX. We should optimize the pipeline to complete within 5-10 minutes for most cases and only go for up to 30 minutes for whole new articles.

Ideas:

  • Remove validation stage. It will probably add some false positives but on the other hand the speedup will be about 2x and the coverage will also slightly improve.
  • Prioritize high-severity issues and do not go for low-severity ones at all during PR reviews. This one is actually quite promising when paired with auto-fixes. While reviewing, we could just look for high-severity problems, then get them resolved, then merge, and then at some point in the future do a full run (automatically) looking for low-severity issues and open a new PR with AI-generated fixes. Expected result: reviews and time-to-merge are much quicker, and we don't lose on quality in long-term.

Metadata

Metadata

Assignees

Labels

scope: aiStandalone or auxiliary AI-related tasks and ideas

Type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions