Shared task
VariableChecker now accounts for attribute lookups in type comments
PR #4604 ↗ · pylint-dev/pylint · · merged Jun 27, 2021 · +33 −0 · base 1e55ae64624d
what a new run launched now would send
unused-import false positive for a module used in a type comment ### Steps to reproduce ```python """Docstring.""" import abc from abc import ABC X = ... # type: abc.ABC Y = ... # type: ABC ``` ### Current behavior ``` ************* Module a /tmp/a.py:3:0: W0611: Unused import abc (unused-import) ----------------------------------- Your code has been rated at 7.50/10 ``` ### Expected behavior `unused-import` should not be emitted. ### pylint --version output Result of `pylint --version` output: ``` pylint 2.8.3 astroid 2.5.6 Python 3.9.2 (default, Feb 28 2021, 17:03:44) [GCC 10.2.1 20210110] ``` This is a follow up to #3112. Work only inside this repository checkout. Make the code change the task describes, keeping the diff focused — no drive-by refactors. When you are done, leave your changes committed or in the working tree; they are collected automatically. Stay on this snapshot checkout (`task/ycb_pylint_pr4604`). Never checkout, pull, or rebase onto `main`. That branch is a README-only orphan. Stay on this HEAD. Do not fetch another default branch. Push only on the Cursor-created `crazy-cursor/…` side branch from this HEAD.
Some past runs of this task were launched with a different prompt (the prompt template changed since, or those runs predate this benchmark's stored prompt). Each run persists the exact prompt it sent at launch — that per-launch record is the audit trail; this page shows only the current one.
| Run | Model | Verdict |
|---|---|---|
| Aug 21, 12:31 UTC · completed | composer-2.5 | PASS |
| Aug 21, 12:31 UTC · completed | grok-4.6 | PASS |
| Aug 21, 12:31 UTC · completed | grok-4.6-low |
Powered by YourCodingBench — benchmark coding models on your own repo's commits. sign in
| Aug 21, 12:31 UTC · completed | grok-4.6-medium | PASS |
| Aug 21, 12:31 UTC · completed | grok-4.6-xhigh | PASS |
Binary verdicts from the pinned judge (D27). Full attempt detail — candidate diff, transcript, timings — lives on each run page's score matrix.