Skip to content

pyright fork with various type checking improvements, improved vscode support and pylance features built into the language server

License

Notifications You must be signed in to change notification settings

nikaro/basedpyright

 
 

Repository files navigation

basedpyright

pypi visual studio marketplace open VSX sublime text pycharm nvim-lspconfig coc.nvim emacs Discord basedpyright - checked

Basedpyright is a fork of pyright with various type checking improvements, improved vscode support and pylance features built into the language server.

📚 Documentation | 🛝 Playground

why?

there are two main reasons for this fork:

  1. pyright is lacking several features that are made exclusive to pylance, microsoft's closed-source vscode extension
  2. the maintainer of pyright closes valid issues for no reason and lashes out at users

here is a (mostly) comprehensive list of the new features we've added to basedpyright:

ability to pin the version used by vscode

in pyright, if the vscode extension gets updated, you may see errors in your project that don't appear in the CI, or vice-versa. see this issue.

basedpyright fixes this problem by adding an importStrategy option to the extension, which defaults to looking in your project for the basedpyright pypi package.

published as a pypi package - no nodejs required

pyright is only published as an npm package, which requires you to install nodejs. the version on pypi is just an unofficial wrapper that installs node and the npm package the first time you invoke the cli, which is quite flaky.

python developers should not be expected to have to install nodejs in order to typecheck their python code. it should just be a regular pypi package like mypy, ruff, and pretty much all other python tooling. this is why basedpyright is officially published on pypi, which comes bundled with the npm package.

new diagnostic rules

reportUnreachable - report errors on code that would otherwise be completely unchecked

pyright often incorrectly marks code as unreachable. in most cases, unreachable code is a mistake and therefore should be an error, but pyright does not have an option to report unreachable code. in fact, unreachable code is not even type-checked at all:

if sys.platform == "win32":
  1 + "" # no error

by default, pyright will treat the body in the code above as unreachable if pyright itself was run on an operating system other than windows. this is bad of course, because chances are if you write such a check, you intend for your code to be executed on multiple platforms.

to make things worse, unreachable code is not even type-checked, so the obviously invalid 1 + "" above will go completely unnoticed by the type checker.

basedpyright solves this issue with a reportUnreachable option, which will report an error on such unchecked code. in this example, you can update your pyright config to specify more platforms using the pythonPlatform option if you intend for the code to be reachable.

reportAny - fully ban the Any type

pyright has a few options to ban "Unknown" types such as reportUnknownVariableType, reportUnknownParameterType, etc. but "Unknown" is not a real type, rather a distinction pyright uses used to represent Anys that come from untyped code or unfollowed imports. if you want to ban all kinds of Any, pyright has no way to do that:

def foo(bar, baz: Any) -> Any:
    print(bar) # error: unknown type
    print(baz) # no error

basedpyright introduces the reportAny option, which will report an error on usages of anything typed as Any.

reportIgnoreCommentWithoutRule - enforce that all ignore comments specify an error code

it's good practice to specify an error code in your pyright: ignore comments:

# pyright: ignore[reportUnreachable]

this way, if the error changes or a new error appears on the same line in the future, you'll get a new error because the comment doesn't account for the other error.

note that type: ignore comments (enableTypeIgnoreComments) are unsafe and are disabled by default (see #330 and #55). we recommend using pyright: ignore comments instead.

reportPrivateLocalImportUsage - prevent implicit re-exports in local code

pyright's reportPrivateImportUsage rule only checks for private imports of third party modules inside py.typed packages. but there's no reason your own code shouldn't be subject to the same restrictions. to explicitly re-export something, give it a redundant alias as described in the "Stub Files" section of PEP484 (although it only mentions stub files, other type checkers like mypy have also extended this behavior to source files as well):

# foo.py

from .some_module import a  # private import
from .some_module import b as b  # explicit re-export
# bar.py

# reportPrivateLocalImportUsage error, because `a` is not explicitly re-exported by the `foo` module:
from foo import a

# no error, because `b` is explicitly re-exported:
from foo import b

reportImplicitRelativeImport - reporting errors on invalid "relative" imports

pyright allows invalid imports such as this:

# ./module_name/foo.py:
# ./module_name/bar.py:
import foo # wrong! should be `import module_name.foo` or `from module_name import foo`

this may look correct at first glance, and will work when running bar.py directly as a script, but when it's imported as a module, it will crash:

# ./main.py:
import module_name.bar  # ModuleNotFoundError: No module named 'foo'

the new reportImplicitRelativeImport rule bans imports like this. if you want to do a relative import, the correct way to do it is by importing it from . (the current package):

# ./module_name/bar.py:
from . import foo

reportInvalidCast - prevent non-overlapping casts

most of the time when casting, you want to either cast to a narrower or wider type:

foo: int | None
cast(int, foo) #  narrower type
cast(object, foo) #  wider type

but pyright doesn't prevent casts to a type that doesn't overlap with the original:

foo: int
cast(str, foo)

in this example, it's impossible to be foo to be a str if it's also an int, because the int and str types do not overlap. the reportInvalidCast rule will report invalid casts like these.

note about casting with TypedDicts

a common use case of cast is to convert a regular dict into a TypedDict:

foo: dict[str, int | str]
bar = cast(dict[{"foo": int, "bar": str}], foo)

unfortunately, this will cause a reportInvalidCast error when this rule is enabled, because although at runtime TypedDict is a dict, type checkers treat it as an unrelated subtype of Mapping that doesn't have a clear method, which would break its type-safety if it were to be called on a TypedDict.

this means that although casting between them is a common use case, TypedDicts and dicts technically do not overlap.

reportUnsafeMultipleInheritance - ban inheriting from multiple different base classes with constructors

multiple inheritance in python is awful:

class Foo:
    def __init__(self):
        super().__init__()
class Bar:
    def __init__(self):
        ...

class Baz(Foo, Bar):
    ...

Baz()

in this example, Baz() calls Foo.__init__, and the super().__init__() in Foo now calls to Bar.__init__ even though Foo does not extend Bar.

this is complete nonsense and very unsafe, because there's no way to statically know what the super class will be.

pyright has the reportMissingSuperCall rule which, for this reason, complains even when your class doesn't have a base class. but that sucks because there's no way to know what arguments the unknown __init__ takes, which means even if you do add a call to super().__init__() you have no clue what arguments it may take. so this rule is super annoying when it's enabled, and has very little benefit because it barely makes a difference in terms of safety.

reportUnsafeMultipleInheritance bans multiple inheritance when there are multiple base classes with an __init__ or __new__ method, as there's no way to guarantee that all of them will get called with the correct arguments (or at all). this allows reportMissingSuperCall to be more lenient. ie. when reportUnsafeMultipleInheritance is enabled, missing super() calls will only be reported on classes that actually have a base class.

re-implementing pylance-exclusive features

basedpyright re-implements some of the features that microsoft made exclusive to pylance, which is microsoft's closed-source vscode extension built on top of the pyright language server with some additional exclusive functionality (see the pylance FAQ for more information).

the following features have been re-implemented in basedpyright's language server, meaning they are no longer exclusive to vscode. you can use any editor that supports the language server protocol. for more information on installing pyright in your editor of choice, see the installation instructions.

import suggestion code actions

pyright only supports import suggestions as autocomplete suggestions, but not as quick fixes (see this issue).

basedpyright re-implements pylance's import suggestion code actions:

image

semantic highlighting

before after
image image

basedpyright re-implements pylance's semantic highlighting along with some additional improvements:

initial implementation of the semantic highlighting provider was adapted from the pyright-inlay-hints project.

inlay hints

image

basedpyright contains several improvements and bug fixes to the original implementation adapted from pyright-inlay-hints.

docstrings for compiled builtin modules

many of the builtin modules are written in c, meaning the pyright language server cannot statically inspect and display their docstrings to the user. unfortunately they are also not available in the .pyi stubs for these modules, as the typeshed maintainers consider it to be too much of a maintanance nightmare.

pylance works around this problem by running a "docstring scraper" script on the user's machine, which imports compiled builtin modules, scrapes all the docstrings from them at runtime, then saves them so that the language server can read them. however this isn't ideal for a few reasons:

  • only docstrings for modules and functions available on the user's current OS and python version will be generated. so if you're working on a cross-platform project, or code that's intended to be run on multiple versions of python, you won't be able to see docstrings for compiled builtin modules that are not available in your current python installation.
  • the check to determine whether a builtin object is compiled is done at the module level, meaning modules like re and os which have python source files but contain re-exports of compiled functions, are treated as if they are entirely written in python. this means many of their docstrings are still missing in pylance.
  • it's (probably) slower because these docstrings need to be scraped either when the user launches vscode, or when the user hovers over a builtin class/function (disclaimer: i don't actually know when it runs, because pylance is closed source)

basedpyright solves all of these problems by using docify to scrape the docstrings from all compiled builtin functions/classes for all currently supported python versions and all platforms (macos, windows and linux), and including them in the default typeshed stubs that come with the basedpyright package.

examples

here's a demo of basedpyright's builtin docstrings when running on windows, compared to pylance:

basedpyright

pylance

generating your own stubs with docstrings

basedpyright uses docify to add docstrings to its stubs. if you have third party compiled modules and you want basedpyright to see its docstrings, you can do the same:

python -m docify path/to/stubs/for/package --in-place

or if you're using a different version of typeshed, you can use the --if-needed argument to replicate how basedpyright's version of typeshed is generated for your current platform and python version:

python -m docify path/to/typeshed/stdlib --if-needed --in-place

renaming packages and modules

when renaming a package or module, basedpyright will update all usages to the new name, just like pylance does:

errors on invalid configuration

in pyright, if you have any invalid config, it may or may not print a warning to the console, then it will continue type-checking and the exit code will be 0 as long as there were no type errors:

[tool.pyright]
mode = "strict"  # wrong! the setting you're looking for is called `typeCheckingMode`

in this example, it's very easy for errors to go undetected because you thought you were on strict mode, but in reality pyright just ignored the setting and silently continued type-checking on "basic" mode.

to solve this problem, basedpyright will exit with code 3 on any invalid config.

fixes for the reportRedeclaration and reportDuplicateImport rules

pyright does not report redeclarations if the redeclaration has the same type:

foo: int = 1
foo: int = 2  # no error

nor does it care if you have a duplicated import in multiple different import statements, or in aliases:

from foo import bar
from bar import bar  # no error
from baz import foo as baz, bar as baz  # no error

basedpyright solves both of these problems by always reporting an error on a redeclaration or an import with the same name as an existing import.

better defaults

we believe that type checkers and linters should be as strict as possible by default, making the user aware of all the available rules so they can more easily make informed decisions about which rules they don't want enabled in their project. that's why the following defaults have been changed in basedpyright

typeCheckingMode

used to be basic, but now defaults to all. in the future we intend to add baseline to allow for easy adoption of more strict rules in existing codebases.

pythonPlatform

used to assume that the operating system pyright is being run on is the only operating system your code will run on, which is rarely the case. in basedpyright, pythonPlatform defaults to All, which assumes your code can run on any operating system.

inline TypedDict support

pyright used to support defining TypedDicts inline, like so:

foo: dict[{"foo": int, "bar": str}] = {"foo": "a", "bar": 1}

this was an experimental feature and was removed because it never made it into a PEP. but this functionality is very convenient and we see no reason not to continue supporting it, so we added it back in basedpyright.

currently this can be disabled by setting enableExperimentalFeatures to false. in the future there will be a separate enableNonStandardFeatures option once we add more "based" features.

improved integration with CI platforms

regular pyright has third party integrations for github actions and gitlab, but they are difficult to install/set up. these integrations are built into basedpyright, which makes them much easier to use.

github actions

basedpyright automatically detects when it's running in a github action, and modifies its output to use github workflow commands. this means errors will be displayed on the affected lines of code in your pull requests automatically:

image

this is an improvement to regular pyright, which requires you to use a third party action that requires boilerplate to get working. basedpyright just does it automatically without you having to do anything special:

# .github/workflows/your_workflow.yaml

jobs:
  check:
    steps:
      - run: ...  # checkout repo, install dependencies, etc
      - run: basedpyright  # no additional arguments required. it automatically detects if it's running in a github action 

gitlab code quality reports

the --gitlabcodequality argument will output a gitlab code quality report which shows up on merge requests:

image

to enable this in your gitlab CI, just specify a file path to output the report to, and in the artifacts.reports.codequality section of your .gitlab-ci.yml file:

basedpyright:
  script: basedpyright --gitlabcodequality report.json
  artifacts:
    reports:
      codequality: report.json

basedmypy feature parity

basedmypy is a fork of mypy with a similar goal in mind: to fix some of the serious problems in mypy that do not seem to be a priority for the maintainers. it also adds many new features which may not be standardized but greatly improve the developer experience when working with python's far-from-perfect type system.

we aim to port most of basedmypy's features to basedpyright, however as mentioned above our priority is to first fix the critical problems with pyright.

note that any non-standard features we add will be optional, as we intend to support library developers who can't control what type checker their library is used with.

pypi package

basedpyright differs from pyright by publishing the command line tool as a pypi package instead of an npm package. this makes it far more convenient for python developers to use, since there's no need to install any additional tools.

for more information, see the installation instructions.

vscode extension

install

install the extension from the vscode extension marketplace or the open VSX registry

usage

the basedpyright vscode extension will automatically look for the pypi package in your python environment.

if you're adding basedpyright as a development dependency in your project, we recommend adding it to the recommended extensions list in your workspace to prompt others working on your repo to install it:

// .vscode/extensions.json

{
  "recommendations": ["detachhead.basedpyright"]
}

in .vscode/settings.json, remove any settings starting with python.analysis, as they are not used by basedpyright. you should instead set these settings using the tool.basedpyright (or tool.pyright) section in pyroject.toml (see below)

you should also disable the built in language server support from the python extension, as it conflicts with basedpyright's language server. the basedpyright extension will detect this problem and suggest fixing it automatically.

using basedpyright with pylance (not recommended)

unless you depend on any pylance-exclusive features that haven't yet been re-implemented in basedpyright, it's recommended to disable/uninstall the pylance extension.

if you do want to continue using pylance, all of the options and commands in basedpyright have been renamed to avoid any conflicts with the pylance extension, and the restriction that prevents both extensions from being enabled at the same time has been removed. for an optimal experience you should change the following settings in your .vscode/settings.json file:

  • disable pylance's type-checking by setting "python.analysis.typeCheckingMode" to "off". this will prevent pylance from displaying duplicated errors from its bundled pyright version alongside the errors already displayed by the basedpyright extension.
  • disable basedpyright's LSP features by setting "basedpyright.disableLanguageServices" to true. this will prevent duplicated hover text and other potential issues with pylance's LSP. keep in mind that this may result in some inconsistent behavior since pylance uses its own version of the pyright LSP.
{
    "python.analysis.typeCheckingMode": "off",
    "basedpyright.disableLanguageServices": true
}

(the basedpyright extension will detect this problem and suggest fixing it automatically)

playground

you can try basedpyright in your browser using the basedpyright playground

pre-commit hook

integration with pre-commit is also supported.

# .pre-commit-config.yaml

repos:
  - repo: https://github.com/DetachHead/basedpyright-pre-commit-mirror
    rev: v1.13.0  # or whatever the latest version is at the time
    hooks:
    - id: basedpyright

for more information, see the documentation here

recommended setup

it's recommended to use both the basedpyright cli and vscode extension in your project. the vscode extension is for local development and the cli is for your CI.

below are the changes i recommend making to your project when adopting basedpyright

pyproject.toml

we recommend using pdm with pyprojectx (click the "inside project" tab) to manage your dependencies.

[tool.pyprojectx]
main = ["pdm==2.12.4"]  # installs pdm to your project instead of globally

[tool.pdm.dev-dependencies]  # or the poetry equivalent
dev = [
    "basedpyright", # you can pin the version here if you want, or just rely on the lockfile
]

[tool.basedpyright]
# many settings are not enabled even in strict mode, which is why basedpyright includes an "all" option
# you can then decide which rules you want to disable
typeCheckingMode = "all"

pinning your dependencies is important because it allows your CI builds to be reproducible (ie. two runs on the same commit will always produce the same result). basedpyright ensures that the version of pyright used by vscode always matches this pinned version.

About

pyright fork with various type checking improvements, improved vscode support and pylance features built into the language server

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • TypeScript 84.1%
  • Python 15.6%
  • Other 0.3%