Confusion about dev dependencies - what controls them?

[Destroy666x]

Hello,

I'm probably missing something obvious, but using pdm for the 1st time and I'm having a hard time figuring out how to install dev dependencies. I have this section:

[tool.pdm.dev-dependencies]
style = [
  'black==2.9.*',
  'ruff==0.0.*',
]

test = [
  'pytest==7.4.*',
]

After reading the documentation, I'd assume that these will be installed by default with pdm install. But they aren't. And pdm install -d reports:

[PdmUsageError]: Requested groups not in lockfile: test,style

which doesn't quite make sense to me as the install command is supposed to modify the lock file.

What am I missing? I'm using pdm 2.9.3.

[sr-murthy]

pdm install installs the dependencies specified in a lockfile - either the default root-level lockfile, if no -L option is given, or any lockfile specified with -L.

If you leave out -L /path/to/lockfile then pdm install will use the default lockfile, pdm.lock, in your root directory, and in your case it looks like your default lockfile does not contain those dev dependencies in pyproject.toml.

I suppose one way of syncing the default lockfile with pyproject.toml is to run pdm update -d, which will result in possible package updates in pyproject.toml in both the default (production) and dev. dependencies, if newer versions were detected upstream, as well as resulting changes to the lockfile and your working set. So in your case I would first run:

pdm update -d

As this would end up installing any new or updated dependencies in your working environment from an updated lockfile, a subsequent pdm install wouldn't be necessary.

So, basically your lockfile(s) should be in sync with your pyproject.toml, and then pdm install would work.

[Destroy666x]

Did you have the other packages listed in pyproject.toml in style group? That diff states otherwise

[sr-murthy]

No @Destroy666x I did not have a style group prior to running this command. The diff I posted is what I'm seeing and does not suggest otherwise: the style group with black was added to dev deps, and that's it.

[sr-murthy]

You did not post the full output of your commands. Please do that, and then we can verify your assertions.

[Destroy666x]

I listed the command and what I had in pyproject.toml before I ran it, then I wrote what the result was. There's nothing else involved. I'll leave it at that and will wait for tool's author confirmation if this is how this works.

[sr-murthy]

Sure, but I was just trying to reproduce your error, which I could not.

[sr-murthy]

@frostming This raises a question. We have a pdm sync that syncs the working set with the lockfile, but do we need to extend this to pyproject.toml as well, so syncing between pyproject.toml <-> lockfile <-> working set?

[frostming]

@frostming This raises a question. We have a pdm sync that syncs the working set with the lockfile, but do we need to extend this to pyproject.toml as well, so syncing between pyproject.toml <-> lockfile <-> working set?

that's what pdm install does