Python version used in rez-build automatically become a requirement? #1443

Anti-Distinctlyminty · 2023-02-12T17:12:17Z

Anti-Distinctlyminty
Feb 12, 2023

I have been building packages using rez in python-3.9, up until recently where I needed to add python-3.7 as a package due to Houdini using that version. So now my Houdini packages have python-3.7 as a weak reference.
As part of my build process I use a package, and here is its definition:

name = "sesi_download_api"

version = "0.1.0"

build_requires = ["python-3"]

build_command = "python {root}/build.py"

requires = [
    "python-3",
    "python_dotenv",
    "semantic_version",
    "rez_utils",
]

uuid = "d56ac672-507e-11ed-91b7-e0d55e201446"

def commands():
    env.PYTHONPATH.append("{root}")

(All build.py does is copy the source files)

Note that the package requirement is for python-3 only. However, now when I try to build I get the following conflict:

================================================================================
Building houdini-19.5.435...
================================================================================

================================================================================
Building variant 0 (1/1)...
================================================================================
Resolving build environment: '~python-3.7' platform-windows arch-AMD64 python-3 sesi_download_api
resolve failed, by luke@WORKSTATION03, on Sun Feb 12 17:44:33 2023, using Rez v2.112.0

requested packages:
~python-3.7
platform-windows
arch-AMD64
python-3
sesi_download_api
~platform==windows           (implicit)
~arch==AMD64                 (implicit)
~os==windows-10.0.19045.SP0  (implicit)

The context failed to resolve:
The following package conflicts occurred: (python-3.9 <--!--> python==3.7.9)

Resolve paths starting from initial requests to conflict:
  python-3.7 --> python-3.7.9
  sesi_download_api --> sesi_download_api-0.1.0 --> python-3.9

To see a graph of the failed resolution, add --fail-graph in your rez-env or rez-build command.

The build environment could not be resolved:
The following package conflicts occurred: (python-3.9 <--!--> python==3.7.9)

The package has no requirement for python-3.9, so is this getting baked in somehow from when I build the package using python-3.9?

Answered by maxnbk

Feb 12, 2023

build_requires is propagating a python-3 non-weak requirement to the build requirements of your houdini package.
You might have more success with private_build_requires, if I'm interpreting your situation correctly.

This has been a source of mistakes by many in the past, and I think our docs should clarify it better.

View full answer

maxnbk · 2023-02-12T17:25:13Z

maxnbk
Feb 12, 2023
Maintainer

build_requires is propagating a python-3 non-weak requirement to the build requirements of your houdini package.
You might have more success with private_build_requires, if I'm interpreting your situation correctly.

This has been a source of mistakes by many in the past, and I think our docs should clarify it better.

5 replies

Anti-Distinctlyminty Feb 12, 2023
Author

Hi maxnbk, thank you for the response.

build_requires is propagating a python-3 non-weak requirement to the build requirements of your houdini package.

This is where I'm confused. The build_requires just states python-3, nothing more specific. So where is the requirement for 3.9 coming from?

JeanChristopheMorinPerso Feb 12, 2023
Maintainer

@Anti-Distinctlyminty you can use rez-build --fail-graph to get the dependency graph. It'll show you where the conflict comes from.

Anti-Distinctlyminty Feb 12, 2023
Author

Hi @JeanChristopheMorinPerso,
It would appear that something is wrong...

output

================================================================================
Building houdini-19.5.435...
================================================================================

================================================================================
Building variant 0 (1/1)...
================================================================================
Resolving build environment: '~python-3.7' platform-windows arch-AMD64 python-3 sesi_download_api
resolve failed, by luke@WORKSTATION03, on Sun Feb 12 20:23:03 2023, using Rez v2.112.0

requested packages:
~python-3.7
platform-windows
arch-AMD64
python-3
sesi_download_api
~platform==windows           (implicit)
~arch==AMD64                 (implicit)
~os==windows-10.0.19045.SP0  (implicit)

The context failed to resolve:
The following package conflicts occurred: (python-3.9 <--!--> python==3.7.9)

Resolve paths starting from initial requests to conflict:
  python-3.7 --> python-3.7.9
  sesi_download_api --> sesi_download_api-0.1.0 --> python-3.9

To see a graph of the failed resolution, add --fail-graph in your rez-env or rez-build command.

The build environment could not be resolved:
The following package conflicts occurred: (python-3.9 <--!--> python==3.7.9)
rendering image to C:\Users\luke\AppData\Local\Temp\resolve-dot-tgbdla90.png...
Traceback (most recent call last):
  File "c:\opt\rez\lib\site-packages\rez\cli\build.py", line 158, in command
    builder.build(install_path=opts.prefix,
  File "c:\opt\rez\lib\site-packages\rezplugins\build_process\local.py", line 52, in build
    num_visited, build_env_scripts = self.visit_variants(
  File "c:\opt\rez\lib\site-packages\rez\build_process.py", line 208, in visit_variants
    result = func(variant, **kwargs)
  File "c:\opt\rez\lib\site-packages\rezplugins\build_process\local.py", line 336, in _build_variant
    build_result = self._build_variant_base(
  File "c:\opt\rez\lib\site-packages\rezplugins\build_process\local.py", line 217, in _build_variant_base
    context, rxt_filepath = self.create_build_context(
  File "c:\opt\rez\lib\site-packages\rez\build_process.py", line 270, in create_build_context
    raise BuildContextResolveError(context)
rez.exceptions.BuildContextResolveError: The build environment could not be resolved:
The following package conflicts occurred: (python-3.9 <--!--> python==3.7.9)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "c:\opt\rez\lib\site-packages\rez\vendor\pydot\pydot.py", line 1906, in create
    stdout_data, stderr_data, process = call_graphviz(
  File "c:\opt\rez\lib\site-packages\rez\vendor\pydot\pydot.py", line 122, in call_graphviz
    process = subprocess.Popen(
  File "C:\Program Files\Python39\lib\subprocess.py", line 951, in __init__
    self._execute_child(args, executable, preexec_fn, close_fds,
  File "C:\Program Files\Python39\lib\subprocess.py", line 1420, in _execute_child
    hp, ht, pid, tid = _winapi.CreateProcess(executable, args,
FileNotFoundError: [WinError 2] The system cannot find the file specified

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Program Files\Python39\lib\runpy.py", line 197, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "C:\Program Files\Python39\lib\runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "C:\opt\rez\Scripts\rez\rez-build.exe\__main__.py", line 7, in <module>
  File "c:\opt\rez\lib\site-packages\rez\cli\_entry_points.py", line 106, in run_rez_build
    return run("build")
  File "c:\opt\rez\lib\site-packages\rez\cli\_main.py", line 191, in run
    returncode = run_cmd()
  File "c:\opt\rez\lib\site-packages\rez\cli\_main.py", line 183, in run_cmd
    return func(opts, opts.parser, extra_arg_groups)
  File "c:\opt\rez\lib\site-packages\rez\cli\build.py", line 169, in command
    view_graph(g)
  File "c:\opt\rez\lib\site-packages\rez\utils\graph_utils.py", line 279, in view_graph
    dest_file = _write_graph(graph_str, dest_file=dest_file)
  File "c:\opt\rez\lib\site-packages\rez\utils\graph_utils.py", line 304, in _write_graph
    save_graph(graph_str, dest_file)
  File "c:\opt\rez\lib\site-packages\rez\utils\graph_utils.py", line 248, in save_graph
    return save_graph_object(graphs[0], dest_file, fmt, image_ratio)
  File "c:\opt\rez\lib\site-packages\rez\utils\graph_utils.py", line 266, in save_graph_object
    write_fn(dest_file)
  File "c:\opt\rez\lib\site-packages\rez\vendor\pydot\pydot.py", line 1726, in new_method
    self.write(
  File "c:\opt\rez\lib\site-packages\rez\vendor\pydot\pydot.py", line 1811, in write
    s = self.create(prog, format, encoding=encoding)
  File "c:\opt\rez\lib\site-packages\rez\vendor\pydot\pydot.py", line 1916, in create
    raise OSError(*args)
FileNotFoundError: [WinError 2] "dot" not found in path.

This is odd, as I swear I've used this feature in the past

JeanChristopheMorinPerso Feb 12, 2023
Maintainer

Well, somehow the dot executable is not in your $PATH.

Anti-Distinctlyminty Feb 12, 2023
Author

Apologies - I thought that rez shipped with what it needed to produce the graphs.

That seemed to make it a fair bit more obvious. Much obliged gentlemen.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Python version used in rez-build automatically become a requirement? #1443

{{title}}

Replies: 1 comment 5 replies

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

Select a reply

Python version used in rez-build automatically become a requirement? #1443

Anti-Distinctlyminty Feb 12, 2023

Replies: 1 comment · 5 replies

maxnbk Feb 12, 2023 Maintainer

Anti-Distinctlyminty Feb 12, 2023 Author

JeanChristopheMorinPerso Feb 12, 2023 Maintainer

Anti-Distinctlyminty Feb 12, 2023 Author

JeanChristopheMorinPerso Feb 12, 2023 Maintainer

Anti-Distinctlyminty Feb 12, 2023 Author

Anti-Distinctlyminty
Feb 12, 2023

Replies: 1 comment 5 replies

maxnbk
Feb 12, 2023
Maintainer

Anti-Distinctlyminty Feb 12, 2023
Author

JeanChristopheMorinPerso Feb 12, 2023
Maintainer

Anti-Distinctlyminty Feb 12, 2023
Author

JeanChristopheMorinPerso Feb 12, 2023
Maintainer

Anti-Distinctlyminty Feb 12, 2023
Author