Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CZLassen failing to load SPOT files #155

Closed
chapman39 opened this issue Jan 30, 2025 · 1 comment
Closed

CZLassen failing to load SPOT files #155

chapman39 opened this issue Jan 30, 2025 · 1 comment

Comments

@chapman39
Copy link

Hello, I've been working on a script that uses hatchet came across this issue on lassen.

Steps to reproduce:

  1. ssh lassen
  2. Create test-hatchet.py file
  3. Copy paste code block from https://llnl-hatchet.readthedocs.io/en/latest/llnl.html#id3
  4. chmod +x test-hatchet.py
[meemee@lassen709:serac]$ python3 test-hatchet.py 
<IPython.core.display.Javascript object>
Traceback (most recent call last):
  File "test-hatchet.py", line 19, in <module>
    db = spotdb.connect(input_db_uri_str)
  File "/usr/gapps/spot/live//spotdb/spotdb/spotdb_base.py", line 116, in connect
    raise SpotDBError("Unknown Spot database format: " + database_key)
spotdb.spotdb_base.SpotDBError: Unknown Spot database format: ./mpi
[meemee@lassen709:serac]$ which python3
/usr/tcetmp/bin/python3

Usually I module load python/3.8, when I do that:

[meemee@lassen709:serac]$ python3 test-hatchet.py 
<IPython.core.display.Javascript object>
--------------------------------------------------------------------------------
Error: Shared object (.so) not found for cython module.
        Please run install.sh from the hatchet root directory to build modules.
--------------------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/gapps/spot/live//hatchet/ppc64le/hatchet/graphframe.py", line 24, in <module>
    from .cython_modules.libs import graphframe_modules as _gfm_cy
ImportError: dynamic module does not define module export function (PyInit_graphframe_modules)
Traceback (most recent call last):
  File "test-hatchet.py", line 13, in <module>
    import hatchet
  File "/usr/gapps/spot/live//hatchet/ppc64le/hatchet/__init__.py", line 9, in <module>
    from .graphframe import GraphFrame
  File "/usr/gapps/spot/live//hatchet/ppc64le/hatchet/graphframe.py", line 24, in <module>
    from .cython_modules.libs import graphframe_modules as _gfm_cy
ImportError: dynamic module does not define module export function (PyInit_graphframe_modules)
[meemee@lassen709:serac]$ which python3
/usr/tce/packages/python/python-3.8.2/bin/python3

It looks like the hatchet versions on LC are a bit old.

[meemee@lassen709:serac]$ ls -lha /usr/gapps/spot/live//hatchet/
total 24K
drwxrwsr-x  4 pascal spotdev 4.0K Feb  3  2021 .
drwxrwsr-x 11 pascal spotdev 4.0K Oct 10 10:58 ..
-rwxrwxr-x  1 pascal spotdev  374 Aug  3  2022 check-hatchet-perms.sh
drwxrwsr-x  7 pascal spotdev 4.0K Aug  3  2022 ppc64le
-rwxrwxr-x  1 pascal spotdev  551 Aug  3  2022 set-hatchet-perms.sh
drwxrwsr-x  7 pascal spotdev 4.0K Aug  3  2022 x86_64

Works fine on ruby though.

Should I just use thicket? Is thicket hosted on LC somewhere?

@chapman39
Copy link
Author

Closing, having been told from the Thicket team that Hatchet should not be used on lassen.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant