Repository navigation
QST: Install from source without blas with pip #24703
Description
Activity
Besides the "wheels are coming", the answer to the question when you build from source is (as hinted at in the error message) that this works:
$ # the -C syntax requires pip 23.1; for older pip versions replace it with --config-settings= $ pip install numpy -C-Dallow-noblas=true $ # or with pypa/build from a local repo $ python -m build -C-Dallow-noblas=true
There is no environment variable to do the same thing. We may relax the requirement for having BLAS installed, but I think it'd be good to see how many people find the current state a problem with the final 1.26.0 release which will include 32-bit Windows wheels.
While the question is answered, let's leave this issue open until at least a week after the 1.26.0 release date, so it's easier to discover for others.
For anyone who runs into this - based on:
This is the syntax for pip:
python -m pip install numpy --config-settings=setup-args="-Dallow-noblas=true"Reacted by Brandon Elliott, larin92, Hosam, Agriya Khetarpal and FlorianWe may relax the requirement for having BLAS installed, but I think it'd be good to see how many people find the current state a problem with the final 1.26.0 release which will include 32-bit Windows wheels.
This will be an issue for aarch64 users on musl based systems as numpy does not provide binary wheels for that. We (linuxserver.io) are facing that issue on our docker images that are alpine based with aarch64 images
Reacted by ber2st, Dave Lane, Wilmar den Ouden and Brandon Rhodes@aptalca thanks for that comment. To make sure I'm understanding it right: are you saying that you're seeing failed builds and that's a problem, or also that it's fine to avoid the failed builds by default by building fallback linear algebra routines that may be ~50x slower?
Sorry, I should have clarified.
We are seeing failed builds due to the newly enforced openblas requirement. Previously, numpy would build without openblas just fine. Now we have to either add openblas or add the build argument to allow building without openblas.
In most cases (for us) the speed difference is not noticeable as the apps we build don't rely on complex calculations.
Reacted by Ralf Gommers, ber2st and Hosam- added 2 commits that reference this issue
on Sep 21, 2023 I am trying to install:
~/klippy-env/bin/pip install -v numpyI get this error:
Library m found: YES
Found CMake: /usr/bin/cmake (3.18.4)
WARNING: CMake Toolchain: Failed to determine CMake compilers state
Run-time dependency openblas found: NO (tried pkgconfig and cmake)
Run-time dependency openblas found: NO (tried pkgconfig and cmake)../../numpy/meson.build:207:4: ERROR: Problem encountered: No BLAS library detected! Install one, or use the
allow-noblasbuild option (note, this may be up to 100x slower for some linear algebra operations).A full log can be found at /tmp/pip-install-gmgwihuj/numpy_9524064cd0ae4863b894d750518a40a5/.mesonpy-utl0nn8j/build/meson-logs/meson-log.txt
error: subprocess-exited-with-error× Preparing metadata (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> See above for output.note: This error originates from a subprocess, and is likely not a problem with pip.
full command: /home/pi/klippy-env/bin/python /home/pi/klippy-env/lib/python3.9/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py prepare_metadata_for_build_wheel /tmp/tmp2fcjefqc
cwd: /tmp/pip-install-gmgwihuj/numpy_9524064cd0ae4863b894d750518a40a5
Preparing metadata (pyproject.toml) ... error
error: metadata-generation-failed× Encountered error while generating package metadata.
╰─> See above for output.note: This is an issue with the package mentioned above, not pip.
hint: See above for details.[notice] A new release of pip is available: 23.2 -> 23.2.1
[notice] To update, run: python -m pip install --upgrade pip
pi@voron:~ $I tried to do this python update, but apparently it doesn't update either. I have no idea what to do.
Thanks in advance.Reacted by theangkko@Itsmittyhere what version of python are you using on what platform? Do you intend to build from source? You need to install the development version of a BLAS library.
FWIW: I ran into this one while using cibuildwheel to build a package that relies on NumPy. Based on your discussion, I have to imagine there's some way of configuring
setup.cfgto specify "allow-noblas" somehow, but since I have no particular need for supporting PyPy/i686, I could get around it by adding[tool.cibuildwheel] skip = ["pp*", "*i686"]
to
pyproject.toml.Reacted by Severin Simmler9 remaining items
@rgommers replacing
cmakewithpkg-configresolved it. Thank you!Reacted by Ralf GommersIt would be nice to debug why the CMake files supplied with openblas are not sufficient. Is there a command-line interface to the cmake module discovery mechanism?
Just adding to the above comments, I just ran into the same problem trying to update a package I maintain (that depends on numpy) to work with Python 3.12. I tried everything I could think of, including adding the cibuildwheel pre-install of numpy with the
allow-noblas=trueoption and I just couldn't get it to work. Disabling the build of*i686eventually solved the problem, but is obviously not ideal.@rfrenchseti try adding these packages before installing numpy.
pkg-config \ libopenblas-dev \Names may be different depending on which distro.
Just for info, we face the same issue when doing CI on an architecture where no wheels are provided (PPC64le).
Numpy should just build by default, even with the largest warning about bad performances, but it should not fail building because so many projects have numpy as a dependency.- added a commit that references this issue
on Nov 3, 2023 - added a commit that references this issue
on Nov 6, 2023 - added 2 commits that reference this issue
on Nov 11, 2023 - added a commit that references this issue
on Dec 12, 2023 - added a commit that references this issue
on Dec 12, 2023 For anyone who runs into this - based on:
This is the syntax for pip:
python -m pip install numpy --config-settings=setup-args="-Dallow-noblas=true"For everybody running into that (like myself): This works only from numpy version 1.26.1!
Reacted by Agriya Khetarpal
When trying out latest release candidate:
From: pyproj4/pyproj#1330 (comment)
Is there an environment variable you can set to not require blas when installing numpy?