Repository navigation
[Python][CI] vcpkg dependencies fail rebuilding #47367
Description
Activity
This vcpkg issue really makes it difficult for us to do any useful diagnosis: microsoft/vcpkg#46976
@kou Would it be doable to patch vcpkg to integrate the snippet showed in this comment:
microsoft/vcpkg#30622 (comment)Does it make sense to release everything but windows wheels (with a public not as to why)?
Then Windows users would get 21.0 which already has the bug?
If we can't build PyArrow at all, then yes, we can probably do that. If we can build it knowing that dependencies are not entirely up-to-date and that there is an unfixed regression due to a likely compiler bug, we should probably release the Windows wheels.
Would it be doable to patch vcpkg to integrate the snippet showed in this comment: microsoft/vcpkg#30622 (comment)
I'll try it next week.
I've patched vcpkg and I've been able to get some logs:
-- Check for working CXX compiler: C:/Program Files (x86)/Microsoft Visual Studio/2022/BuildTools/VC/Tools/MSVC/14.44.35207/bin/Hostx64/x64/cl.exe - broken CMake Error at C:/Program Files/CMake/share/cmake-3.31/Modules/CMakeTestCXXCompiler.cmake:73 (message): The C++ compiler "C:/Program Files (x86)/Microsoft Visual Studio/2022/BuildTools/VC/Tools/MSVC/14.44.35207/bin/Hostx64/x64/cl.exe" is not able to compile a simple test program. It fails with the following output: Change Dir: 'C:/vcpkg/buildtrees/boost-headers/amd64-windows-static-md-release-rel/CMakeFiles/CMakeScratch/TryCompile-aw5mul' Run Build Command(s): "C:/Program Files (x86)/Microsoft Visual Studio/2022/BuildTools/Common7/IDE/CommonExtensions/Microsoft/CMake/Ninja/ninja.exe" -v cmTC_9b7ce [1/2] "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\VC\Tools\MSVC\14.44.35207\bin\Hostx64\x64\cl.exe" /nologo /TP /nologo /DWIN32 /D_WINDOWS /W3 /utf-8 /GR /EHsc /MP /D_DEBUG /MDd /Z7 /Ob0 /Od /RTC1 -MDd /showIncludes /FoCMakeFiles\cmTC_9b7ce.dir\testCXXCompiler.cxx.obj /FdCMakeFiles\cmTC_9b7ce.dir\ /FS -c C:\vcpkg\buildtrees\boost-headers\amd64-windows-static-md-release-rel\CMakeFiles\CMakeScratch\TryCompile-aw5mul\testCXXCompiler.cxx [2/2] C:\Windows\system32\cmd.exe /C "cd . && "C:\Program Files\CMake\bin\cmake.exe" -E vs_link_exe --msvc-ver=1944 --intdir=CMakeFiles\cmTC_9b7ce.dir --rc=rc --mt=CMAKE_MT-NOTFOUND --manifests -- "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\VC\Tools\MSVC\14.44.35207\bin\Hostx64\x64\link.exe" /nologo CMakeFiles\cmTC_9b7ce.dir\testCXXCompiler.cxx.obj /out:cmTC_9b7ce.exe /implib:cmTC_9b7ce.lib /pdb:cmTC_9b7ce.pdb /version:0.0 /machine:x64 /debug /INCREMENTAL /subsystem:console kernel32.lib user32.lib gdi32.lib winspool.lib shell32.lib ole32.lib oleaut32.lib uuid.lib comdlg32.lib advapi32.lib && cd ." FAILED: cmTC_9b7ce.exe C:\Windows\system32\cmd.exe /C "cd . && "C:\Program Files\CMake\bin\cmake.exe" -E vs_link_exe --msvc-ver=1944 --intdir=CMakeFiles\cmTC_9b7ce.dir --rc=rc --mt=CMAKE_MT-NOTFOUND --manifests -- "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\VC\Tools\MSVC\14.44.35207\bin\Hostx64\x64\link.exe" /nologo CMakeFiles\cmTC_9b7ce.dir\testCXXCompiler.cxx.obj /out:cmTC_9b7ce.exe /implib:cmTC_9b7ce.lib /pdb:cmTC_9b7ce.pdb /version:0.0 /machine:x64 /debug /INCREMENTAL /subsystem:console kernel32.lib user32.lib gdi32.lib winspool.lib shell32.lib ole32.lib oleaut32.lib uuid.lib comdlg32.lib advapi32.lib && cd ." RC Pass 1: command "rc /fo CMakeFiles\cmTC_9b7ce.dir/manifest.res CMakeFiles\cmTC_9b7ce.dir/manifest.rc" failed (exit code 0) with the following output: no such file or directory ninja: build stopped: subcommand failed. CMake will not be able to correctly generate this project. Call Stack (most recent call first): CMakeLists.txt:3 (project) -- Configuring incomplete, errors occurred! ninja: build stopped: subcommand failed. CMake Error at scripts/cmake/vcpkg_execute_required_process.cmake:130 (message): Command failed: "C:/Program Files (x86)/Microsoft Visual Studio/2022/BuildTools/Common7/IDE/CommonExtensions/Microsoft/CMake/Ninja/ninja.exe" -v Working Directory: C:/vcpkg/buildtrees/boost-headers/amd64-windows-static-md-release-rel/vcpkg-parallel-configure Error code: 1 See logs for more information: C:\vcpkg\buildtrees\boost-headers\config-amd64-windows-static-md-release-rel-CMakeCache.txt.log C:\vcpkg\buildtrees\boost-headers\config-amd64-windows-static-md-release-rel-CMakeConfigureLog.yaml.log C:\vcpkg\buildtrees\boost-headers\config-amd64-windows-static-md-release-out.log Call Stack (most recent call first): installed/x64-windows/share/vcpkg-cmake/vcpkg_cmake_configure.cmake:269 (vcpkg_execute_required_process) installed/x64-windows/share/vcpkg-boost/boost-install.cmake:55 (vcpkg_cmake_configure) ports/boost-headers/portfile.cmake:12 (boost_configure_and_install) scripts/ports.cmake:191 (include) error: building boost-headers:amd64-windows-static-md-release failed with: BUILD_FAILEDThe issue is related to the
vs_buildtoolsinstallation, it seems there are some missing components. I've tried a full installation and the build is progressing successfully, it has already installed boost and a bunch of other dependenciesInstalling 69/108
https://github.com/ursacomputing/crossbow/actions/runs/17438872341/job/49516179092I'll try to trim down the installation of
vs_buildtoolscomponents and fix any other issue, the PR where I am testing:Update: Both Arrow CPP and the Windows wheel were built successfully on that job. It failed due to a couple of test failures that were already happening on the nightly jobs some time ago. I'll investigate tomorrow but might be related to some libraries missing from build tools on the test image too:
Python313\Lib\subprocess.py:419: CalledProcessError ---------------------------- Captured stdout call ----------------------------- Compiling extensions.pyx because it changed. [1/1] Cythonizing extensions.pyx Extension module: <setuptools.extension.Extension('extensions') at 0x24849772490> ['C:\\Python313\\Lib\\site-packages\\numpy\\_core\\include', 'C:\\Python313\\Lib\\site-packages\\pyarrow\\include'] ['arrow_python', 'arrow'] ['C:\\Python313\\Lib\\site-packages\\pyarrow', 'C:\\Python313\\Lib\\site-packages\\pyarrow.libs'] running build_ext building 'extensions' extension creating build\temp.win-amd64-cpython-313\Release "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\VC\Tools\MSVC\14.44.35207\bin\HostX86\x64\cl.exe" /c /nologo /O2 /W3 /GL /DNDEBUG /MD -IC:\Python313\Lib\site-packages\numpy\_core\include -IC:\Python313\Lib\site-packages\pyarrow\include -IC:\Python313\include -IC:\Python313\Include "-IC:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\VC\Tools\MSVC\14.44.35207\include" "-IC:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\VC\Auxiliary\VS\include" /EHsc /Tpextensions.cpp /Fobuild\temp.win-amd64-cpython-313\Release\extensions.obj -D_ENABLE_EXTENDED_ALIGNED_STORAGE /std:c++17 extensions.cpp C:\Python313\include\pyconfig.h(59): fatal error C1083: Cannot open include file: 'io.h': No such file or directorySeems to match this StackOverflow question:
https://stackoverflow.com/questions/40018405/cannot-open-include-file-io-h-no-such-file-or-directoryThanks for working on the vcpkg log output! (Sorry for not working on it yet...)
- added a commit that references this issue
on Sep 8, 2025 - added a commit that references this issue
on May 26, 2026
Describe the bug, including details regarding any error messages, version, and platform.
See #47360 :
vcpkg installin our Windows wheel builds fails rebuilding the dependencies. We are not able to make any changes to our vcpkg or Windows build setup until this is fixed.Component(s)
Continuous Integration, Packaging, Python