Can't execute Meshroom

[TrevtheForthDev]

Issue description

I'm trying to create an environment for Meshroom. I already ran all of the patchelf stuff, and got all of the packages I need. I run nix-shell -p binutils stdenv wget dpkg nix-index stdenv.cc zlib python3.out glibc.out and try to execute Meshroom, and it throws the error:
Fatal Python error: Py_Initialize: Unable to get the locale encoding Traceback (most recent call last): File "/opt/rh/rh-python36/root/usr/lib64/python3.6/encodings/__init__.py", line 31, in <module> zipimport.ZipImportError: can't decompress data; zlib not available Aborted

Steps to reproduce

nix-shell -p binutils stdenv wget dpkg nix-index stdenv.cc zlib python3.out glibc.out
./Meshroom

Technical details

• system: "x86_64-linux"
• host os: Linux 4.19.31, NixOS, 18.09.2394.2d656a97297 (Jellyfish)
• multi-user?: yes
• sandbox: yes
• version: nix-env (Nix) 2.1.3
• channels(trev): ""
• channels(root): "nixos-18.09.2394.2d656a97297, nixos-hardware, unstable-19.03pre167858.f2a1a4e93be"
• nixpkgs: /nix/var/nix/profiles/per-user/root/channels/nixos

[TrevtheForthDev]

https://0x0.st/zu0I.nix
This is a fix from a friend, perhaps someone can turn this to a package if they'd like. Cheers!

[Stekke]

https://0x0.st/zu0I.nix
This is a fix from a friend, perhaps someone can turn this to a package if they'd like. Cheers!

Is this for the binary distribution of meshroom?
If anyone wants to help, I'm trying to package this software in my branch

[tomberek]

Did this get any farther?

[Stekke]

Not by me, I remember getting stuck somewhere with an error on a python package, and stopped looking into it.

[QuteBits]

@Stekke @tomberek @TrevtheForthDev and anyone for whom fixing the zipimport.ZipImportError: can't decompress data; zlib not available error is still relevant: Meshroom builds are distributed as tar.gz which have all needed python packages (including zlib) embedded. They are called via symlinks. Check if they are broken (go to <meshroom-distribution>/aliceVision/bin for example and do ls -l: you will either see almost every second entry being a symlink or almost every second entry having size 0, in which case it's broken).

The thing that broke it for me was: unzipping the Meshroom release on a Windows machine and then copying the folder to a linux machine. If that's your case, just copy the tar.gz directly to your linux machine where you intend to run Meshroom and then unzip it there (in that way symlinks will remain intact)

[nomelif]

Is anyone still working on this? I've been playing around with meshroom, but I haven't figured out how to run it on nixos, steam-run or otherwise. Running the newest meshroom with nix-autobahn seems to give the same zlib error as above, so I thought it relevant to say that the links lead somewhere:

lrwxrwxrwx 1 glados users   33 26. 2. 03:19 aliceVision_cameraCalibration -> aliceVision_cameraCalibration-1.0
-rwxr-xr-x 1 glados users 339K 26. 2. 03:10 aliceVision_cameraCalibration-1.0
lrwxrwxrwx 1 glados users   26 26. 2. 03:19 aliceVision_cameraInit -> aliceVision_cameraInit-2.0
-rwxr-xr-x 1 glados users 544K 26. 2. 03:08 aliceVision_cameraInit-2.0
lrwxrwxrwx 1 glados users   34 26. 2. 03:19 aliceVision_cameraLocalization -> aliceVision_cameraLocalization-1.0
-rwxr-xr-x 1 glados users 324K 26. 2. 03:18 aliceVision_cameraLocalization-1.0
lrwxrwxrwx 1 glados users   46 26. 2. 03:19 aliceVision_computeStructureFromKnownPoses -> aliceVision_computeStructureFromKnownPoses-1.0
-rwxr-xr-x 1 glados users 219K 26. 2. 03:18 aliceVision_computeStructureFromKnownPoses-1.0
lrwxrwxrwx 1 glados users   45 26. 2. 03:19 aliceVision_convertFloatDescriptorToUchar -> aliceVision_convertFloatDescriptorToUchar-1.0
-rwxr-xr-x 1 glados users 138K 26. 2. 03:18 aliceVision_convertFloatDescriptorToUchar-1.0
lrwxrwxrwx 1 glados users   27 26. 2. 03:19 aliceVision_convertMesh -> aliceVision_convertMesh-1.0
-rwxr-xr-x 1 glados users 122K 26. 2. 03:05 aliceVision_convertMesh-1.0
lrwxrwxrwx 1 glados users   26 26. 2. 03:19 aliceVision_convertRAW -> aliceVision_convertRAW-1.0
-rwxr-xr-x 1 glados users 164K 26. 2. 03:06 aliceVision_convertRAW-1.0
lrwxrwxrwx 1 glados users   32 26. 2. 03:19 aliceVision_convertSfMFormat -> aliceVision_convertSfMFormat-2.0
-rwxr-xr-x 1 glados users 341K 26. 2. 03:09 aliceVision_convertSfMFormat-2.0
lrwxrwxrwx 1 glados users   34 26. 2. 03:19 aliceVision_depthMapEstimation -> aliceVision_depthMapEstimation-2.0
-rwxr-xr-x 1 glados users 251K 26. 2. 03:18 aliceVision_depthMapEstimation-2.0
lrwxrwxrwx 1 glados users   33 26. 2. 03:19 aliceVision_depthMapFiltering -> aliceVision_depthMapFiltering-2.0
-rwxr-xr-x 1 glados users 198K 26. 2. 03:18 aliceVision_depthMapFiltering-2.0
lrwxrwxrwx 1 glados users   36 26. 2. 03:19 aliceVision_exportAnimatedCamera -> aliceVision_exportAnimatedCamera-2.0
-rwxr-xr-x 1 glados users 361K 26. 2. 03:09 aliceVision_exportAnimatedCamera-2.0
lrwxrwxrwx 1 glados users   36 26. 2. 03:19 aliceVision_exportCameraFrustums -> aliceVision_exportCameraFrustums-1.0
-rwxr-xr-x 1 glados users 116K 26. 2. 03:18 aliceVision_exportCameraFrustums-1.0
lrwxrwxrwx 1 glados users   39 26. 2. 03:19 aliceVision_exportColoredPointCloud -> aliceVision_exportColoredPointCloud-1.0
-rwxr-xr-x 1 glados users  94K 26. 2. 03:09 aliceVision_exportColoredPointCloud-1.0
lrwxrwxrwx 1 glados users   31 26. 2. 03:19 aliceVision_exportKeypoints -> aliceVision_exportKeypoints-1.0
-rwxr-xr-x 1 glados users 147K 26. 2. 03:18 aliceVision_exportKeypoints-1.0
lrwxrwxrwx 1 glados users   29 26. 2. 03:19 aliceVision_exportMatches -> aliceVision_exportMatches-1.0
-rwxr-xr-x 1 glados users 183K 26. 2. 03:18 aliceVision_exportMatches-1.0
lrwxrwxrwx 1 glados users   28 26. 2. 03:19 aliceVision_exportMatlab -> aliceVision_exportMatlab-1.0
-rwxr-xr-x 1 glados users 113K 26. 2. 03:09 aliceVision_exportMatlab-1.0
lrwxrwxrwx 1 glados users   29 26. 2. 03:19 aliceVision_exportMeshlab -> aliceVision_exportMeshlab-1.0
-rwxr-xr-x 1 glados users 113K 26. 2. 03:09 aliceVision_exportMeshlab-1.0
lrwxrwxrwx 1 glados users   34 26. 2. 03:19 aliceVision_exportMeshroomMaya -> aliceVision_exportMeshroomMaya-1.0
-rwxr-xr-x 1 glados users 133K 26. 2. 03:09 aliceVision_exportMeshroomMaya-1.0
lrwxrwxrwx 1 glados users   26 26. 2. 03:19 aliceVision_exportMVE2 -> aliceVision_exportMVE2-1.0
-rwxr-xr-x 1 glados users 148K 26. 2. 03:09 aliceVision_exportMVE2-1.0
lrwxrwxrwx 1 glados users   34 26. 2. 03:19 aliceVision_exportMVSTexturing -> aliceVision_exportMVSTexturing-1.0
-rwxr-xr-x 1 glados users 107K 26. 2. 03:09 aliceVision_exportMVSTexturing-1.0
lrwxrwxrwx 1 glados users   26 26. 2. 03:19 aliceVision_exportPMVS -> aliceVision_exportPMVS-1.0
-rwxr-xr-x 1 glados users 219K 26. 2. 03:09 aliceVision_exportPMVS-1.0
lrwxrwxrwx 1 glados users   28 26. 2. 03:19 aliceVision_exportTracks -> aliceVision_exportTracks-1.0
-rwxr-xr-x 1 glados users 209K 26. 2. 03:18 aliceVision_exportTracks-1.0
lrwxrwxrwx 1 glados users   33 26. 2. 03:19 aliceVision_featureExtraction -> aliceVision_featureExtraction-1.0
-rwxr-xr-x 1 glados users 272K 26. 2. 03:18 aliceVision_featureExtraction-1.0
lrwxrwxrwx 1 glados users   31 26. 2. 03:19 aliceVision_featureMatching -> aliceVision_featureMatching-2.0
-rwxr-xr-x 1 glados users 564K 26. 2. 03:18 aliceVision_featureMatching-2.0
lrwxrwxrwx 1 glados users   25 26. 2. 03:19 aliceVision_globalSfM -> aliceVision_globalSfM-1.0
-rwxr-xr-x 1 glados users 237K 26. 2. 03:17 aliceVision_globalSfM-1.0
lrwxrwxrwx 1 glados users   29 26. 2. 03:19 aliceVision_imageMatching -> aliceVision_imageMatching-1.0
-rwxr-xr-x 1 glados users 276K 26. 2. 03:18 aliceVision_imageMatching-1.0
lrwxrwxrwx 1 glados users   30 26. 2. 03:19 aliceVision_incrementalSfM -> aliceVision_incrementalSfM-2.1
-rwxr-xr-x 1 glados users 278K 26. 2. 03:17 aliceVision_incrementalSfM-2.1
lrwxrwxrwx 1 glados users   35 26. 2. 03:19 aliceVision_LdrToHdrCalibration -> aliceVision_LdrToHdrCalibration-0.1
-rwxr-xr-x 1 glados users 217K 26. 2. 03:08 aliceVision_LdrToHdrCalibration-0.1
lrwxrwxrwx 1 glados users   29 26. 2. 03:19 aliceVision_LdrToHdrMerge -> aliceVision_LdrToHdrMerge-0.1
-rwxr-xr-x 1 glados users 249K 26. 2. 03:08 aliceVision_LdrToHdrMerge-0.1
lrwxrwxrwx 1 glados users   32 26. 2. 03:19 aliceVision_LdrToHdrSampling -> aliceVision_LdrToHdrSampling-0.1
-rwxr-xr-x 1 glados users 214K 26. 2. 03:08 aliceVision_LdrToHdrSampling-0.1
lrwxrwxrwx 1 glados users   28 26. 2. 03:19 aliceVision_meshDecimate -> aliceVision_meshDecimate-1.0
-rwxr-xr-x 1 glados users 854K 26. 2. 03:18 aliceVision_meshDecimate-1.0
lrwxrwxrwx 1 glados users   29 26. 2. 03:19 aliceVision_meshDenoising -> aliceVision_meshDenoising-1.0
-rwxr-xr-x 1 glados users 1,2M 26. 2. 03:18 aliceVision_meshDenoising-1.0
lrwxrwxrwx 1 glados users   29 26. 2. 03:19 aliceVision_meshFiltering -> aliceVision_meshFiltering-4.0
-rwxr-xr-x 1 glados users 218K 26. 2. 03:17 aliceVision_meshFiltering-4.0
lrwxrwxrwx 1 glados users   23 26. 2. 03:19 aliceVision_meshing -> aliceVision_meshing-4.0
-rwxr-xr-x 1 glados users 370K 26. 2. 03:18 aliceVision_meshing-4.0
lrwxrwxrwx 1 glados users   30 26. 2. 03:19 aliceVision_meshResampling -> aliceVision_meshResampling-1.0
-rwxr-xr-x 1 glados users 198K 26. 2. 03:17 aliceVision_meshResampling-1.0
lrwxrwxrwx 1 glados users   35 26. 2. 03:19 aliceVision_panoramaCompositing -> aliceVision_panoramaCompositing-1.0
-rwxr-xr-x 1 glados users 292K 26. 2. 03:09 aliceVision_panoramaCompositing-1.0
lrwxrwxrwx 1 glados users   34 26. 2. 03:19 aliceVision_panoramaEstimation -> aliceVision_panoramaEstimation-1.0
-rwxr-xr-x 1 glados users 424K 26. 2. 03:17 aliceVision_panoramaEstimation-1.0
lrwxrwxrwx 1 glados users   28 26. 2. 03:19 aliceVision_panoramaInit -> aliceVision_panoramaInit-2.0
-rwxr-xr-x 1 glados users 437K 26. 2. 03:18 aliceVision_panoramaInit-2.0
lrwxrwxrwx 1 glados users   31 26. 2. 03:19 aliceVision_panoramaMerging -> aliceVision_panoramaMerging-1.0
-rwxr-xr-x 1 glados users 201K 26. 2. 03:08 aliceVision_panoramaMerging-1.0
lrwxrwxrwx 1 glados users   37 26. 2. 03:19 aliceVision_panoramaPrepareImages -> aliceVision_panoramaPrepareImages-0.1
-rwxr-xr-x 1 glados users 152K 26. 2. 03:08 aliceVision_panoramaPrepareImages-0.1
lrwxrwxrwx 1 glados users   29 26. 2. 03:19 aliceVision_panoramaSeams -> aliceVision_panoramaSeams-1.0
-rwxr-xr-x 1 glados users 243K 26. 2. 03:09 aliceVision_panoramaSeams-1.0
lrwxrwxrwx 1 glados users   31 26. 2. 03:19 aliceVision_panoramaWarping -> aliceVision_panoramaWarping-1.0
-rwxr-xr-x 1 glados users 246K 26. 2. 03:18 aliceVision_panoramaWarping-1.0
lrwxrwxrwx 1 glados users   33 26. 2. 03:19 aliceVision_prepareDenseScene -> aliceVision_prepareDenseScene-2.0
-rwxr-xr-x 1 glados users 226K 26. 2. 03:08 aliceVision_prepareDenseScene-2.0
lrwxrwxrwx 1 glados users   30 26. 2. 03:19 aliceVision_rigCalibration -> aliceVision_rigCalibration-1.0
-rwxr-xr-x 1 glados users 350K 26. 2. 03:18 aliceVision_rigCalibration-1.0
lrwxrwxrwx 1 glados users   31 26. 2. 03:19 aliceVision_rigLocalization -> aliceVision_rigLocalization-1.0
-rwxr-xr-x 1 glados users 350K 26. 2. 03:18 aliceVision_rigLocalization-1.0
lrwxrwxrwx 1 glados users   25 26. 2. 03:19 aliceVision_texturing -> aliceVision_texturing-3.0
-rwxr-xr-x 1 glados users 231K 26. 2. 03:16 aliceVision_texturing-3.0
lrwxrwxrwx 1 glados users   39 26. 2. 03:19 aliceVision_utils_fisheyeProjection -> aliceVision_utils_fisheyeProjection-1.0
-rwxr-xr-x 1 glados users 315K 26. 2. 03:07 aliceVision_utils_fisheyeProjection-1.0
lrwxrwxrwx 1 glados users   38 26. 2. 03:19 aliceVision_utils_frustumFiltering -> aliceVision_utils_frustumFiltering-1.0
-rwxr-xr-x 1 glados users 186K 26. 2. 03:18 aliceVision_utils_frustumFiltering-1.0
lrwxrwxrwx 1 glados users   39 26. 2. 03:19 aliceVision_utils_hardwareResources -> aliceVision_utils_hardwareResources-1.0
-rwxr-xr-x 1 glados users  96K 26. 2. 03:06 aliceVision_utils_hardwareResources-1.0
lrwxrwxrwx 1 glados users   37 26. 2. 03:19 aliceVision_utils_imageProcessing -> aliceVision_utils_imageProcessing-2.0
-rwxr-xr-x 1 glados users 507K 26. 2. 03:18 aliceVision_utils_imageProcessing-2.0
lrwxrwxrwx 1 glados users   39 26. 2. 03:19 aliceVision_utils_keyframeSelection -> aliceVision_utils_keyframeSelection-2.0
-rwxr-xr-x 1 glados users 235K 26. 2. 03:09 aliceVision_utils_keyframeSelection-2.0
lrwxrwxrwx 1 glados users   40 26. 2. 03:19 aliceVision_utils_lightingEstimation -> aliceVision_utils_lightingEstimation-1.0
-rwxr-xr-x 1 glados users 248K 26. 2. 03:18 aliceVision_utils_lightingEstimation-1.0
lrwxrwxrwx 1 glados users   33 26. 2. 03:19 aliceVision_utils_mergeMeshes -> aliceVision_utils_mergeMeshes-1.0
-rwxr-xr-x 1 glados users 133K 26. 2. 03:05 aliceVision_utils_mergeMeshes-1.0
lrwxrwxrwx 1 glados users   39 26. 2. 03:19 aliceVision_utils_qualityEvaluation -> aliceVision_utils_qualityEvaluation-1.0
-rwxr-xr-x 1 glados users 185K 26. 2. 03:09 aliceVision_utils_qualityEvaluation-1.0
lrwxrwxrwx 1 glados users   34 26. 2. 03:19 aliceVision_utils_rigTransform -> aliceVision_utils_rigTransform-1.0
-rwxr-xr-x 1 glados users 176K 26. 2. 03:18 aliceVision_utils_rigTransform-1.0
lrwxrwxrwx 1 glados users   34 26. 2. 03:19 aliceVision_utils_sfmAlignment -> aliceVision_utils_sfmAlignment-1.0
-rwxr-xr-x 1 glados users 201K 26. 2. 03:18 aliceVision_utils_sfmAlignment-1.0
lrwxrwxrwx 1 glados users   39 26. 2. 03:19 aliceVision_utils_sfmColorHarmonize -> aliceVision_utils_sfmColorHarmonize-1.0
-rwxr-xr-x 1 glados users 3,8M 26. 2. 03:19 aliceVision_utils_sfmColorHarmonize-1.0
lrwxrwxrwx 1 glados users   37 26. 2. 03:19 aliceVision_utils_sfmLocalization -> aliceVision_utils_sfmLocalization-1.0
-rwxr-xr-x 1 glados users 285K 26. 2. 03:19 aliceVision_utils_sfmLocalization-1.0
lrwxrwxrwx 1 glados users   33 26. 2. 03:19 aliceVision_utils_sfmTransfer -> aliceVision_utils_sfmTransfer-1.0
-rwxr-xr-x 1 glados users 190K 26. 2. 03:18 aliceVision_utils_sfmTransfer-1.0
lrwxrwxrwx 1 glados users   34 26. 2. 03:19 aliceVision_utils_sfmTransform -> aliceVision_utils_sfmTransform-1.0
-rwxr-xr-x 1 glados users 350K 26. 2. 03:18 aliceVision_utils_sfmTransform-1.0
lrwxrwxrwx 1 glados users   36 26. 2. 03:19 aliceVision_utils_split360Images -> aliceVision_utils_split360Images-1.0
-rwxr-xr-x 1 glados users 221K 26. 2. 03:06 aliceVision_utils_split360Images-1.0
lrwxrwxrwx 1 glados users   37 26. 2. 03:19 aliceVision_utils_voctreeCreation -> aliceVision_utils_voctreeCreation-1.0
-rwxr-xr-x 1 glados users 269K 26. 2. 03:09 aliceVision_utils_voctreeCreation-1.0
lrwxrwxrwx 1 glados users   41 26. 2. 03:19 aliceVision_utils_voctreeQueryUtility -> aliceVision_utils_voctreeQueryUtility-1.0
-rwxr-xr-x 1 glados users 260K 26. 2. 03:18 aliceVision_utils_voctreeQueryUtility-1.0
lrwxrwxrwx 1 glados users   39 26. 2. 03:19 aliceVision_utils_voctreeStatistics -> aliceVision_utils_voctreeStatistics-1.0
-rwxr-xr-x 1 glados users 178K 26. 2. 03:09 aliceVision_utils_voctreeStatistics-1.0

[aidalgol]

I got the binary Meshroom release running on NixOS, and there is an open PR to have this merged into the nix-warez repo.

Before that, I had tried to package Meshroom from source in nixpkgs, and got stuck on a bug in the PySide2 package (#191313).