Skip to content

Much more user-friendly handling of pip errors during pipx install #625

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 70 commits into from
Feb 22, 2021
Merged

Much more user-friendly handling of pip errors during pipx install #625

merged 70 commits into from
Feb 22, 2021

Conversation

itsayellow
Copy link
Contributor

@itsayellow itsayellow commented Feb 8, 2021 •
edited
Loading

  • I have added an entry to docs/changelog.md

Summary of changes

This stops streaming all pip errors to the shell when pipx install fails due to pip errors. Instead, it

  • saves all pip stderr and stdout to a log file in ~/.local/pipx/logs
  • Prints the full path of this pip error log file to the shell.
  • identifies the package(s) that failed to build
  • attempts to list no more than 10 lines of the most relevant errors from the pip output.

Currently when pipx install fails, we stream the entire pip stderr output to the shell. This can easily be an overwhelming mass of text, in some cases over 1900 lines long. This is not user-friendly.

Closes #613

Test plan

Here is a comparison of trying to execute pipx install mayan-edms==3.5.2 on macOS

This PR:

> pipx install mayan-edms==3.5.2
Fatal error from pip prevented installation. Full pip output in file:
    /Users/mclapp/.local/pipx/logs/cmd_2021-02-07_18.02.54_pip_errors.log

pip failed to build package:
    Pillow

Some possibly relevant errors from pip install:
    The headers or library files could not be found for zlib,
    __main__.RequiredDependencyException: zlib

Error installing mayan-edms from spec 'mayan-edms==3.5.2'.

pipx 0.16.0.0 (current behavior):

birchtree:pipx pipx install mayan-edms==3.5.2
  ERROR: Command errored out with exit status 1:
   command: /Users/mclapp/.local/pipx/venvs/mayan-edms/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/private/var/folders/ys/3cx7bntj6tsb0v0_z95tzw2h0000gn/T/pip-install-y0i1qj0r/pillow_88917bd4c3064d859f3fa8e856fad942/setup.py'"'"'; __file__='"'"'/private/var/folders/ys/3cx7bntj6tsb0v0_z95tzw2h0000gn/T/pip-install-y0i1qj0r/pillow_88917bd4c3064d859f3fa8e856fad942/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /private/var/folders/ys/3cx7bntj6tsb0v0_z95tzw2h0000gn/T/pip-wheel-shsdwain
       cwd: /private/var/folders/ys/3cx7bntj6tsb0v0_z95tzw2h0000gn/T/pip-install-y0i1qj0r/pillow_88917bd4c3064d859f3fa8e856fad942/
  Complete output (172 lines):
  running bdist_wheel
  running build
  running build_py
  creating build
  creating build/lib.macosx-11-x86_64-3.9
  creating build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/MpoImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/ImageMode.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/PngImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/XbmImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/PcxImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/SunImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/ImageFile.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/SpiderImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/TarIO.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/FitsStubImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/MpegImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/BdfFontFile.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/GribStubImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/ImageStat.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/PixarImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/GimpPaletteFile.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/ImageColor.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/ContainerIO.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/MspImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/MicImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/_version.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/ImtImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/GifImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/PalmImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/ImageQt.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/ImageMath.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/PaletteFile.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/FontFile.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/PdfParser.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/ExifTags.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/ImageCms.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/FpxImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/ImageChops.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/BufrStubImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/PSDraw.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/PcdImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/ImageFilter.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/ImageDraw2.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/ImagePath.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/DcxImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/__init__.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/JpegPresets.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/Hdf5StubImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/features.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/ImageDraw.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/GimpGradientFile.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/ImageWin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/IcoImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/_tkinter_finder.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/EpsImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/TgaImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/ImageMorph.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/Jpeg2KImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/WalImageFile.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/PcfFontFile.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/BlpImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/ImageTk.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/GbrImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/ImageOps.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/PdfImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/ImageShow.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/ImageEnhance.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/WmfImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/ImageGrab.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/WebPImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/FliImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/TiffTags.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/CurImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/_util.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/GdImageFile.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/TiffImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/IptcImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/ImagePalette.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/BmpImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/ImageTransform.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/IcnsImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/McIdasImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/XpmImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/DdsImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/ImageSequence.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/PyAccess.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/_binary.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/Image.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/__main__.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/XVThumbImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/SgiImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/ImImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/PsdImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/JpegImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/ImageFont.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/PpmImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  copying src/PIL/FtexImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
  running egg_info
  writing src/Pillow.egg-info/PKG-INFO
  writing dependency_links to src/Pillow.egg-info/dependency_links.txt
  writing top-level names to src/Pillow.egg-info/top_level.txt
  reading manifest file 'src/Pillow.egg-info/SOURCES.txt'
  reading manifest template 'MANIFEST.in'
  warning: no files found matching '*.c'
  warning: no files found matching '*.h'
  warning: no files found matching '*.sh'
  warning: no previously-included files found matching '.appveyor.yml'
  warning: no previously-included files found matching '.coveragerc'
  warning: no previously-included files found matching '.editorconfig'
  warning: no previously-included files found matching '.readthedocs.yml'
  warning: no previously-included files found matching 'azure-pipelines.yml'
  warning: no previously-included files found matching 'codecov.yml'
  warning: no previously-included files matching '.git*' found anywhere in distribution
  warning: no previously-included files matching '*.pyc' found anywhere in distribution
  warning: no previously-included files matching '*.so' found anywhere in distribution
  no previously-included directories found matching '.azure-pipelines'
  no previously-included directories found matching '.ci'
  writing manifest file 'src/Pillow.egg-info/SOURCES.txt'
  running build_ext
  
  
  The headers or library files could not be found for zlib,
  a required dependency when compiling Pillow from source.
  
  Please see the install instructions at:
     https://pillow.readthedocs.io/en/latest/installation.html
  
  Traceback (most recent call last):
    File "/private/var/folders/ys/3cx7bntj6tsb0v0_z95tzw2h0000gn/T/pip-install-y0i1qj0r/pillow_88917bd4c3064d859f3fa8e856fad942/setup.py", line 860, in <module>
      setup(
    File "/Users/mclapp/.local/pipx/shared/lib/python3.9/site-packages/setuptools/__init__.py", line 153, in setup
      return distutils.core.setup(**attrs)
    File "/usr/local/Cellar/python@3.9/3.9.1_8/Frameworks/Python.framework/Versions/3.9/lib/python3.9/distutils/core.py", line 148, in setup
      dist.run_commands()
    File "/usr/local/Cellar/python@3.9/3.9.1_8/Frameworks/Python.framework/Versions/3.9/lib/python3.9/distutils/dist.py", line 966, in run_commands
      self.run_command(cmd)
    File "/usr/local/Cellar/python@3.9/3.9.1_8/Frameworks/Python.framework/Versions/3.9/lib/python3.9/distutils/dist.py", line 985, in run_command
      cmd_obj.run()
    File "/Users/mclapp/.local/pipx/shared/lib/python3.9/site-packages/wheel/bdist_wheel.py", line 299, in run
      self.run_command('build')
    File "/usr/local/Cellar/python@3.9/3.9.1_8/Frameworks/Python.framework/Versions/3.9/lib/python3.9/distutils/cmd.py", line 313, in run_command
      self.distribution.run_command(command)
    File "/usr/local/Cellar/python@3.9/3.9.1_8/Frameworks/Python.framework/Versions/3.9/lib/python3.9/distutils/dist.py", line 985, in run_command
      cmd_obj.run()
    File "/usr/local/Cellar/python@3.9/3.9.1_8/Frameworks/Python.framework/Versions/3.9/lib/python3.9/distutils/command/build.py", line 135, in run
      self.run_command(cmd_name)
    File "/usr/local/Cellar/python@3.9/3.9.1_8/Frameworks/Python.framework/Versions/3.9/lib/python3.9/distutils/cmd.py", line 313, in run_command
      self.distribution.run_command(command)
    File "/usr/local/Cellar/python@3.9/3.9.1_8/Frameworks/Python.framework/Versions/3.9/lib/python3.9/distutils/dist.py", line 985, in run_command
      cmd_obj.run()
    File "/usr/local/Cellar/python@3.9/3.9.1_8/Frameworks/Python.framework/Versions/3.9/lib/python3.9/distutils/command/build_ext.py", line 340, in run
      self.build_extensions()
    File "/private/var/folders/ys/3cx7bntj6tsb0v0_z95tzw2h0000gn/T/pip-install-y0i1qj0r/pillow_88917bd4c3064d859f3fa8e856fad942/setup.py", line 694, in build_extensions
      raise RequiredDependencyException(f)
  __main__.RequiredDependencyException: zlib
  
  During handling of the above exception, another exception occurred:
  
  Traceback (most recent call last):
    File "<string>", line 1, in <module>
    File "/private/var/folders/ys/3cx7bntj6tsb0v0_z95tzw2h0000gn/T/pip-install-y0i1qj0r/pillow_88917bd4c3064d859f3fa8e856fad942/setup.py", line 914, in <module>
      raise RequiredDependencyException(msg)
  __main__.RequiredDependencyException:
  
  The headers or library files could not be found for zlib,
  a required dependency when compiling Pillow from source.
  
  Please see the install instructions at:
     https://pillow.readthedocs.io/en/latest/installation.html
  
  
  ----------------------------------------
  ERROR: Failed building wheel for Pillow
    ERROR: Command errored out with exit status 1:
     command: /Users/mclapp/.local/pipx/venvs/mayan-edms/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/private/var/folders/ys/3cx7bntj6tsb0v0_z95tzw2h0000gn/T/pip-install-y0i1qj0r/pillow_88917bd4c3064d859f3fa8e856fad942/setup.py'"'"'; __file__='"'"'/private/var/folders/ys/3cx7bntj6tsb0v0_z95tzw2h0000gn/T/pip-install-y0i1qj0r/pillow_88917bd4c3064d859f3fa8e856fad942/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /private/var/folders/ys/3cx7bntj6tsb0v0_z95tzw2h0000gn/T/pip-record-n8k65byo/install-record.txt --single-version-externally-managed --compile --install-headers /Users/mclapp/.local/pipx/venvs/mayan-edms/include/site/python3.9/Pillow
         cwd: /private/var/folders/ys/3cx7bntj6tsb0v0_z95tzw2h0000gn/T/pip-install-y0i1qj0r/pillow_88917bd4c3064d859f3fa8e856fad942/
    Complete output (174 lines):
    running install
    running build
    running build_py
    creating build
    creating build/lib.macosx-11-x86_64-3.9
    creating build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/MpoImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/ImageMode.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/PngImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/XbmImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/PcxImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/SunImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/ImageFile.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/SpiderImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/TarIO.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/FitsStubImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/MpegImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/BdfFontFile.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/GribStubImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/ImageStat.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/PixarImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/GimpPaletteFile.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/ImageColor.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/ContainerIO.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/MspImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/MicImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/_version.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/ImtImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/GifImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/PalmImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/ImageQt.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/ImageMath.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/PaletteFile.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/FontFile.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/PdfParser.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/ExifTags.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/ImageCms.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/FpxImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/ImageChops.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/BufrStubImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/PSDraw.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/PcdImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/ImageFilter.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/ImageDraw2.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/ImagePath.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/DcxImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/__init__.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/JpegPresets.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/Hdf5StubImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/features.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/ImageDraw.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/GimpGradientFile.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/ImageWin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/IcoImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/_tkinter_finder.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/EpsImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/TgaImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/ImageMorph.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/Jpeg2KImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/WalImageFile.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/PcfFontFile.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/BlpImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/ImageTk.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/GbrImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/ImageOps.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/PdfImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/ImageShow.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/ImageEnhance.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/WmfImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/ImageGrab.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/WebPImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/FliImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/TiffTags.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/CurImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/_util.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/GdImageFile.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/TiffImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/IptcImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/ImagePalette.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/BmpImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/ImageTransform.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/IcnsImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/McIdasImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/XpmImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/DdsImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/ImageSequence.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/PyAccess.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/_binary.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/Image.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/__main__.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/XVThumbImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/SgiImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/ImImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/PsdImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/JpegImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/ImageFont.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/PpmImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    copying src/PIL/FtexImagePlugin.py -> build/lib.macosx-11-x86_64-3.9/PIL
    running egg_info
    writing src/Pillow.egg-info/PKG-INFO
    writing dependency_links to src/Pillow.egg-info/dependency_links.txt
    writing top-level names to src/Pillow.egg-info/top_level.txt
    reading manifest file 'src/Pillow.egg-info/SOURCES.txt'
    reading manifest template 'MANIFEST.in'
    warning: no files found matching '*.c'
    warning: no files found matching '*.h'
    warning: no files found matching '*.sh'
    warning: no previously-included files found matching '.appveyor.yml'
    warning: no previously-included files found matching '.coveragerc'
    warning: no previously-included files found matching '.editorconfig'
    warning: no previously-included files found matching '.readthedocs.yml'
    warning: no previously-included files found matching 'azure-pipelines.yml'
    warning: no previously-included files found matching 'codecov.yml'
    warning: no previously-included files matching '.git*' found anywhere in distribution
    warning: no previously-included files matching '*.pyc' found anywhere in distribution
    warning: no previously-included files matching '*.so' found anywhere in distribution
    no previously-included directories found matching '.azure-pipelines'
    no previously-included directories found matching '.ci'
    writing manifest file 'src/Pillow.egg-info/SOURCES.txt'
    running build_ext
    
    
    The headers or library files could not be found for zlib,
    a required dependency when compiling Pillow from source.
    
    Please see the install instructions at:
       https://pillow.readthedocs.io/en/latest/installation.html
    
    Traceback (most recent call last):
      File "/private/var/folders/ys/3cx7bntj6tsb0v0_z95tzw2h0000gn/T/pip-install-y0i1qj0r/pillow_88917bd4c3064d859f3fa8e856fad942/setup.py", line 860, in <module>
        setup(
      File "/Users/mclapp/.local/pipx/shared/lib/python3.9/site-packages/setuptools/__init__.py", line 153, in setup
        return distutils.core.setup(**attrs)
      File "/usr/local/Cellar/python@3.9/3.9.1_8/Frameworks/Python.framework/Versions/3.9/lib/python3.9/distutils/core.py", line 148, in setup
        dist.run_commands()
      File "/usr/local/Cellar/python@3.9/3.9.1_8/Frameworks/Python.framework/Versions/3.9/lib/python3.9/distutils/dist.py", line 966, in run_commands
        self.run_command(cmd)
      File "/usr/local/Cellar/python@3.9/3.9.1_8/Frameworks/Python.framework/Versions/3.9/lib/python3.9/distutils/dist.py", line 985, in run_command
        cmd_obj.run()
      File "/Users/mclapp/.local/pipx/shared/lib/python3.9/site-packages/setuptools/command/install.py", line 61, in run
        return orig.install.run(self)
      File "/usr/local/Cellar/python@3.9/3.9.1_8/Frameworks/Python.framework/Versions/3.9/lib/python3.9/distutils/command/install.py", line 546, in run
        self.run_command('build')
      File "/usr/local/Cellar/python@3.9/3.9.1_8/Frameworks/Python.framework/Versions/3.9/lib/python3.9/distutils/cmd.py", line 313, in run_command
        self.distribution.run_command(command)
      File "/usr/local/Cellar/python@3.9/3.9.1_8/Frameworks/Python.framework/Versions/3.9/lib/python3.9/distutils/dist.py", line 985, in run_command
        cmd_obj.run()
      File "/usr/local/Cellar/python@3.9/3.9.1_8/Frameworks/Python.framework/Versions/3.9/lib/python3.9/distutils/command/build.py", line 135, in run
        self.run_command(cmd_name)
      File "/usr/local/Cellar/python@3.9/3.9.1_8/Frameworks/Python.framework/Versions/3.9/lib/python3.9/distutils/cmd.py", line 313, in run_command
        self.distribution.run_command(command)
      File "/usr/local/Cellar/python@3.9/3.9.1_8/Frameworks/Python.framework/Versions/3.9/lib/python3.9/distutils/dist.py", line 985, in run_command
        cmd_obj.run()
      File "/usr/local/Cellar/python@3.9/3.9.1_8/Frameworks/Python.framework/Versions/3.9/lib/python3.9/distutils/command/build_ext.py", line 340, in run
        self.build_extensions()
      File "/private/var/folders/ys/3cx7bntj6tsb0v0_z95tzw2h0000gn/T/pip-install-y0i1qj0r/pillow_88917bd4c3064d859f3fa8e856fad942/setup.py", line 694, in build_extensions
        raise RequiredDependencyException(f)
    __main__.RequiredDependencyException: zlib
    
    During handling of the above exception, another exception occurred:
    
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "/private/var/folders/ys/3cx7bntj6tsb0v0_z95tzw2h0000gn/T/pip-install-y0i1qj0r/pillow_88917bd4c3064d859f3fa8e856fad942/setup.py", line 914, in <module>
        raise RequiredDependencyException(msg)
    __main__.RequiredDependencyException:
    
    The headers or library files could not be found for zlib,
    a required dependency when compiling Pillow from source.
    
    Please see the install instructions at:
       https://pillow.readthedocs.io/en/latest/installation.html
    
    
    ----------------------------------------
ERROR: Command errored out with exit status 1: /Users/mclapp/.local/pipx/venvs/mayan-edms/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/private/var/folders/ys/3cx7bntj6tsb0v0_z95tzw2h0000gn/T/pip-install-y0i1qj0r/pillow_88917bd4c3064d859f3fa8e856fad942/setup.py'"'"'; __file__='"'"'/private/var/folders/ys/3cx7bntj6tsb0v0_z95tzw2h0000gn/T/pip-install-y0i1qj0r/pillow_88917bd4c3064d859f3fa8e856fad942/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /private/var/folders/ys/3cx7bntj6tsb0v0_z95tzw2h0000gn/T/pip-record-n8k65byo/install-record.txt --single-version-externally-managed --compile --install-headers /Users/mclapp/.local/pipx/venvs/mayan-edms/include/site/python3.9/Pillow Check the logs for full command output.

Error installing mayan-edms from spec 'mayan-edms==3.5.2'.

@itsayellow
First stab at filtering pip output.
baf6fe1
@itsayellow
Print all pip errors to stdout.
27f14d5
@itsayellow
Add filter and temporarily unfilter error output.
a214957
@itsayellow
Fix bug stderr/stdout mixup.
45f73b9
@itsayellow
Fix lint.
cf06ddb
@itsayellow
Merge branch 'master' of github.com:pipxproject/pipx into pip-error
e5644dc
@itsayellow
Merge branch 'master' of github.com:pipxproject/pipx into pip-error
199021d
@itsayellow
Make mostly usable version.
779ae85
@itsayellow
Move pipx_log_file to constants.py.
74e8bca
@itsayellow
Refactor.
104f1a3
@itsayellow
Don't log run_subprocess if we write it out later.
718830e
@itsayellow
Switch print to logger.error.
8097a90
@itsayellow
Grep for lines with error if no failed found.
2012030
@itsayellow
Also search stderr for errors.
bc2b79b
@itsayellow
Add a lot more analysis.
187c07b
@itsayellow
Fix bug.
83699a1
@itsayellow
Apply lstrip to error lines.
efec763
@itsayellow
Improve debug output.
0356774
@itsayellow
Improve pip error analysis.
d174687
@itsayellow
Refactor code.
9323486
@itsayellow
Comment out debug.
f9ad9b2
@itsayellow
Expand search for Errors and Exceptions.
374348a
@itsayellow
Add more eror lines to possibly relevant.
0349fa5
@itsayellow
Deduplicate error messages.
bb9aaeb
@itsayellow
Ensure error2_re doesn't end in colon.
ed22f11
@itsayellow
Make error2_lines almost useful.
60c237a
@itsayellow
Remove unused code.
89a6801
@itsayellow
Clean up analyze_pip_output.
31a57ae
@itsayellow
Clean up code.
dfe2443
@itsayellow
Code cleanup.
15f928f
@itsayellow
Revamp error log analysis, add categories.
e4117eb
@itsayellow
Fix print bug.
35d505f
@itsayellow
Fix conflict attribtuion.
b473cb5
@itsayellow
Also check stderr for failed to build as backup.
ed74c4b
@itsayellow
Comment out exception_error2 which seems useless.
ee08aa4
@itsayellow
Extra paranoia for print_categories.
30e9e3b
@itsayellow
Standardize error message.
503122a
@itsayellow
Add a linebreak before PIP STDERR.
ac5d9c0
@itsayellow
stderr, not stdout.
2bccf96
@itsayellow
Refactor.
69b1e2d
@itsayellow
More refactoring.
1019371
@itsayellow
Remove extra CR.
e246bda
@itsayellow
Merge branch 'master' of github.com:pipxproject/pipx into pip-error
fc46618
@itsayellow
Don't use one or more packages as package name.
f3ce959
@itsayellow
Remove commented-out code.
e8928ca
@itsayellow
Rearrange error ranking.
595cbeb
@itsayellow
Clean up code.
59f4094
@itsayellow
Code cleanup, remove TODO, debug code, rename variables.
fb29ad7
@itsayellow
Add test for pip fail.
0205d6b
@itsayellow
Use Pattern type from typing for py3.6.
e73b528
@itsayellow
Fix test code.
972d3f8
@itsayellow
Fix test.
ea4d07a
@itsayellow
Add changelog entry.
da51f2d
@itsayellow
Add PR # to changelog entry.
28d1d31
@itsayellow
Merge branch 'master' of github.com:pipxproject/pipx into pip-error
1759555
@itsayellow
Copy link
Contributor Author

itsayellow commented Feb 13, 2021 •
edited
Loading

I'm going to merge this soon if nobody has any comments.

@itsayellow itsayellow merged commit 8889ff5 into pypa:master Feb 22, 2021
@itsayellow itsayellow deleted the pip-error branch February 22, 2021 04:54
@corneliusroemer corneliusroemer mentioned this pull request Oct 16, 2023
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Implement better handling of pip errors
1 participant
@itsayellow