⚡️ PipZap ⚡
Zap the mess out of the dependency jungles
Overview
PipZap is a command-line tool designed to optimize Python dependency management by pruning redundant dependencies, and easing the transition to the modern formats.
It processes a dependency file, such as requirements.txt, uv's or Poetry's pyproject.toml, and outputs a minimal list of direct dependencies, removing those satisfied transitively.
Leveraging uv for dependency resolution, PipZap ensures your dependency list is lean and functional, making it easier to maintain and integrate into modern workflows.
Why PipZap?
Python dependency management can be a mess, especially with scientific libraries where outdated practices persist. Projects (even recent ones) often ship with a requirements.txt generated by pip freeze, leaving you with a sprawling list of pinned dependencies, many of which are redundant.
Take the easy_ViTPose project as an example: its requirements.txt lists 50 packages, including transitive dependencies like certifi and numpy.
See below for a real example with
easy_VitPose
PipZap can transform this into a concise, modern format such as poetry, uv, or even a good old requirements.txt with just the essential direct dependencies. This makes it much easier to
adopt any package into a modern codebase.
Moreover, even in well-maintained codebases, accidental over-specification creeps in, and PipZap cuts through that noise, keeping your dependency list clean and intentional.
Features
- Dependency Pruning: Eliminates redundant dependencies satisfied transitively.
- Format Auto-Detection: Automatically recognizes
requirements.txt,uv, andPoetryfiles. - Flexible Output: Outputs in
requirements,poetry, oruvformats. - Python Version Handling: Extracts from
pyproject.tomlor accepts via CLI forrequirements.txt. - Isolated Resolution: Resolves dependencies in a temporary, isolated environment to avoid impacting your project.
- Verbose Logging: Optional rich logging for detailed insights.
Installation
Install PipZap with pip:
Usage
Eliminate redundant dependencies from a file:
pipzap requirements.txt -p 3.11 pipzap pyproject.toml pipzap pyproject.toml -o pruned.toml -f poetry -v
- Use
-p/--python-versionto specify (recommended; defaults to the current environment forrequirements.txt). - Python version is auto-detected from
pyproject.tomlwhen present. - Output format defaults to the input format unless specified with
-f/--format(e.g.,-f requirements).
Supported Formats
requirements.txt: Pip-style with--extra-index-urlsupport.- UV
pyproject.toml: Parses[project.dependencies]and[project.requires-python]. - Poetry
pyproject.toml: Handles[project.dependencies](modern) and[tool.poetry.dependencies](legacy).
How It Works
- Parsing: Identifies the file format and extracts direct dependencies.
- Resolution: Uses
uvto build the dependency graph in a temporary, isolatedpyproject.toml. - Pruning: Identifies and removes transitive redundancies.
- Formatting: Outputs the pruned dependencies in the specified format (
requirements,poetry, oruv).
Examples
Pruning requirements.txt from easy_ViTPose
Input (requirements.txt from easy_ViTPose):
certifi==2023.7.22
charset-normalizer==3.2.0
coloredlogs==15.0.1
contourpy==1.1.1
cycler==0.11.0
ffmpeg==1.4
filelock==3.12.4
filterpy==1.4.5
flatbuffers==23.5.26
fonttools==4.43.0
humanfriendly==10.0
idna==3.4
imageio==2.31.3
importlib-resources==6.1.0
jinja2>=3.1.3
kiwisolver==1.4.5
lazy_loader==0.3
MarkupSafe==2.1.3
matplotlib==3.8.0
mpmath==1.3.0
networkx==3.1
numpy==1.26.0
onnx==1.14.1
onnxruntime==1.16.0
opencv-python==4.8.0.76
packaging==23.1
pandas==2.1.1
Pillow>=10.2.0
protobuf==4.24.3
psutil==5.9.5
py-cpuinfo==9.0.0
pycocotools==2.0.8
pyparsing==3.1.1
python-dateutil==2.8.2
pytz==2023.3.post1
PyWavelets==1.4.1
PyYAML==6.0.1
requests==2.31.0
scikit-image==0.21.0
scipy==1.11.2
seaborn==0.12.2
six==1.16.0
sympy==1.12
tifffile==2023.9.18
tqdm==4.66.1
typing_extensions==4.8.0
tzdata==2023.3
ultralytics==8.2.48
urllib3>=2.0.7
zipp==3.17.0
Command:
pipzap requirements.txt -p 3.11 -f poetry
Output (pruned to direct dependencies):
[tool.poetry.dependencies] ffmpeg = "1.4" filterpy = "1.4.5" importlib-resources = "6.1.0" lazy_loader = "0.3" onnx = "1.14.1" onnxruntime = "1.16.0" pycocotools = "2.0.8" scikit-image = "0.21.0" typing_extensions = "4.8.0" ultralytics = "8.2.48" zipp = "3.17.0"
Contributing
Contributions are welcome! To get started:
- Fork the repository.
- Install dev dependencies:
pip install -e .[dev]. - Run tests:
pytest. - Submit a pull request. Follow the Ruff linting rules and ensure type safety with mypy.
License
PipZap is licensed under the MIT License. See LICENSE for details.
Acknowledgments
- Powered by uv for dependency resolution.
- Born from the chaos of overgrown Python dependency lists.
