← Back
Editing: req_set.cpython-36.pyc
3 �Pf � � @ s~ d dl mZ d dlmZ d dlmZ d dlZd dlZd dlm Z d dlm Z d dl m Z d dl mZmZmZmZmZ d d lmZmZmZmZmZmZmZmZm Z m Z d d l m Z d d l m!Z!m"Z"m#Z#m$Z$m%Z% d d l&m'Z' d d l(m)Z) d dl*m+Z+ d dl,m-Z- d dl.m/Z/ ej0e1�Z2G dd� de3�Z4G dd� de3�Z5dd� Z6G dd� de5�Z7G dd� de5�Z8G dd � d e5�Z9G d d � d e3�Z:dS ) � )�absolute_import)� defaultdict)�chainN)� pkg_resources)�requests)� expanduser)� is_file_url� is_dir_url� is_vcs_url� url_to_path� unpack_url) �InstallationError�BestVersionAlreadyInstalled�DistributionNotFound�PreviousBuildDirError� HashError� HashErrors� HashUnpinned�DirectoryUrlHashUnsupported�VcsHashUnsupported�UnsupportedPythonVersion)�InstallRequirement)� display_path�dist_in_usersite�dist_in_install_path� ensure_dir�normalize_path)� MissingHashes)� indent_log)�check_dist_requires_python)�vcs)�Wheelc @ sD e Zd Zdd� Zdd� Zdd� Zdd� Zd d � Zd d � Zd d� Z dS )� Requirementsc C s g | _ i | _d S )N)�_keys�_dict)�self� r& � /usr/lib/python3.6/req_set.py�__init__" s zRequirements.__init__c C s | j S )N)r# )r% r& r& r' �keys& s zRequirements.keysc s � fdd�� j D �S )Nc s g | ]}� j | �qS r& )r$ )�.0�key)r% r& r' � <listcomp>* s z'Requirements.values.<locals>.<listcomp>)r# )r% r& )r% r' �values) s zRequirements.valuesc C s || j kS )N)r# )r% �itemr& r& r' � __contains__, s zRequirements.__contains__c C s$ || j kr| j j|� || j|< d S )N)r# �appendr$ )r% r+ �valuer& r& r' � __setitem__/ s zRequirements.__setitem__c C s | j | S )N)r$ )r% r+ r& r& r' � __getitem__4 s zRequirements.__getitem__c s$ � fdd�� j � D �}ddj|� S )Nc s$ g | ] }d t |�t � | �f �qS )z%s: %s)�repr)r* �k)r% r& r' r, 8 s z)Requirements.__repr__.<locals>.<listcomp>zRequirements({%s})z, )r) �join)r% r- r& )r% r' �__repr__7 s zRequirements.__repr__N) �__name__� __module__� __qualname__r( r) r- r/ r2 r3 r7 r& r& r& r' r" s r" c @ s( e Zd ZdZdd� Zdd� Zdd� ZdS ) �DistAbstractionat Abstracts out the wheel vs non-wheel prepare_files logic. The requirements for anything installable are as follows: - we must be able to determine the requirement name (or we can't correctly handle the non-upgrade case). - we must be able to generate a list of run-time dependencies without installing any additional packages (or we would have to either burn time by doing temporary isolated installs or alternatively violate pips 'don't start installing unless all requirements are available' rule - neither of which are desirable). - for packages with setup requirements, we must also be able to determine their requirements without installing additional packages (for the same reason as run-time dependencies) - we must be able to create a Distribution object exposing the above metadata. c C s || _ d S )N)�req_to_install)r% r< r& r& r' r( O s zDistAbstraction.__init__c C s t | j��dS )z Return a setuptools Dist object.N)�NotImplementedError�dist)r% �finderr& r& r' r> R s zDistAbstraction.distc C s t | j��dS )z3Ensure that we can get a Dist for this requirement.N)r= r> )r% r& r& r' � prep_for_distV s z DistAbstraction.prep_for_distN)r8 r9 r: �__doc__r( r> r@ r& r& r& r' r; < s r; c C s0 | j rt| �S | jr$| jjr$t| �S t| �S dS )z�Factory to make an abstract dist object. Preconditions: Either an editable req with a source_dir, or satisfied_by or a wheel link, or a non-editable req with a source_dir. :return: A concrete DistAbstraction. N)�editable�IsSDist�link�is_wheel�IsWheel)r< r& r& r' �make_abstract_dist[ s rG c @ s e Zd Zdd� Zdd� ZdS )rF c C s t tj| jj��d S )Nr )�listr Zfind_distributionsr< � source_dir)r% r? r& r& r' r> m s z IsWheel.distc C s d S )Nr& )r% r& r& r' r@ q s zIsWheel.prep_for_distN)r8 r9 r: r> r@ r& r& r& r' rF k s rF c @ s e Zd Zdd� Zdd� ZdS )rC c C s( | j j� }|jd�r$|j|jd�� |S )Nzdependency_links.txt)r< Zget_distZ has_metadataZadd_dependency_linksZget_metadata_lines)r% r? r> r& r& r' r> x s z IsSDist.distc C s | j j� | j j� d S )N)r< Z run_egg_infoZ assert_source_matches_version)r% r& r& r' r@ � s zIsSDist.prep_for_distN)r8 r9 r: r> r@ r& r& r& r' rC v s rC c @ s e Zd Zdd� Zdd� ZdS )� Installedc C s | j jS )N)r< � satisfied_by)r% r? r& r& r' r> � s zInstalled.distc C s d S )Nr& )r% r& r& r' r@ � s zInstalled.prep_for_distN)r8 r9 r: r> r@ r& r& r& r' rJ � s rJ c @ s� e Zd Zd$dd�Zdd� Zdd � Zd%d d �Zd d � Zedd� �Z edd� �Z dd� Z d&dd�Z dd� Z dd� Zdd� Zd'd d �Zd d � Zd d!� Zf fd"d#�ZdS )(�RequirementSetFNTc C s� | dkrt d��|| _|| _|| _|| _|| _|| _| | _t� | _ i | _ g | _ | | _ || _ g | _g | _g | _|| _| | _|| _| | _| | _|| _|r�t|�}|| _|| _|| _tt �| _ dS )a3 Create a RequirementSet. :param wheel_download_dir: Where still-packed .whl files should be written to. If None they are written to the download_dir parameter. Separate to download_dir to permit only keeping wheel archives for pip wheel. :param download_dir: Where still packed archives should be written to. If None they are not saved, and are deleted immediately after unpacking. :param wheel_cache: The pip wheel cache, for passing to InstallRequirement. Nz?RequirementSet() missing 1 required keyword argument: 'session') � TypeError� build_dir�src_dir� download_dir�upgrade�upgrade_strategy�ignore_installed�force_reinstallr" � requirements�requirement_aliases�unnamed_requirements�ignore_dependencies�ignore_requires_python�successfully_downloaded�successfully_installed�reqs_to_cleanup�as_egg� use_user_site� target_dir�session� pycompile�isolatedr �wheel_download_dir� _wheel_cache�require_hashesr rH � _dependencies)r% rN rO rP rQ rR rS r] r_ rX rT r^ r` ra rb rc � wheel_cachere rY r& r& r' r( � s< zRequirementSet.__init__c C s8 dd� | j j� D �}|jdd� d� djdd� |D ��S )Nc S s g | ]}|j s|�qS r& )Z comes_from)r* �reqr& r& r' r, � s z*RequirementSet.__str__.<locals>.<listcomp>c S s | j j� S )N)�name�lower)rh r& r& r' �<lambda>� s z(RequirementSet.__str__.<locals>.<lambda>)r+ � c S s g | ]}t |j��qS r& )�strrh )r* rh r& r& r' r, � s )rU r- �sortr6 )r% �reqsr& r& r' �__str__� s zRequirementSet.__str__c C sN dd� | j j� D �}|jdd� d� djdd� |D ��}d| jjt|�|f S ) Nc S s g | ]}|�qS r& r& )r* rh r& r& r' r, � s z+RequirementSet.__repr__.<locals>.<listcomp>c S s | j j� S )N)ri rj )rh r& r& r' rk � s z)RequirementSet.__repr__.<locals>.<lambda>)r+ z, c S s g | ]}t |j��qS r& )rm rh )r* rh r& r& r' r, � s z"<%s object; %d requirement(s): %s>)rU r- rn r6 � __class__r8 �len)r% ro Zreqs_strr& r& r' r7 � s zRequirementSet.__repr__c C s� |j }|j|�s&tjd|j |j� g S |jrV|jjrVt|jj�}|j � sVt d|j ��| j |_ | j |_ | j |_ | j|_|dk|_|s�| jj|� |gS y| j|�}W n tk r� d}Y nX |dko�|o�|j o�|j|jko�|jj|jjk �rt d|||f ��|�s8|| j|< |j� |k�r0|| j|j� < |g}n�g }|j �r�|j�r�|j�r�|j�ol|jj|jjk �r�| j j|� t d| ��d|_t t t |j�j t |j����|_tj!d||j� |g}|}|�r�| j|�}| j"| j|� |S dS )a' Add install_req as a requirement to install. :param parent_req_name: The name of the requirement that needed this added. The name is used because when multiple unnamed requirements resolve to the same name, we could otherwise end up with dependency links that point outside the Requirements set. parent_req must already be added. Note that None implies that this is a user supplied requirement, vs an inferred one. :param extras_requested: an iterable of extras used to evaluate the environement markers. :return: Additional requirements to scan. That is either [] if the requirement is not applicable, or [install_req] if the requirement is applicable and has just been added. z6Ignoring %s: markers '%s' don't match your environmentz-%s is not a supported wheel on this platform.Nz5Double requirement given: %s (already in %s, name=%r)zhCould not satisfy constraints for '%s': installation from path or url cannot be constrained to a versionFzSetting %s extras to: %s)#ri Z match_markers�logger�warningZmarkersrD rE r! �filenameZ supportedr r] r^ r_ ra � is_directrW r0 �get_requirement�KeyError� constraint�extrasrh Z specifierrU rj rV �pathr\ �tuple�sorted�set�union�debugrf ) r% � install_reqZparent_req_name�extras_requestedri ZwheelZ existing_req�resultZ parent_reqr& r& r' �add_requirement� sp z RequirementSet.add_requirementc C sF |j � }|| jkr | j| j s>|| jkrB| j| j| j rBdS dS )NTF)rj rU ry rV )r% � project_nameri r& r& r' �has_requirement4 s z RequirementSet.has_requirementc C s t dd� | jj� D ��p | jS )Nc s s | ]}|j s|V qd S )N)ry )r* rh r& r& r' � <genexpr>? s z2RequirementSet.has_requirements.<locals>.<genexpr>)rH rU r- rW )r% r& r& r' �has_requirements= s z RequirementSet.has_requirementsc C sD | j r@t| j �| _ tjj| j �r$dS tjd� tdt| j � ��dS )NTz!Could not find download directoryz0Could not find or access download directory '%s'F) rP r �osr{ �existsrs �criticalr r )r% r& r& r' � is_downloadB s zRequirementSet.is_downloadc C sT xB||j � fD ]2}|| jkr&| j| S || jkr| j| j| S qW td| ��d S )NzNo project with the name %r)rj rU rV rx )r% r� ri r& r& r' rw O s z RequirementSet.get_requirementc C s4 x.| j j� D ] }|jrq |j|d� |j� q W d S )N)� auto_confirm)rU r- ry � uninstall�commit_uninstall)r% r� rh r& r& r' r� W s zRequirementSet.uninstallc C s� | j rt| j � | j| jj� }| jp6tdd� |D ��}|rJ| jrJtd��g }t � }xdt ||�D ]V}y |j | j |||| j d�� W q` tk r� } z||_|j|� W Y dd}~X q`X q`W |r�|�dS )zY Prepare process. Create temp directories, download and/or unpack files. c s s | ] }|j V qd S )N)Zhas_hash_options)r* rh r& r& r' r� j s z/RequirementSet.prepare_files.<locals>.<genexpr>z�--egg is not allowed with --require-hashes mode, since it delegates dependency resolution to setuptools and could thus result in installation of unhashed packages.)re rX N)rc r rW rU r- re �anyr] r r r �extend� _prepare_filerX r rh r0 )r% r? Z root_reqsre Zdiscovered_reqsZ hash_errorsrh �excr& r& r' � prepare_files^ s, z RequirementSet.prepare_filesc C s | j o | jdkp | jdko |jS )NZeagerzonly-if-needed)rQ rR rv )r% rh r& r& r' �_is_upgrade_allowed� s z"RequirementSet._is_upgrade_allowedc C s� |j � |jr�| j|�}d}|r�| jp*|jshy|j||� W n* tk rT d}Y n tk rf Y nX |s�| jr~t |j� p�t |j� s�|j|_ d|_|r�d}n| j dkr�d}nd}|S dS dS )a Check if req_to_install should be skipped. This will check if the req is installed, and whether we should upgrade or reinstall it, taking into account all the relevant user options. After calling this req_to_install will only have satisfied_by set to None if the req_to_install is to be upgraded/reinstalled etc. Any other value will be a dist recording the current thing installed that satisfies the requirement. Note that for vcs urls and the like we can't assess skipping in this routine - we simply identify that we need to pull the thing down, then later on it is pulled down and introspected to assess upgrade/ reinstalls etc. :return: A text reason for why it was skipped, or None. FTNzalready up-to-datezonly-if-neededz%not upgraded as not directly requiredzalready satisfied) �check_if_existsrK r� rT rD Zfind_requirementr r r^ r r �conflicts_withrR )r% r< r? Zupgrade_allowedZbest_installed� skip_reasonr& r& r' �_check_skip_installed� s4 z$RequirementSet._check_skip_installedc ( s� �j s �jrg S d�_�jr*tjd�� n��jdks8t��jsJ�j�|�}�jrx|dk shtd�jf ��tjd|�� n<�j r��j j dkr�t �j j �}tjdt |�� n tjd�� t� ��� �j�r |r�td � ���j�j� �j�j � t��}|j� �j�r�j�j� �j� �n0�j�rD|�r8tjd � t��}�n �j�j� t j j t j j �j d ���r|t!d ��j f ���j"|�j#��|� �j �s�t��j }|�r�t$|��r�t%� �nt&|��r�t'|��r�t(� ��j) �r�j* �r�t+� ��j,| d �} |�r| �rt-� } yZ�j} d} �j j.�r4�j/�r4�j/} �j j.�rN| �rJd} nd} t0�j �j | | �j1| d� W nH t2j3k �r� } z(tj4d�| � td�| �j f ��W Y dd} ~ X nX t��}|j� �j�r�j j t5j6k�r�j�j� �j�s��j� �j�rP�j7�s�j�rD�j8�r&t9�j� �p0t:�j� �s<�j�_;d�_n tjd�� |j<|�} y t=| � W nH t>k �r� } z*�j?�r�tj@|jAd � n �jB� � W Y dd}~X nX g � � ��fdd�}�jC�jD��sވjE�d� |�sp�jF�r tjddj �jF�� tGtH�jF�tH| jF� �}x |D ]}tj@d| |� �q W tGtH| jF�tH�jF�@ �}x | jI|�D ]}|||d� �qZW �jJjK�� �j �r��j �r��jLjK�� W dQ R X � S )zxPrepare a single requirements file. :return: A list of additional InstallRequirements to also install. Tz Obtaining %sNzP_check_skip_installed returned None but req_to_install.satisfied_by is set to %rzRequirement %s: %s�filez Processing %sz Collecting %szoThe editable requirement %s cannot be installed when requiring hashes, because there is no single file to hash.z�Since it is already installed, we are trusting this package without checking its hash. To ensure a completely repeatable environment, install into an empty virtualenv.zsetup.pyz�pip can't proceed with requirements '%s' due to a pre-existing build directory (%s). This is likely due to a previous installation that failed. pip is being responsible and not assuming it can delete this. Please delete it and try again.)Ztrust_internetF)r` �hashesz4Could not install requirement %s because of error %szDCould not install requirement %s because of HTTP error %s for URL %sz<Requirement already satisfied (use --upgrade to upgrade): %sr c s4 t t| ���j�jd�}� j�j|�j|d�� d S )N)rb rg )r� )r rm rb rd r� r� ri )�subreqr� Zsub_install_req)� more_reqsr< r% r& r' �add_req� s z-RequirementSet._prepare_file.<locals>.add_reqz!Installing extra requirements: %r�,z"%s does not provide the extra '%s')r� )Mry ZpreparedrB rs �inforK �AssertionErrorrS r� rD �schemer Zurlr r r Zensure_has_source_dirrO Zupdate_editabler� rG r@ �archiverP r� r� rJ rN r� r{ r� r6 rI r Z populate_linkr� r r r r r Z original_linkZ is_pinnedr r� r rE rc r r` r Z HTTPErrorr� r Z all_schemesrQ r^ r r r� r> r r rY rt �args�remove_temporary_sourcer� ri r� rz r} r~ Zrequiresr\ r0 rZ )r% r? r< re rX r� r{ Z abstract_distrD r� rP Zautodelete_unpackedr� r> �er� Zmissing_requestedZmissingZavailable_requestedr� r& )r� r< r% r' r� � s " z RequirementSet._prepare_filec C s8 t jd� t� � x| jD ] }|j� qW W dQ R X dS )z Clean up files, remove builds.zCleaning up...N)rs r� r r\ r� )r% rh r& r& r' � cleanup_files� s z RequirementSet.cleanup_filesc s< g � t � �� ���fdd��x�jj� D ] }�|� q(W � S )z�Create the installation order. The installation order is topological - requirements are installed before the requiring thing. We break cycles at an arbitrary point, and make no other guarantees. c sP | j s| �krd S | jr d S �j| � x�j| D ] }�|� q2W � j| � d S )N)rK ry �addrf r0 )rh Zdep)�order� ordered_reqs�scheduler% r& r' r� � s z,RequirementSet._to_install.<locals>.schedule)r~ rU r- )r% r� r& )r� r� r� r% r' � _to_install� s zRequirementSet._to_installc O s� | j � }|r(tjddjdd� |D ��� t� �� x�|D ]�}|jrltjd|j� t� � |jdd� W dQ R X y|j||f|�|� W n$ |jr�|j r�|j � � Y nX |jr�|jr�|j � |j � q6W W dQ R X || _ dS ) zl Install everything in this set (after having downloaded and unpacked the packages) z!Installing collected packages: %sz, c S s g | ] }|j �qS r& )ri )r* rh r& r& r' r, s z*RequirementSet.install.<locals>.<listcomp>z Found existing installation: %sT)r� N) r� rs r� r6 r r� r� �installZinstall_succeededZrollback_uninstallr� r� r[ )r% Zinstall_optionsZglobal_optionsr� �kwargsZ to_installZ requirementr& r& r' r� � s: zRequirementSet.install)FNFFNFFFNTFNNFF)NN)F)FF)r8 r9 r: r( rp r7 r� r� �propertyr� r� rw r� r� r� r� r� r� r� r� r& r& r& r' rL � s4 4 [ 'E rL );Z __future__r � collectionsr � itertoolsr Zloggingr� Z pip._vendorr r Z pip.compatr Z pip.downloadr r r r r Zpip.exceptionsr r r r r r r r r r Zpip.req.req_installr Z pip.utilsr r r r r Zpip.utils.hashesr Zpip.utils.loggingr Zpip.utils.packagingr Zpip.vcsr Z pip.wheelr! Z getLoggerr8 rs �objectr" r; rG rF rC rJ rL r& r& r& r' �<module> s0 0
Save File
Cancel