← Back
Editing: adapters.cpython-36.pyc
3 |`�h7q � @ sR d Z ddlZddlZddlZddlmZmZ ddlm Z ddl m Z ddl m Z ddlmZ ddlmZ dd lmZ dd lmZ dd lmZ dd lmZ dd lmZ ddlmZ ddlmZ ddlm Z ddlm Z ddlm Z ddlm Z ddl!m"Z" ddl#m$Z$m%Z% ddl&m'Z'm(Z(m)Z)m*Z*m+Z+m,Z,m-Z- ddl.m/Z/ ddl0m1Z1 ddl2m3Z3m4Z4m5Z5m Z mZm6Z6m7Z7m8Z8m9Z9 ddl:m;Z; ydd l<m=Z= W n e>k �r� d d � Z=Y nX d Z?d Z@dZAdZBy ddlCZCe� ZDeDjEe(e'�� W n e>k �r� dZDY nX d!d"ejFeGejHf eId#�d$d%�ZJd&d!d"d'd(d)�d*d+�ZKG d,d-� d-eL�ZMG d.d/� d/eM�ZNdS )0z� requests.adapters ~~~~~~~~~~~~~~~~~ This module contains the transport adapters that Requests uses to define and maintain connections. � N)� PoolManager�proxy_from_url)� HTTPResponse)� parse_url)�Timeout)�Retry)�create_urllib3_context)�ClosedPoolError)�ConnectTimeoutError)� HTTPError)� MaxRetryError)�NewConnectionError)� ProxyError)� ProtocolError)�ReadTimeoutError)�SSLError)� ResponseError)�LocationValueError� )�Response)�urlparse� basestring)�DEFAULT_CA_BUNDLE_PATH�extract_zipped_paths�get_encoding_from_headers�prepend_scheme_if_needed�get_auth_from_url� urldefragauth� select_proxy)�CaseInsensitiveDict)�extract_cookies_to_jar) �ConnectionError�ConnectTimeout� ReadTimeoutr r � RetryError� InvalidSchema�InvalidProxyURL� InvalidURL)�_basic_auth_str)�SOCKSProxyManagerc O s t d��d S )Nz'Missing dependencies for SOCKS support.)r% )�args�kwargs� r, � /usr/lib/python3.6/adapters.pyr) 0 s r) F� zbool | str | Nonez#typing.Tuple[str, str] | str | None)�verify� client_cert�poolmanager_kwargs�returnc C s, |j d�}| dko&td k o&| o&|d k}|S )N� ssl_contextT)�get�_preloaded_ssl_context)r/ r0 r1 Zhas_poolmanager_ssl_contextZ should_use_default_ssl_contextr, r, r- �_should_use_default_contextE s r6 ZPreparedRequestr z<(typing.Dict[str, typing.Any], typing.Dict[str, typing.Any]))�requestr/ r0 � poolmanagerr2 c C s� i }i }t | j�}|jj� }|j}t|di �} d} d } |dkrDd} n6t||| �rZt|d< n |dkrltt �} nt |t �rz|} | d k r�t j j| �s�| |d< n| |d< | |d < |d k r�t |t�r�t|�d kr�|d |d < |d |d< n||d < ||j|d�}||fS )NZconnection_pool_kw� CERT_REQUIREDF� CERT_NONEr3 T�ca_certs� ca_cert_dir� cert_reqs� r � cert_filer �key_file)�scheme�host�port)r �urlrA �lowerrC �getattrr6 r5 r r � isinstance�str�os�path�isdir�tuple�lenZhostname) r7 r/ r0 r8 � host_params� pool_kwargsZparsed_request_urlrA rC r1 r= �cert_locr, r, r- �_urllib3_request_contextV s< rQ c s2 e Zd ZdZ� fdd�Zd dd�Zd d � Z� ZS ) � BaseAdapterzThe Base Transport Adapterc s t t| �j� d S )N)�superrR �__init__)�self)� __class__r, r- rT � s zBaseAdapter.__init__FNTc C s t �dS )aC Sends PreparedRequest object. Returns Response object. :param request: The :class:`PreparedRequest <PreparedRequest>` being sent. :param stream: (optional) Whether to stream the request content. :param timeout: (optional) How long to wait for the server to send data before giving up, as a float, or a :ref:`(connect timeout, read timeout) <timeouts>` tuple. :type timeout: float or tuple :param verify: (optional) Either a boolean, in which case it controls whether we verify the server's TLS certificate, or a string, in which case it must be a path to a CA bundle to use :param cert: (optional) Any user-provided SSL certificate to be trusted. :param proxies: (optional) The proxies dictionary to apply to the request. N)�NotImplementedError)rU r7 �stream�timeoutr/ �cert�proxiesr, r, r- �send� s zBaseAdapter.sendc C s t �dS )z!Cleans up adapter specific items.N)rW )rU r, r, r- �close� s zBaseAdapter.close)FNTNN)�__name__� __module__� __qualname__�__doc__rT r\ r] � __classcell__r, r, )rV r- rR � s rR c s� e Zd ZdZdddddgZeeeef� fdd� Zd d � Z d d � Z efd d�Z dd� Z dd� Z dd� Zd(dd�Zd)dd�Zd*dd�Zd d � Zd d � Zd d!� Zd"d#� Zd+d&d'�Z� ZS ),� HTTPAdaptera� The built-in HTTP Adapter for urllib3. Provides a general-case interface for Requests sessions to contact HTTP and HTTPS urls by implementing the Transport Adapter interface. This class will usually be created by the :class:`Session <Session>` class under the covers. :param pool_connections: The number of urllib3 connection pools to cache. :param pool_maxsize: The maximum number of connections to save in the pool. :param max_retries: The maximum number of retries each connection should attempt. Note, this applies only to failed DNS lookups, socket connections and connection timeouts, never to requests where data has made it to the server. By default, Requests does not retry failed connections. If you need granular control over the conditions under which we retry a request, import urllib3's ``Retry`` class and pass that instead. :param pool_block: Whether the connection pool should block for connections. Usage:: >>> import requests >>> s = requests.Session() >>> a = requests.adapters.HTTPAdapter(max_retries=3) >>> s.mount('http://', a) � max_retries�config�_pool_connections� _pool_maxsize� _pool_blockc sd |t krtddd�| _n tj|�| _i | _i | _tt| �j� || _ || _ || _ | j |||d� d S )Nr F)�read)�block) �DEFAULT_RETRIESr rd Zfrom_intre � proxy_managerrS rc rT rf rg rh �init_poolmanager)rU Zpool_connectionsZ pool_maxsizerd Z pool_block)rV r, r- rT � s zHTTPAdapter.__init__c s � fdd�� j D �S )Nc s i | ]}t � |d �|�qS )N)rF )�.0�attr)rU r, r- � <dictcomp>� s z,HTTPAdapter.__getstate__.<locals>.<dictcomp>)� __attrs__)rU r, )rU r- � __getstate__� s zHTTPAdapter.__getstate__c C sH i | _ i | _x |j� D ]\}}t| ||� qW | j| j| j| jd� d S )N)rj )rl re �items�setattrrm rf rg rh )rU �statero �valuer, r, r- � __setstate__� s zHTTPAdapter.__setstate__c K s0 || _ || _|| _tf |||dd�|��| _dS )a Initializes a urllib3 PoolManager. This method should not be called from user code, and is only exposed for use when subclassing the :class:`HTTPAdapter <requests.adapters.HTTPAdapter>`. :param connections: The number of urllib3 connection pools to cache. :param maxsize: The maximum number of connections to save in the pool. :param block: Block when no free connections are available. :param pool_kwargs: Extra keyword arguments used to initialize the Pool Manager. T)� num_pools�maxsizerj �strictN)rf rg rh r r8 )rU Z connectionsry rj rO r, r, r- rm � s z HTTPAdapter.init_poolmanagerc K s� || j kr| j | }n||j� jd�r^t|�\}}t|f||| j| j| jd�|�� }| j |< n4| j|�}t |f|| j| j| jd�|�� }| j |< |S )a� Return urllib3 ProxyManager for the given proxy. This method should not be called from user code, and is only exposed for use when subclassing the :class:`HTTPAdapter <requests.adapters.HTTPAdapter>`. :param proxy: The proxy to return a urllib3 ProxyManager for. :param proxy_kwargs: Extra keyword arguments used to configure the Proxy Manager. :returns: ProxyManager :rtype: urllib3.ProxyManager �socks)�username�passwordrx ry rj )� proxy_headersrx ry rj ) rl rE � startswithr r) rf rg rh r~ r )rU �proxyZ proxy_kwargsZmanagerr| r} r~ r, r, r- �proxy_manager_for� s* z HTTPAdapter.proxy_manager_forc C s� |j � jd�rZ|rZd|_|dk rl|}tjj|�s>td|� ���tjj|�sR||_ql||_ nd|_d|_d|_ |r�t |t �s�|d |_ |d |_ n ||_ d|_ |j r�tjj|j � r�td j|j ���|j r�tjj|j � r�td j|j ���dS ) aA Verify a SSL certificate. This method should not be called from user code, and is only exposed for use when subclassing the :class:`HTTPAdapter <requests.adapters.HTTPAdapter>`. :param conn: The urllib3 connection object associated with the cert. :param url: The requested URL. :param verify: Either a boolean, in which case it controls whether we verify the server's TLS certificate, or a string, in which case it must be a path to a CA bundle to use :param cert: The SSL certificate to verify. �httpsr9 TzCCould not find a suitable TLS CA certificate bundle, invalid path: r: Nr r z9Could not find the TLS certificate file, invalid path: {}z1Could not find the TLS key file, invalid path: {})rE r r= rI rJ �exists�OSErrorrK r; r< rG r r? r@ �IOError�format)rU �connrD r/ rZ rP r, r, r- � cert_verify s2 zHTTPAdapter.cert_verifyc C s� t � }t|dd�|_tt|di ��|_t|j�|_||_|jj|_t |j t �r^|j j d�|_ n|j |_ t |j||� ||_| |_|S )a� Builds a :class:`Response <requests.Response>` object from a urllib3 response. This should not be called from user code, and is only exposed for use when subclassing the :class:`HTTPAdapter <requests.adapters.HTTPAdapter>` :param req: The :class:`PreparedRequest <PreparedRequest>` used to generate the response. :param resp: The urllib3 response object. :rtype: requests.Response ZstatusN�headerszutf-8)r rF Z status_coder r� r �encoding�raw�reasonrG rD �bytes�decoder �cookiesr7 � connection)rU Zreq�respZresponser, r, r- �build_responseL s zHTTPAdapter.build_responseNc C s t |||| j�S )a� Build the PoolKey attributes used by urllib3 to return a connection. This looks at the PreparedRequest, the user-specified verify value, and the value of the cert parameter to determine what PoolKey values to use to select a connection from a given urllib3 Connection Pool. The SSL related pool key arguments are not consistently set. As of this writing, use the following to determine what keys may be in that dictionary: * If ``verify`` is ``True``, ``"ssl_context"`` will be set and will be the default Requests SSL Context * If ``verify`` is ``False``, ``"ssl_context"`` will not be set but ``"cert_reqs"`` will be set * If ``verify`` is a string, (i.e., it is a user-specified trust bundle) ``"ca_certs"`` will be set if the string is not a directory recognized by :py:func:`os.path.isdir`, otherwise ``"ca_certs_dir"`` will be set. * If ``"cert"`` is specified, ``"cert_file"`` will always be set. If ``"cert"`` is a tuple with a second item, ``"key_file"`` will also be present To override these settings, one may subclass this class, call this method and use the above logic to change parameters as desired. For example, if one wishes to use a custom :py:class:`ssl.SSLContext` one must both set ``"ssl_context"`` and based on what else they require, alter the other keys to ensure the desired behaviour. :param request: The PreparedReqest being sent over the connection. :type request: :class:`~requests.models.PreparedRequest` :param verify: Either a boolean, in which case it controls whether we verify the server's TLS certificate, or a string, in which case it must be a path to a CA bundle to use. :param cert: (optional) Any user-provided SSL certificate for client authentication (a.k.a., mTLS). This may be a string (i.e., just the path to a file which holds both certificate and key) or a tuple of length 2 with the certificate file path and key file path. :returns: A tuple of two dictionaries. The first is the "host parameters" portion of the Pool Key including scheme, hostname, and port. The second is a dictionary of SSLContext related parameters. )rQ r8 )rU r7 r/ rZ r, r, r- �$build_connection_pool_key_attributesq s +z0HTTPAdapter.build_connection_pool_key_attributesc C s� t |j|�}y| j|||�\}}W n. tk rP } zt||d��W Y dd}~X nX |r�t|d�}t|�} | jsvtd��| j |�} | j f |d|i��} n| j j f |d|i��} | S )ap Returns a urllib3 connection for the given request and TLS settings. This should not be called from user code, and is only exposed for use when subclassing the :class:`HTTPAdapter <requests.adapters.HTTPAdapter>`. :param request: The :class:`PreparedRequest <PreparedRequest>` object to be sent over the connection. :param verify: Either a boolean, in which case it controls whether we verify the server's TLS certificate, or a string, in which case it must be a path to a CA bundle to use. :param proxies: (optional) The proxies dictionary to apply to the request. :param cert: (optional) Any user-provided SSL certificate to be used for client authentication (a.k.a., mTLS). :rtype: urllib3.ConnectionPool )r7 N�httpzFPlease check proxy URL. It is malformed and could be missing the host.rO ) r rD r� � ValueErrorr' r r rB r& r� Zconnection_from_hostr8 ) rU r7 r/ r[ rZ r� rN rO �e� proxy_urlrl r� r, r, r- � get_connection_with_tls_context� s( z+HTTPAdapter.get_connection_with_tls_contextc C sd t ||�}|rDt|d�}t|�}|js.td��| j|�}|j|�}n t|�}|j� }| j j|�}|S )a DEPRECATED: Users should move to `get_connection_with_tls_context` for all subclasses of HTTPAdapter using Requests>=2.32.2. Returns a urllib3 connection for the given URL. This should not be called from user code, and is only exposed for use when subclassing the :class:`HTTPAdapter <requests.adapters.HTTPAdapter>`. :param url: The URL to connect to. :param proxies: (optional) A Requests-style dictionary of proxies used on this request. :rtype: urllib3.ConnectionPool r� zFPlease check proxy URL. It is malformed and could be missing the host.) r r r rB r& r� Zconnection_from_urlr Zgeturlr8 )rU rD r[ r� r� rl r� Zparsedr, r, r- �get_connection� s zHTTPAdapter.get_connectionc C s* | j j� x| jj� D ] }|j� qW dS )z�Disposes of any internal state. Currently, this closes the PoolManager and any active ProxyManager, which closes any pooled connections. N)r8 �clearrl �values)rU r� r, r, r- r] � s zHTTPAdapter.closec C sb t |j|�}t|j�j}|o"|dk}d}|rDt|�jj� }|jd�}|j}|r^| r^t|j�}|S )a? Obtain the url to use when making the final request. If the message is being sent through a HTTP proxy, the full URL has to be used. Otherwise, we should only use the path portion of the URL. This should not be called from user code, and is only exposed for use when subclassing the :class:`HTTPAdapter <requests.adapters.HTTPAdapter>`. :param request: The :class:`PreparedRequest <PreparedRequest>` being sent. :param proxies: A dictionary of schemes or schemes and hosts to proxy URLs. :rtype: str r� Fr{ )r rD r rA rE r Zpath_urlr ) rU r7 r[ r� rA Zis_proxied_http_requestZusing_socks_proxyZ proxy_schemerD r, r, r- � request_url� s zHTTPAdapter.request_urlc K s dS )a" Add any headers needed by the connection. As of v2.0 this does nothing by default, but is left for overriding by users that subclass the :class:`HTTPAdapter <requests.adapters.HTTPAdapter>`. This should not be called from user code, and is only exposed for use when subclassing the :class:`HTTPAdapter <requests.adapters.HTTPAdapter>`. :param request: The :class:`PreparedRequest <PreparedRequest>` to add headers to. :param kwargs: The keyword arguments from the call to send(). Nr, )rU r7 r+ r, r, r- � add_headers s zHTTPAdapter.add_headersc C s& i }t |�\}}|r"t||�|d< |S )a Returns a dictionary of the headers to add to any request sent through a proxy. This works with urllib3 magic to ensure that they are correctly sent to the proxy, rather than in a tunnelled request if CONNECT is being used. This should not be called from user code, and is only exposed for use when subclassing the :class:`HTTPAdapter <requests.adapters.HTTPAdapter>`. :param proxy: The url of the proxy being used for this request. :rtype: dict zProxy-Authorization)r r( )rU r� r� r| r} r, r, r- r~ s zHTTPAdapter.proxy_headersFTc 7 C s� y| j ||||d�}W n. tk rD } zt||d��W Y dd}~X nX | j||j||� | j||�} | j||||||d� |jdkp�d|jk } t |t �r�y|\} } t | | d�}W n4 t k r� } zdj |�} t | ��W Y dd}~X nX nt |t �r�n t ||d�}�yN| �s6|j|j| |j|jdddd| j|d � }�nt|d ��rH|j}|jtd �}y�|j|j| d d � x$|jj� D ]\}}|j||� �qtW |j� xN|jD ]D}|jtt|��dd� j d�� |jd� |j|� |jd� �q�W |jd� y|j d d�}W n t k �r |j � }Y nX t j |||ddd�}W n |j!� � Y nX W �n� t"t#j$fk �r� } zt%| |d��W Y dd} ~ X �nZ t&k �r. } z�t |j't(��r�t |j't)��s�t*||d��t |j't+��r�t,||d��t |j't-��r�t.||d��t |j't/��rt0||d��t%||d��W Y dd}~X n� t1k �r\ } zt%||d��W Y dd}~X n� t-k �r� } zt.|��W Y dd}~X n^ t/t2fk �r� } z<t |t/��r�t0||d��n t |t3��r�t4||d��n� W Y dd}~X nX | j5||�S )a Sends PreparedRequest object. Returns Response object. :param request: The :class:`PreparedRequest <PreparedRequest>` being sent. :param stream: (optional) Whether to stream the request content. :param timeout: (optional) How long to wait for the server to send data before giving up, as a float, or a :ref:`(connect timeout, read timeout) <timeouts>` tuple. :type timeout: float or tuple or urllib3 Timeout object :param verify: (optional) Either a boolean, in which case it controls whether we verify the server's TLS certificate, or a string, in which case it must be a path to a CA bundle to use :param cert: (optional) Any user-provided SSL certificate to be trusted. :param proxies: (optional) The proxies dictionary to apply to the request. :rtype: requests.Response )r[ rZ )r7 N)rX rY r/ rZ r[ zContent-Length)�connectri zrInvalid timeout {}. Pass a (connect, read) timeout tuple, or a single float to set both timeouts to the same valueF) �methodrD �bodyr� ZredirectZassert_same_host�preload_content�decode_contentZretriesrY � proxy_pool)rY T)Zskip_accept_encodingr> zutf-8s s 0 )� buffering)Zpoolr� r� r� )6r� r r' r� rD r� r� r� r� rG rL � TimeoutSaucer� r� Zurlopenr� rd �hasattrr� Z _get_conn�DEFAULT_POOL_TIMEOUTZ putrequestrs Z putheaderZ endheadersr\ �hexrM �encodeZ getresponse� TypeErrorr Z from_httplibr] r �socket�errorr! r r� r r r" r r$ � _ProxyErrorr � _SSLErrorr r � _HTTPErrorr r# r� )rU r7 rX rY r/ rZ r[ r� r� rD Zchunkedr� ri �errr� Zlow_conn�headerrv �i�rr, r, r- r\ 5 s� zHTTPAdapter.send)N)NN)N)FNTNN)r^ r_ r` ra rq �DEFAULT_POOLSIZErk �DEFAULT_POOLBLOCKrT rr rw rm r� r� r� r� r� r� r] r� r� r~ r\ rb r, r, )rV r- rc � s( %3% - / rc )Ora Zos.pathrI r� ZtypingZurllib3.poolmanagerr r Zurllib3.responser Z urllib3.utilr r r� Zurllib3.util.retryr Zurllib3.util.ssl_r Zurllib3.exceptionsr r r r� r r r r� r r r r� r r Zmodelsr �compatr r Zutilsr r r r r r r Z structuresr r� r � exceptionsr! r" r# r$ r% r& r' Zauthr( Zurllib3.contrib.socksr) � ImportErrorr� r� rk r� Zsslr5 Zload_verify_locationsZDictrH ZAny�boolr6 rQ �objectrR rc r, r, r, r- �<module> sj $ , *
Save File
Cancel