HEX

File: //usr/lib/python3.6/site-packages/urllib3/__pycache__/response.cpython-36.pyc
3

��yi���@sFddlmZddlmZddlZddlZddlZddlZddlZddl	Z	ddl
mZddl
m
ZddlmZddlmZmZmZmZmZmZmZmZdd	lmZmZdd
lmZ ddl!m"Z"m#Z#ddl$m%Z%m&Z&ej'e(�Z)Gd
d�de*�Z+Gdd�de*�Z,Gdd�de*�Z-Gdd�de*�Z.dd�Z/Gdd�d�Z0Gdd�dej1�Z2dS)�)�absolute_import)�contextmanagerN)�timeout)�error�)�HTTPHeaderDict)�BodyNotHttplibCompatible�
ProtocolError�DecodeError�ReadTimeoutError�ResponseNotChunked�IncompleteRead�
InvalidHeader�DependencyWarning)�string_types�PY3)�http_client)�
HTTPException�BaseSSLError)�is_fp_closed�is_response_to_headc@s2eZdZdd�Zdd�Zddd�Zedd	��Zd
S)
�DeflateDecodercCs d|_d|_d|_tj�|_dS)NT�)�
_first_try�_first_try_data�_unfed_data�zlib�
decompressobj�_obj)�self�r �/usr/lib/python3.6/response.py�__init__szDeflateDecoder.__init__cCst|j|�S)N)�getattrr)r�namer r r!�__getattr__!szDeflateDecoder.__getattr__rcCs�|j|}d|_|r$|jjr$|S|}|dkr6d}n|dkrH||_dS|jsf|jj|jj||d�S|j|7_y$|jj||d�}|r�d|_d|_|Stjk
r�d|_tjtj	�|_z|j|j|d�Sd|_XYnXdS)Nrr)�
max_lengthF)
rr�unconsumed_tailr�
decompressrrrr�	MAX_WBITS)r�datar&Zoriginal_max_lengthZdecompressedr r r!r($s6
zDeflateDecoder.decompresscCst|j�pt|jj�o|jS)N)�boolrrr'r)rr r r!�has_unconsumed_tailNs
z"DeflateDecoder.has_unconsumed_tailN���)r-)�__name__�
__module__�__qualname__r"r%r(�propertyr,r r r r!rs
*rc@seZdZdZdZdZdS)�GzipDecoderStaterr�N)r.r/r0�FIRST_MEMBER�
OTHER_MEMBERS�SWALLOW_DATAr r r r!r2Usr2c@s2eZdZdd�Zdd�Zddd�Zedd	��Zd
S)
�GzipDecodercCs$tjdtj�|_tj|_d|_dS)N�r)rrr)rr2r4�_state�_unconsumed_tail)rr r r!r"^szGzipDecoder.__init__cCst|j|�S)N)r#r)rr$r r r!r%cszGzipDecoder.__getattr__rc
Cs"t�}|jtjkrt|�S|dkr4|j|7_dS|j|}|rT|jjrTt|�Sx�y&||jj|t	|t
|�d�d�7}Wn>tjk
r�|j}tj|_d|_|tj
kr�t|�S�YnX|jjp�|jj|_}|dkr�t
|�|kr�P|s�t|�S|jjrVtj
|_tjdtj�|_qVWt|�S)Nrr)r&r8)�	bytearrayr9r2r6�bytesr:r�eofr(�max�lenrrr5r'Zunused_datarr))rr*r&�retZprevious_stater r r!r(fs:

zGzipDecoder.decompresscCs
t|j�S)N)r+r:)rr r r!r,�szGzipDecoder.has_unconsumed_tailNr-)r-)r.r/r0r"r%r(r1r,r r r r!r7\s
2r7c@s:eZdZdZdZdd�Zdd�Zddd	�Zed
d��Z	dS)�MultiDecodera
    From RFC7231:
        If one or more encodings have been applied to a representation, the
        sender that applied the encodings MUST generate a Content-Encoding
        header field that lists the content codings in the order in which
        they were applied.
    �cCsPdd�|jd�D�}t|�|jkr<tdt|��d|j����dd�|D�|_dS)NcSsg|]}|j��qSr )�strip)�.0�mr r r!�
<listcomp>�sz)MultiDecoder.__init__.<locals>.<listcomp>�,z)Too many content encodings in the chain: z > cSsg|]}t|��qSr )�_get_decoder)rD�er r r!rF�s)�splitr?�max_decode_linksr
�	_decoders)rZmodes�	encodingsr r r!r"�s
zMultiDecoder.__init__cCs|jdj�S)Nr)rL�flush)rr r r!rN�szMultiDecoder.flushrcCs�|dkr*xt|j�D]}|j|�}qW|St�}x`d}x0t|j�D]"}|j||t|�d�}|rBd}qBW||7}|s�t|�|kr�t|�Sd}q2WdS)NrF)r&Tr)�reversedrLr(r;r?r<)rr*r&�dr@Zany_datar r r!r(�szMultiDecoder.decompresscCstdd�|jD��S)Ncss|]}|jVqdS)N)r,)rDrPr r r!�	<genexpr>�sz3MultiDecoder.has_unconsumed_tail.<locals>.<genexpr>)�anyrL)rr r r!r,�sz MultiDecoder.has_unconsumed_tailNr-)r-)
r.r/r0�__doc__rKr"rNr(r1r,r r r r!rA�s	
rAcCs$d|krt|�S|dkrt�St�S)NrG�gzip)rAr7r)�moder r r!rH�s
rHc@s0eZdZdZdd�Zdd�Zdd�Zdd	�Zd
S)�BytesQueueBuffera�Memory-efficient bytes buffer

    To return decoded data in read() and still follow the BufferedIOBase API, we need a
    buffer to always return the correct amount of bytes.

    This buffer should be filled using calls to put()

    Our maximum memory usage is determined by the sum of the size of:

     * self.buffer, which contains the full data
     * the largest chunk that we will copy in get()
    cCstj�|_d|_dS)Nr)�collections�deque�buffer�_size)rr r r!r"�s
zBytesQueueBuffer.__init__cCs|jS)N)rZ)rr r r!�__len__�szBytesQueueBuffer.__len__cCs"|jj|�|jt|�7_dS)N)rY�appendrZr?)rr*r r r!�put�szBytesQueueBuffer.putc	Cs|dkrdS|jstd��n|dkr,td��t|jd�|krft|jdt�rf|j|8_|jj�Sd}tj	�}x�||k�r||}|jj�}t|�}||kr�|d|�||d�}}|j
|�|jj|�|j|8_Pn|j
|�|j|8_||7}|jstPqtW|j�S)Nrrzbuffer is emptyzn should be > 0)
rY�RuntimeError�
ValueErrorr?�
isinstancer<rZ�popleft�io�BytesIO�write�
appendleft�getvalue)	r�nZfetchedr@Z	remaining�chunkZchunk_lengthZ
left_chunkZright_chunkr r r!�get�s6
"



zBytesQueueBuffer.getN)r.r/r0rSr"r[r]rir r r r!rV�s
rVc@s8eZdZdZddgZdddddgZdLdd�Zdd�Zdd�Ze	dd��Z
e	dd��Zdd�Zdd�Z
dd�Zdd�ZdMd d!�Zd"d#�Zed$d%��ZdNd&d'�ZdOd(d)�ZdQd,d-�Zed.d/��Zd0d1�ZdRd2d3�Zd4d5�Zd6d7�Ze	d8d9��Zd:d;�Zd<d=�Zd>d?�Z d@dA�Z!dBdC�Z"dDdE�Z#dFdG�Z$dSdHdI�Z%dJdK�Z&d
S)T�HTTPResponsea�
    HTTP Response container.

    Backwards-compatible to httplib's HTTPResponse but the response ``body`` is
    loaded and decoded on-demand when the ``data`` property is accessed.  This
    class is also compatible with the Python standard library's :mod:`io`
    module, and can hence be treated as a readable object in the context of that
    framework.

    Extra parameters for behaviour not present in httplib.HTTPResponse:

    :param preload_content:
        If True, the response's body will be preloaded during construction.

    :param decode_content:
        If True, will attempt to decode the body based on the
        'content-encoding' header.

    :param original_response:
        When this HTTPResponse wrapper is generated from an httplib.HTTPResponse
        object, it's convenient to include the original for debug purposes. It's
        otherwise unused.

    :param retries:
        The retries contains the last :class:`~urllib3.util.retry.Retry` that
        was used during the request.

    :param enforce_content_length:
        Enforce content length checking. Body returned by server must match
        value of Content-Length header, if present. Otherwise, raise error.
    rTZdeflatei-i.i/i3i4�NrTFcCs t|t�r||_n
t|�|_||_||_||_||_||_d|_|
|_	||_
d|_d|_d|_
|	|_d|_||_||_|r�t|ttf�r�||_|
|_||_t|d�r�||_
d|_d|_|jjdd�j�}dd�|jd�D�}d	|kr�d
|_|j|�|_t�|_|�r|j�r|j |d�|_dS)NFr�readztransfer-encodingrkcss|]}|j�VqdS)N)rC)rD�encr r r!rQhsz(HTTPResponse.__init__.<locals>.<genexpr>rG�chunkedT)�decode_content)!r`r�headers�status�version�reason�strictro�_has_decoded_content�retries�enforce_content_length�_decoder�_body�_fp�_original_response�_fp_bytes_read�msg�_request_url�
basestringr<�_pool�_connection�hasattrrn�
chunk_leftri�lowerrJ�_init_length�length_remainingrV�_decoded_bufferrl)r�bodyrprqrrrsrtZpreload_contentro�original_responseZpool�
connectionr}rvrw�request_methodZrequest_urlZtr_encrMr r r!r"?sD


zHTTPResponse.__init__cCs|j|jkr|jjd�SdS)a
        Should we redirect and where to?

        :returns: Truthy redirect location string if we got a redirect status
            code and valid location. ``None`` if redirect status and no
            location. ``False`` if not a redirect status code.
        �locationF)rq�REDIRECT_STATUSESrpri)rr r r!�get_redirect_locationvsz"HTTPResponse.get_redirect_locationcCs,|js|jrdS|jj|j�d|_dS)N)r�r�Z	_put_conn)rr r r!�release_conn�szHTTPResponse.release_conncCs"|jr|jS|jr|jdd�SdS)NT)�
cache_content)ryrzrl)rr r r!r*�szHTTPResponse.datacCs|jS)N)r�)rr r r!r��szHTTPResponse.connectioncCs
t|j�S)N)rrz)rr r r!�isclosed�szHTTPResponse.isclosedcCs|jS)z�
        Obtain the number of bytes pulled over the wire so far. May differ from
        the amount of content returned by :meth:``HTTPResponse.read`` if bytes
        are encoded on the wire (e.g, compressed).
        )r|)rr r r!�tell�szHTTPResponse.tellcCs�|jjd�}|dk	r�|jr(tjd�dSy<tdd�|jd�D��}t|�dkrZtd|��|j	�}Wnt
k
r|d}YnX|d	kr�d}yt|j�}Wnt
k
r�d	}YnX|dks�d|ko�d
kns�|dkr�d	}|S)zM
        Set initial length value for Response content if available.
        zcontent-lengthNz�Received response with both Content-Length and Transfer-Encoding set. This is expressly forbidden by RFC 7230 sec 3.3.2. Ignoring Content-Length and attempting to process response as Transfer-Encoding: chunked.cSsg|]}t|��qSr )�int)rD�valr r r!rF�sz-HTTPResponse._init_length.<locals>.<listcomp>rGrz8Content-Length contained multiple unmatching values (%s)r���0�d��ZHEAD)r�r�)
rprirn�logZwarning�setrJr?r�popr_r�rq)rr�ZlengthZlengthsrqr r r!r��s,


(zHTTPResponse._init_lengthcsh�jjdd�j�}�jdkrd|�jkr2t|��_n2d|krd�fdd�|jd�D�}t|�rdt|��_dS)z=
        Set-up the _decoder attribute if necessary.
        zcontent-encodingrkNrGcs"g|]}|j��jkr|j��qSr )rC�CONTENT_DECODERS)rDrI)rr r!rF�sz.HTTPResponse._init_decoder.<locals>.<listcomp>)rprir�rxr�rHrJr?)r�content_encodingrMr )rr!�
_init_decoder�s

zHTTPResponse._init_decodercCs�|r|jrtd��|dks |r$d	}y$|rF|jrF|jj||d�}d|_WnHttjfk
r�}z&|jjdd�j	�}t
d||��WYdd}~XnX|r�|r�||j�7}|S)
zN
        Decode the data passed in and potentially flush the decoder.
        z_Calling read(decode_content=False) is not supported after read(decode_content=True) was called.Nr)r&Tzcontent-encodingrkzEReceived response with content-encoding: %s, but failed to decode it.r-)rur^rxr(�IOErrorrrrprir�r
�_flush_decoder)rr*ro�
flush_decoderr&rIr�r r r!�_decode�s"

zHTTPResponse._decodecCs$|jr |jjd�}||jj�SdS)zk
        Flushes the decoder. Should only be called if the decoder is actually
        being used.
        r)rxr(rN)rZbufr r r!r��szHTTPResponse._flush_decoderccs�d}z�y
dVWn�tk
r2t|jdd��Ynptk
rn}z"dt|�krP�t|jdd��WYdd}~Xn4ttfk
r�}ztd||��WYdd}~XnXd}Wd|s�|jr�|jj	�|j
r�|j
j	�|jr�|jj�r�|j�XdS)z�
        Catch low-level python exceptions, instead re-raising urllib3
        variants, so that low-level exceptions are not leaked in the
        high-level api.

        On exit, release the connection back to the pool.
        FNzRead timed out.zread operation timed outzConnection broken: %rT)
�
SocketTimeoutrr�r�strr�SocketErrorr	r{�closer�r�r�)rZ
clean_exitrIr r r!�_error_catchers(	
 

zHTTPResponse._error_catchercCs�|jdkrdSt|jdd�}|j��~|dkrB|s<|jj�nd}n|sR|jj|�nd}|dk	r�|dkr�|r�|jj�|jr�|jdk	r�|jdkr�t|j|j��WdQRX|r�|jt	|�7_|jdk	r�|jt	|�8_|S)z7
        Reads `amt` of bytes from the socket.
        N�closedFrr)
rzr#r�rlr�rwr�r
r|r?)r�amtZ	fp_closedr*r r r!�	_raw_readAs$

	



zHTTPResponse._raw_readcCs�|j�|dkr|j}|dk	rrd}|jrX|jjrX|jd|d|t|j�d�}|jj|�t|j�|krr|jj|�S|j	|�}d}|dkr�d}n|dkr�|r�d}|r�t|j�dkr�|jo�|jjr�|S|dkr�|j|||�}|r�||_
n�|�s|j�rtd��|S|j||||t|j�d�}|jj|�xNt|j�|k�rz|�rz|j	|�}|j||||t|j�d�}|jj|��q.W|jj|�}|S)	aP
        Similar to :meth:`httplib.HTTPResponse.read`, but with two additional
        parameters: ``decode_content`` and ``cache_content``.

        :param amt:
            How much of the content to read. If specified, caching is skipped
            because it doesn't make sense to cache partial content as the full
            response.

        :param decode_content:
            If True, will attempt to decode the body based on the
            'content-encoding' header.

        :param cache_content:
            If True, will save the returned data such that the same result is
            returned despite of the state of the underlying file object. This
            is useful if you want the ``.data`` property to continue working
            after having ``.read()`` the file object. (Overridden if ``amt`` is
            set.)
        NFr)r�r&Trz_Calling read(decode_content=False) is not supported after read(decode_content=True) was called.)r&)
r�rorxr,r�r?r�r]rir�ryrur^)rr�ror�Zdecoded_datar*r�r r r!rllsb

zHTTPResponse.readr3r8ccsx|jr.|j�r.xd|j||d�D]
}|VqWnFxDt|j�sXt|j�dksX|jrr|jjrr|j	||d�}|r0|Vq0WdS)a_
        A generator wrapper for the read() method. A call will block until
        ``amt`` bytes have been read from the connection or until the
        connection is closed.

        :param amt:
            How much of the content to read. The generator will return up to
            much data per iteration, but may return less. This is particularly
            likely when using compressed data. However, the empty string will
            never be returned.

        :param decode_content:
            If True, will attempt to decode the body based on the
            'content-encoding' header.
        )ror)r�roN)
rn�supports_chunked_reads�read_chunkedrrzr?r�rxr,rl)rr�ro�liner*r r r!�stream�szHTTPResponse.streamc
Ks`|j}t|t�s,tr"t|j��}n
tj|�}t|dd�}|f|||j|j|j	||d�|��}|S)a
        Given an :class:`httplib.HTTPResponse` instance ``r``, return a
        corresponding :class:`urllib3.response.HTTPResponse` object.

        Remaining parameters are passed to the HTTPResponse constructor, along
        with ``original_response=r``.
        rtr)r�rprqrrrsrtr�)
r}r`rr�items�from_httplibr#rqrrrs)ZResponseCls�rZresponse_kwrprtZrespr r r!r��s	

zHTTPResponse.from_httplibcCs|jS)N)rp)rr r r!�
getheadersszHTTPResponse.getheaderscCs|jj||�S)N)rpri)rr$�defaultr r r!�	getheaderszHTTPResponse.getheadercCs|jS)N)rp)rr r r!�infoszHTTPResponse.infocCs$|js|jj�|jr |jj�dS)N)r�rzr�r�)rr r r!r�s
zHTTPResponse.closecCs@|jdkrdSt|jd�r$|jj�St|jd�r8|jjSdSdS)NTr�r�)rzr�r�r�)rr r r!r�s

zHTTPResponse.closedcCs6|jdkrtd��nt|jd�r*|jj�Std��dS)Nz-HTTPResponse has no file to get a fileno from�filenozOThe file-like object this HTTPResponse is wrapped around has no file descriptor)rzr�r�r�)rr r r!r�!s



zHTTPResponse.filenocCs$|jdk	r t|jd�r |jj�SdS)NrN)rzr�rN)rr r r!rN*szHTTPResponse.flushcCsdS)NTr )rr r r!�readable.szHTTPResponse.readablecCs:|jt|��}t|�dkrdS||dt|��<t|�SdS)Nr)rlr?)r�bZtempr r r!�readinto2s
zHTTPResponse.readintocCst|jd�S)z�
        Checks if the underlying file-like object looks like a
        httplib.HTTPResponse object. We do this by testing for the fp
        attribute. If it is present we assume it returns raw chunks as
        processed by read_chunked().
        �fp)r�rz)rr r r!r�;sz#HTTPResponse.supports_chunked_readscCsf|jdk	rdS|jjj�}|jdd�d}yt|d�|_Wn&tk
r`|j�tj	|��YnXdS)N�;rrr8)
r�rzr��readlinerJr�r_r��httplibr
)rr�r r r!�_update_chunk_lengthDs
z!HTTPResponse._update_chunk_lengthcCs�d}|dkr2|jj|j�}|}|jjd�d|_nv||jkrZ|jj|�}|j||_|}nN||jkr�|jj|�}|jjd�d|_|}n |jj|j�}|jjd�d|_|S)Nr3)rzZ
_safe_readr�)rr�Zreturned_chunkrh�valuer r r!�
_handle_chunkRs&

zHTTPResponse._handle_chunkc
cs�|j�|jstd��|j�s&td��|j���|jrNt|j�rN|jj�dS|j	j
dkr^dSx>|j�|jdkrtP|j
|�}|j||d|d�}|r`|Vq`W|r�|j�}|r�|Vx |j	j
j�}|s�P|dkr�Pq�W|jr�|jj�WdQRXdS)a�
        Similar to :meth:`HTTPResponse.read`, but with an additional
        parameter: ``decode_content``.

        :param amt:
            How much of the content to read. If specified, caching is skipped
            because it doesn't make sense to cache partial content as the full
            response.

        :param decode_content:
            If True, will attempt to decode the body based on the
            'content-encoding' header.
        zHResponse is not chunked. Header 'transfer-encoding: chunked' is missing.zgBody should be httplib.HTTPResponse like. It should have have an fp attribute which returns raw chunks.NrF)ror�r&s
)r�rnrr�rr�r{rr�rzr�r�r�r�r�r�r�)rr�rorhZdecodedr�r r r!r�hsD





zHTTPResponse.read_chunkedcCs.|jdk	r$t|jj�r$|jjdjS|jSdS)z�
        Returns the URL that was the source of this response.
        If the request that generated this response redirected, this method
        will return the final redirect location.
        Nrr-)rvr?�historyZredirect_locationr~)rr r r!�geturl�szHTTPResponse.geturl)rkNrrNrTTNNNNNFNN)N)N)NNF�)r�N)N)NN)'r.r/r0rSr�r�r"r�r�r1r*r�r�r�r�r�r�r�rr�r�rlr��classmethodr�r�r�r�r�r�r�rNr�r�r�r�r�r�r�r r r r!rjsJ
3
	0
9
+
\

			
Crj)3Z
__future__r�
contextlibrrWrrbZlogging�sys�warningsZsocketrr�rr��_collectionsr�
exceptionsrr	r
rrr
rrZpackages.sixrrrZpackages.six.movesrr�r�rrZ
util.responserrZ	getLoggerr.r��objectrr2r7rArHrV�IOBaserjr r r r!�<module>s.(
<A8
<