Directory:~$ /proc/self/root/usr/lib/python2.7/site-packages/requests_toolbelt/threaded/

Upload File

[Home] [System Details] [Kill Me]

�
ӵ Yc@s�dZd
dl
Z
d
dlZddlmZ
ddlmZ
def
d��YZd	ef
d
��YZ	de	f
d��YZ
d
e	f
d��YZd�Zd
ddgZ
dS(sEModule implementing the Pool for
:mod:``requests_toolbelt.threaded``.i����Ni
(
tthreadi(
tqueuetPoolcBs}eZ
dZd
d
d
ejd
�Zd�Zed��
Z	ed
d�
�
Z
d�Zd�Zd�Z
d�Zd	�ZRS(s>Pool that manages the threads
containing sessions.

    :param queue:
        The queue you're expected to use to which you should add
items.
    :type queue: queue.Queue
    :param initializer:
        Function used to initialize an instance of ``session``.
    :type initializer: collections.Callable
    :param auth_generator:
        Function used to generate new auth credentials for the session.
    :type auth_generator: collections.Callable
    :param int num_threads:
        Number of threads to create.
    :param session:
    :type session: requests.Session
    c
Cs�|dkr!t
j�pd
}n|d
kr<td�
�
n|
|_tj�|_tj�|_||_	|put
|_|p�t
|_||_
gt|j	�
D]-}tj|j�|j|j|j�^q�|_dS(Ni
s)Number of
processes should at least be 1.(tNonetmultiprocessingt	cpu_countt
ValueErrort
_job_queueR
tQueuet_response_queuet
_exc_queuet
_processest	_identityt_initializert_autht_sessiontrangeRt
SessionThreadt_new_sessiont_pool(tselft	job_queuetinitializertauth_generatort
num_processestsessiont
_((sC/usr/lib/python2.7/site-packages/requests_toolbelt/threaded/pool.pyt__init__s

	


	


	c

Cs|j|j
|j��
�
S(
N(RR
R(
R((sC/usr/lib/python2.7/site-packages/requests_toolbelt/threaded/pool.pyR0s
cKs=tj
�}x|
D]}|j|j�

qW|d
||�
S(s2Create
a :class:`~Pool` from an :class:`~ThreadException`\ s.

        Provided an iterable that provides :class:`~ThreadException`
objects,
        this classmethod will generate a new pool to retry the requests
that
        caused the exceptions.

        :param exceptions:
            Iterable that returns :class:`~ThreadException`
        :type exceptions: iterable
        :param kwargs:
            Keyword arguments passed to the :class:`~Pool` initializer.
        :returns: An initialized :class:`~Pool` object.
        :rtype: :class:`~Pool`
        R(R
Rtputtrequest_kwargs(tclst
exceptionstkwargsRtexc((sC/usr/lib/python2.7/site-packages/requests_toolbelt/threaded/pool.pytfrom_exceptions3s


cKszi
d
d6}|j|pi�

t
j�}x;|
D]3}|j�}|ji
|d6�

|j|�

q3W|d||�
S(s�
Create
a :class:`~Pool` from an iterable of URLs.

        :param urls:
            Iterable that returns URLs with which we create a pool.
        :type urls: iterable
        :param dict request_kwargs:
            Dictionary of other keyword arguments to provide to the request
            method.
        :param kwargs:
            Keyword arguments passed to the :class:`~Pool` initializer.
        :returns: An initialized :class:`~Pool` object.
        :rtype: :class:`~Pool`
        tGETtmethodturlR(tupdateR
RtcopyR(RturlsRR
trequest_dictRR%tjob((sC/usr/lib/python2.7/site-packages/requests_toolbelt/threaded/pool.pyt	from_urlsIs







c
cs2x+tr-|j
�}
|
d
kr%Pn|
V
qWd
S(soIterate
over all the exceptions in the pool.

        :returns: Generator of :class:`~ThreadException`
       
N(tTruet
get_exceptionR(RR!((sC/usr/lib/python2.7/site-packages/requests_toolbelt/threaded/pool.pyRbs
	



c
CsBy|jj
�\}
}Wntjk
r0


d
SXt|
|�Sd
S(sSGet an exception from the pool.

        :rtype: :class:`~ThreadException`
        N(R
t
get_nowaitR
tEmptyRtThreadException(RtrequestR!((sC/usr/lib/python2.7/site-packages/requests_toolbelt/threaded/pool.pyR-ms



c
CsBy|jj
�\}
}Wntjk
r0


d
SXt|
|�Sd
S(sPGet a response from the pool.

        :rtype: :class:`~ThreadResponse`
       
N(R	R.R
R/RtThreadResponse(RR1tresponse((sC/usr/lib/python2.7/site-packages/requests_toolbelt/threaded/pool.pytget_responseys



c
cs2x+tr-|j
�}
|
d
kr%Pn|
V
qWd
S(smIterate over all the
responses in the pool.

        :returns: Generator of :class:`~ThreadResponse`
       
N(R,R4R(Rtresp((sC/usr/lib/python2.7/site-packages/requests_toolbelt/threaded/pool.pyt	responses�s
	



c
Cs"x|jD]}
|
j
�
q
Wd
S(s*Join all the threads to the master
thread.N(Rtjoin(Rtsession_thread((sC/usr/lib/python2.7/site-packages/requests_toolbelt/threaded/pool.pytjoin_all�s
N(t__name__t
__module__t__doc__RtrequeststSessionRRtclassmethodR"R+RR-R4R6R9(((sC/usr/lib/python2.7/site-packages/requests_toolbelt/threaded/pool.pyR	s
	
				tThreadProxyc
BseZ
d
Zd�ZRS(cCsHtj
}|
|jkr7|||j�}t||
�S|||
�Sd
S(s/Proxy
attribute accesses to the proxied
object.N(tobjectt__getattribute__tattrstproxied_attrtgetattr(RtattrtgetR3((sC/usr/lib/python2.7/site-packages/requests_toolbelt/threaded/pool.pyt__getattr__�s
	



N(R:R;RRDRH(((sC/usr/lib/python2.7/site-packages/requests_toolbelt/threaded/pool.pyR@�s
R2cBs/eZ
dZd
Zedd
g�
Zd�ZRS(s>
A
wrapper around a requests Response object.

    This will proxy most attribute access actions to the Response object.
For
    example, if you wanted the parsed JSON from the response, you might do:

    .. code-block:: python

        thread_response = pool.get_response()
        json = thread_response.json()

   
R3RcCs|
|_||_
dS(
N(RR3(RRR3((sC/usr/lib/python2.7/site-packages/requests_toolbelt/threaded/pool.pyR�s	(R:R;R<RDt	frozensetRCR(((sC/usr/lib/python2.7/site-packages/requests_toolbelt/threaded/pool.pyR2�s

R0cBs/eZ
dZd
Zedd
g�
Zd�ZRS(s=
A
wrapper around an exception raised during a request.

    This will proxy most attribute access actions to the exception object.
For
    example, if you wanted the message from the exception, you might do:

    .. code-block:: python

        thread_exc = pool.get_exception()
        msg = thread_exc.message

   
t	exceptionRcCs|
|_||_
dS(
N(RRJ(RRRJ((sC/usr/lib/python2.7/site-packages/requests_toolbelt/threaded/pool.pyR�s	(R:R;R<RDRIRCR(((sC/usr/lib/python2.7/site-packages/requests_toolbelt/threaded/pool.pyR0�s

c


Cs|S(
N((
tsession_obj((sC/usr/lib/python2.7/site-packages/requests_toolbelt/threaded/pool.pyR�s
(R<RR=tRt_compatR
RARR@R2R0Rt__all__(((sC/usr/lib/python2.7/site-packages/requests_toolbelt/threaded/pool.pyt<module>
s


�