← Back
Editing: managers.cpython-39.opt-1.pyc
a XC?hǸ � @ sL g d �Z ddlZddlZddlZddlZddlZddlZddlZddlZddlm Z ddl m Z ddl m Z ddlmZmZmZ ddl mZ dd l mZ dd l mZ dd l mZ zdd l mZ W n ey� d ZY n0 dZe �d� dd� Ze�eje� dd� dD �Z e d e u�r8dd� Z e D ]Z e�e e � �q$G dd� de �Z!di fdd�Z"d d � Z#G d d � d e$�Z%d d!� Z&d"d#� Z'G d$d%� d%e �Z(G d&d'� d'e �Z)e j*e j+fe j,e j-fd(�Z.G d)d*� d*e �Z/G d+d,� d,e0�Z1G d-d.� d.e �Z2d/d0� Z3i fd1d2�Z4dmd3d4�Z5G d5d6� d6e �Z6G d7d8� d8e �Z7dnd9d:�Z8G d;d<� d<e2�Z9G d=d>� d>e2�Z:G d?d@� d@e:�Z;G dAdB� dBe2�Z<G dCdD� dDe2�Z=G dEdF� dFe2�Z>G dGdH� dHe2�Z?e4dIdJ�Z@G dKdL� dLe@�ZAe4dMdN�ZBdOdPieB_Ce4dQdR�ZDe4dSdT�ZEdUdUdUdPdPdV�eE_CG dWdS� dSeE�ZFG dXdY� dYe/�ZGeG�dZejH� eG�d[ejH� eG�d\ejIe<� eG�d]ejJe:� eG�d^ejKe:� eG�d_ejLe:� eG�d`ejMe:� eG�daejNe;� eG�dbejOe=� eG�dcejPeF� eG�dde eA� eG�deeQeB� eG�d8e7e?� eG�d:e8eD� eG�d6e6e>� eGjdPe9d df� eGjdUd dg� e�rHG dhdi� di�ZRG djdk� dke(�ZSG dld� de/�ZTdS )o)� BaseManager� SyncManager� BaseProxy�Token� N)�getpid)� format_exc� )� connection)� reduction�get_spawning_popen� ProcessError)�pool)�process)�util)� get_context)� shared_memoryFT�SharedMemoryManagerc C s t j | j| �� ffS �N)�array�typecode�tobytes)�a� r �=/opt/alt/python39/lib64/python3.9/multiprocessing/managers.py� reduce_array/ s r c C s g | ]}t ti |�� ��qS r )�type�getattr��.0�namer r r � <listcomp>3 � r )�items�keys�valuesc C s t t | �ffS r )�list��objr r r �rebuild_as_list5 s r( c @ s4 e Zd ZdZdZdd� Zdd� Zdd� Zd d � Zd S ) r z3 Type to uniquely identify a shared object ��typeid�address�idc C s ||| | _ | _| _d S r r) )�selfr* r+ r, r r r �__init__D s zToken.__init__c C s | j | j| jfS r r) �r- r r r � __getstate__G s zToken.__getstate__c C s |\| _ | _| _d S r r) �r- �stater r r � __setstate__J s zToken.__setstate__c C s d| j j| j| j| jf S )Nz %s(typeid=%r, address=%r, id=%r))� __class__�__name__r* r+ r, r/ r r r �__repr__M s �zToken.__repr__N) r5 � __module__� __qualname__�__doc__� __slots__r. r0 r3 r6 r r r r r > s r r c C s8 | � ||||f� | �� \}}|dkr*|S t||��dS )zL Send a message to manager using connection `c` and return response �#RETURNN)�send�recv�convert_to_error)�cr, � methodname�args�kwds�kind�resultr r r �dispatchU s rE c C sd | dkr |S | dv rRt |t�s4td�|| t|����| dkrHtd| �S t|�S ntd�| ��S d S )N�#ERROR)� #TRACEBACK�#UNSERIALIZABLEz.Result {0!r} (kind '{1}') type is {2}, not strrH zUnserializable message: %s z Unrecognized message type {!r})� isinstance�str� TypeError�formatr � RemoteError� ValueError)rC rD r r r r> _ s �� r> c @ s e Zd Zdd� ZdS )rM c C s dt | jd � d S )NzM --------------------------------------------------------------------------- r zK---------------------------------------------------------------------------)rJ rA r/ r r r �__str__o s zRemoteError.__str__N)r5 r7 r8 rO r r r r rM n s rM c C s2 g }t | �D ] }t| |�}t|�r |�|� q |S )z4 Return a list of names of methods of `obj` )�dirr �callable�append)r' �tempr �funcr r r � all_methodsv s rU c C s dd� t | �D �S )zP Return a list of names of methods of `obj` which do not start with '_' c S s g | ]}|d dkr|�qS )r �_r r r r r r � r! z"public_methods.<locals>.<listcomp>)rU r& r r r �public_methods� s rW c @ s� e Zd ZdZg d�Zdd� Zdd� Zdd� Zd d � Zd d � Z d d� Z dd� Z dd� Z e e e d�Z dd� Zdd� Zdd� Zdd� Zd d � Zd d � Zd d!� Zd"d#� Zd$d%� Zd&S )'�ServerzM Server class which runs in a process controlled by a manager object ) �shutdown�create�accept_connection� get_methods� debug_info�number_of_objects�dummy�incref�decrefc C sx t |t�s td�|t|����|| _t�|�| _t | \}}||dd�| _ | j j | _ ddi| _ i | _ i | _t�� | _d S )Nz&Authkey {0!r} is type {1!s}, not bytes� )r+ Zbacklog�0�Nr )rI �bytesrK rL r �registryr �AuthenticationString�authkey�listener_client�listenerr+ � id_to_obj�id_to_refcount�id_to_local_proxy_obj� threading�Lock�mutex)r- rf r+ rh � serializer�Listener�Clientr r r r. � s �� zServer.__init__c C s� t �� | _| t�� _z�t j| jd�}d|_|� � z | j� � sL| j� d� q4W n t t fyd Y n0 W tjtjkr�t�d� tjt_tjt_t�d� n2tjtjkr�t�d� tjt_tjt_t�d� 0 dS )z( Run the server forever )�targetTr zresetting stdout, stderrr N)rn �Event� stop_eventr �current_process�_manager_server�Thread�accepter�daemon�start�is_set�wait�KeyboardInterrupt� SystemExit�sys�stdout� __stdout__r �debug� __stderr__�stderr�exit)r- rz r r r � serve_forever� s* � zServer.serve_foreverc C sL z| j �� }W n ty$ Y q Y n0 tj| j|fd�}d|_|�� q d S )N�rt rA T)rj Zaccept�OSErrorrn ry �handle_requestr{ r| )r- r? �tr r r rz � s zServer.accepterc C s6 d } }}z>t �|| j� t �|| j� |�� }|\}}}}t| |�}W n tyf dt� f} Y nB0 z||g|�R i |��}W n ty� dt� f} Y n 0 d|f} z|�| � W nr t�y( } zXz|�dt� f� W n ty� Y n0 t � d| � t � d|� t � d| � W Y d} ~ n d} ~ 0 0 |� � dS )z) Handle a new connection NrG r; zFailure to send message: %rz ... request was %r� ... exception was %r) r Zdeliver_challengerh Zanswer_challenger= r � Exceptionr r< r �info�close) r- r? �funcnamerD �request�ignorerA rB rT �msg�er r r r� � s2 "zServer.handle_requestc C s� t �dt�� j� |j}|j}| j}| j� � �sΐz:d }}|� }|\}}} } z|| \}} } W nP t y� } z8z| j | \}} } W n t y� | �Y n0 W Y d} ~ n d} ~ 0 0 || vr�t d|t |�| f ��t||�}z|| i | ��}W n. t�y } zd|f}W Y d}~nXd}~0 0 | �o,| �|d�}|�rb| �|||�\}}t|| j|�}d||ff}nd|f}W n� t �y� |du �r�dt� f}nRz2| j| }|| |||g| �R i | ��}d|f}W n t�y� dt� f}Y n0 Y nL t�y t �dt�� j� t�d � Y n t�y2 dt� f}Y n0 z4z ||� W n" t�yd |d t� f� Y n0 W q$ t�y� } zHt �d t�� j� t �d |� t �d |� |�� t�d� W Y d}~q$d}~0 0 q$dS )zQ Handle requests from the proxies in a particular process/thread z$starting server thread to service %rNz+method %r of %r object is not in exposed=%rrF �#PROXYr; rG z$got EOF -- exiting thread serving %rr rH z exception in thread serving %rz ... message was %rr� r )r r� rn �current_threadr r= r< rk rv r} �KeyErrorrm �AttributeErrorr r r� �getrZ r r+ r �fallback_mapping�EOFErrorr� r� r� r� )r- �connr= r< rk r@ r' r� �identrA rB �exposed� gettypeid�keZfunction�resr� r� r* ZridentZrexposed�tokenZ fallback_funcrD r r r � serve_client� s� � � �� ��� � � zServer.serve_clientc C s |S r r �r- r� r� r' r r r �fallback_getvalue7 s zServer.fallback_getvaluec C s t |�S r �rJ r� r r r � fallback_str: s zServer.fallback_strc C s t |�S r )�reprr� r r r � fallback_repr= s zServer.fallback_repr)rO r6 � #GETVALUEc C s d S r r �r- r? r r r r_ F s z Server.dummyc C s� | j �v g }t| j�� �}|�� |D ]<}|dkr&|�d|| j| t| j| d �dd� f � q&d�|�W d � S 1 s�0 Y dS )zO Return some info --- useful to spot problems with refcounting rc z %s: refcount=%s %sr N�K � ) rp r% rl r# �sortrR rJ rk �join)r- r? rD r# r� r r r r] I s ��zServer.debug_infoc C s t | j�S )z* Number of shared objects )�lenrl r� r r r r^ Y s zServer.number_of_objectsc C sV zDzt �d� |�d� W n ddl}|�� Y n0 W | j�� n | j�� 0 dS )z' Shutdown this process z!manager received shutdown message�r; Nr N)r r� r< � traceback� print_excrv �set)r- r? r� r r r rY ` s zServer.shutdownc O s | j �� | j| \}}}}|du rD|s2t|�dkr:td��|d } n||i |��} |du rbt| �}|dur�t|t�s�td�|t |����t |�t |� }dt | � } t � d|| � | t|�|f| j| < | | jvr�d| j| < W d � n1 s�0 Y | �|| � | t|�fS )z> Create a new shared object and return its id Nr z4Without callable, must have one non-keyword argumentr z,Method_to_typeid {0!r}: type {1!s}, not dictz%xz&%r callable returned object with id %r)rp rf r� rN rW rI �dictrK rL r r% r, r r� r� rk rl r` �tuple) r- r? r* rA rB rQ r� �method_to_typeid� proxytyper' r� r r r rZ m s6 � � �� ( z Server.createc C s t | j|j d �S )zL Return the methods of the shared object indicated by token r )r� rk r, )r- r? r� r r r r\ � s zServer.get_methodsc C s" |t �� _|�d� | �|� dS )z= Spawn a new thread to serve this connection r� N)rn r� r r< r� )r- r? r r r r r[ � s zServer.accept_connectionc C s� | j �� z| j| d7 < W nj ty� } zR|| jv rpd| j|< | j| | j|< | j| \}}}t�d|� n|�W Y d }~n d }~0 0 W d � n1 s�0 Y d S )Nr z&Server re-enabled tracking & INCREF %r)rp rl r� rm rk r r� )r- r? r� r� r' r� r� r r r r` � s �z Server.increfc C s� || j vr$|| jv r$t�d|� d S | j�d | j | dkrXtd�|| j| | j | ���| j | d8 < | j | dkr�| j |= W d � n1 s�0 Y || j vr�d| j|< t�d|� | j� | j|= W d � n1 s�0 Y d S )NzServer DECREF skipping %rr z+Id {0!s} ({1!r}) has refcount {2:n}, not 1+r )Nr Nzdisposing of obj with id %r)rl rm r r� rp �AssertionErrorrL rk )r- r? r� r r r ra � s* � ��& z Server.decrefN)r5 r7 r8 r9 �publicr. r� rz r� r� r� r� r� r� r_ r] r^ rY rZ r\ r[ r` ra r r r r rX � s. "Q� $rX c @ s e Zd ZdgZdZdZdZdS )�State�valuer r � N)r5 r7 r8 r: �INITIAL�STARTED�SHUTDOWNr r r r r� � s r� )�pickleZ xmlrpclibc @ s� e Zd ZdZi ZeZd"dd�Zdd� Zdd � Z d#d d �Z e d$d d��Z dd� Z d%dd�Zdd� Zdd� Zdd� Zdd� Zedd � �Zed d � �Ze d&d d!��ZdS )'r z! Base class for managers Nr� c C s\ |d u rt �� j}|| _t �|�| _t� | _tj| j_ || _ t | \| _ | _ |pTt� | _d S r )r rw rh �_addressrg �_authkeyr� �_stater� r� � _serializerri Z _Listener�_Clientr �_ctx)r- r+ rh rq �ctxr r r r. � s zBaseManager.__init__c C sf | j jtjkrP| j jtjkr&td��n*| j jtjkr>td��ntd�| j j���t| j | j | j | j �S )zX Return server object with serve_forever() method and address attribute �Already started server�Manager has shut down�Unknown state {!r}) r� r� r� r� r� r r� rL rX � _registryr� r� r� r/ r r r � get_server� s � �zBaseManager.get_serverc C s8 t | j \}}|| j| jd�}t|dd� tj| j_dS )z> Connect manager object to the server process �rh Nr_ ) ri r� r� r� rE r� r� r� r� )r- rr rs r� r r r �connect s zBaseManager.connectr c C s4 | j jtjkrP| j jtjkr&td��n*| j jtjkr>td��ntd�| j j���|durht|�sht d��t j dd�\}}| j j t| �j| j| j| j| j|||fd�| _d �d d � | jjD ��}t| �jd | | j_| j�� |�� |�� | _|�� tj| j _t j | t| �j | j| j| j| j | j fd d�| _ dS )z@ Spawn a server process for this manager object r� r� r� Nz initializer must be a callableF)Zduplexr� �:c s s | ]}t |�V qd S r r� )r �ir r r � <genexpr>( r! z$BaseManager.start.<locals>.<genexpr>�-r �rA Z exitpriority)!r� r� r� r� r� r r� rL rQ rK r ZPiper� ZProcessr � _run_serverr� r� r� r� �_processr� Z _identityr5 r r| r� r= r �Finalize�_finalize_managerr� rY )r- � initializer�initargs�reader�writerr� r r r r| s> � �� ��zBaseManager.startc C s^ t � t jt j� |dur ||� | �||||�}|�|j� |�� t�d|j� |� � dS )z@ Create a server, report its address and run it Nzmanager serving at %r) �signal�SIGINT�SIG_IGN�_Serverr< r+ r� r r� r� ) �clsrf r+ rh rq r� r� r� �serverr r r r� : s zBaseManager._run_serverc O sV | j | j| jd�}z&t|dd|f| |�\}}W |�� n |�� 0 t|| j|�|fS )zP Create a new shared object; return the token and exposed tuple r� NrZ )r� r� r� rE r� r )r- r* rA rB r� r, r� r r r �_createQ s zBaseManager._createc C s* | j dur&| j �|� | j �� s&d| _ dS )zC Join the manager process (if it has been spawned) N)r� r� �is_alive�r- �timeoutr r r r� ] s zBaseManager.joinc C s8 | j | j| jd�}zt|dd�W |�� S |�� 0 dS )zS Return some info about the servers shared objects and connections r� Nr] �r� r� r� rE r� �r- r� r r r � _debug_infof s �zBaseManager._debug_infoc C s8 | j | j| jd�}zt|dd�W |�� S |�� 0 dS )z5 Return the number of shared objects r� Nr^ r� r� r r r �_number_of_objectsp s �z BaseManager._number_of_objectsc C sj | j jtjkr| �� | j jtjkrf| j jtjkr<td��n*| j jtjkrTtd��ntd�| j j���| S )NzUnable to start serverr� r� ) r� r� r� r� r| r� r r� rL r/ r r r � __enter__z s �zBaseManager.__enter__c C s | � � d S r )rY �r- �exc_typeZexc_valZexc_tbr r r �__exit__� s zBaseManager.__exit__c C s� | � � r�t�d� z4|||d�}zt|dd� W |�� n |�� 0 W n tyX Y n0 | jdd� | � � r�t�d� t| d�r�t�d � | �� | jdd� | � � r�t�d � t j |_ z t j |= W n ty� Y n0 dS ) zQ Shutdown the manager process; will be registered as a finalizer z#sending shutdown message to managerr� NrY g �?)r� zmanager still alive� terminatez'trying to `terminate()` manager processz#manager still alive after terminate)r� r r� rE r� r� r� �hasattrr� r� r� r� r �_address_to_localr� )r r+ rh r2 r� r� r r r r� � s. z BaseManager._finalize_managerc C s | j S r )r� r/ r r r r+ � s zBaseManager.addressTc s� d| j vr| j�� | _� du r"t� |p0t� dd�}|p@t� dd�}|r\t|�� �D ]\}}qR|||� f| j�< |r�� �fdd�} �| _t| �| � dS )z9 Register a typeid with the manager type r� N� _exposed_�_method_to_typeid_c sf t �d�� | j�g|�R i |��\}}� || j| | j|d�}| j|j| jd�}t|d d|jf� |S )Nz)requesting creation of a shared %r object��managerrh r� r� ra ) r r� r� r� r� r� r+ rE r, )r- rA rB r� Zexp�proxyr� �r� r* r r rS � s �z"BaseManager.register.<locals>.temp) �__dict__r� �copy� AutoProxyr r% r" r5 �setattr) r� r* rQ r� r� r� � create_method�keyr� rS r r� r �register� s" �� zBaseManager.register)NNr� N)Nr )Nr )N)NNNNT)r5 r7 r8 r9 r� rX r� r. r� r� r| � classmethodr� r� r� r� r� r� r� � staticmethodr� �propertyr+ r� r r r r r � s4 � + � �r c @ s e Zd Zdd� Zdd� ZdS )�ProcessLocalSetc C s t �| dd� � d S )Nc S s | � � S r )�clearr& r r r �<lambda>� r! z*ProcessLocalSet.__init__.<locals>.<lambda>)r �register_after_forkr/ r r r r. � s zProcessLocalSet.__init__c C s t | �dfS rd )r r/ r r r � __reduce__� s zProcessLocalSet.__reduce__N)r5 r7 r8 r. r r r r r r � s r c @ s� e Zd ZdZi Ze�� Zd dd�Zdd� Z d i fd d �Z d d � Z dd� Z e dd� �Zdd� Zdd� Zdd� Zdd� Zdd� ZdS ) r z. A base for proxies of shared objects NTFc C s� t j�B t j�|jd �}|d u r:t�� t� f}|t j|j< W d � n1 sN0 Y |d | _|d | _ || _ | j j | _ || _ || _t| d | _|| _|d ur�t�|�| _n"| j d ur�| j j| _n t�� j| _|r�| �� t�| t j� d S )Nr r )r �_mutexr� r� r+ r ZForkAwareLocalr �_tls�_idset�_tokenr, �_id�_managerr� ri r� �_owned_by_managerr rg r� rw rh �_increfr � _after_fork) r- r� rq r� rh r� r` � manager_ownedZ tls_idsetr r r r. � s* * zBaseProxy.__init__c C sd t �d� t�� j}t�� jdkr4|dt�� j 7 }| j| jj | j d�}t |d d|f� || j _ d S )Nz making connection to managerZ MainThread�|r� r[ )r r� r rw r rn r� r� r r+ r� rE r r )r- r r� r r r �_connect s zBaseProxy._connectr c C s� z | j j}W n4 ty@ t�dt�� j� | �� | j j}Y n0 |� | j |||f� |� � \}}|dkrn|S |dkr�|\}}| j j |j d } | jj|_| || j| j | j|d�} | j|j| jd�}t|dd|jf� | S t||��dS ) zV Try to call a method of the referent and return a copy of the result z#thread %r does not own a connectionr; r� ���r� r� Nra )r r r� r r� rn r� r r r< r r= r r� r* r r+ r� r� r� rE r, r> ) r- r@ rA rB r� rC rD r� r� r� r� r r r � _callmethod s0 � �zBaseProxy._callmethodc C s | � d�S )z9 Get a copy of the value of the referent r� �r r/ r r r � _getvalue; s zBaseProxy._getvaluec C s� | j rt�d| jj� d S | j| jj| jd�}t|d d| j f� t�d| jj� | j � | j � | j oj| j j }tj| tj| j| j|| j| j | jfdd�| _d S )Nz%owned_by_manager skipped INCREF of %rr� r` z INCREF %r� r� )r r r� r r, r� r+ r� rE r r �addr r� r� r �_decrefr Z_close)r- r� r2 r r r r A s ��zBaseProxy._increfc C s� |� | j� |d u s |jtjkr�z2t�d| j� || j|d�}t|d d| jf� W q� t y� } zt�d|� W Y d }~q�d }~0 0 nt�d| j� |s�t |d�r�t�dt � � j � |j�� |`d S )Nz DECREF %rr� ra z... decref failed %sz%DECREF %r -- manager already shutdownr z-thread %r has no more proxies so closing conn)�discardr, r� r� r� r r� r+ rE r� r� rn r� r r r� )r� rh r2 ZtlsZidsetr� r� r� r r r r U s $� zBaseProxy._decrefc C sJ d | _ z | �� W n2 tyD } zt�d| � W Y d }~n d }~0 0 d S )Nzincref failed: %s)r r r� r r� )r- r� r r r r n s zBaseProxy._after_forkc C s^ i }t � d ur| j|d< t| dd�rB| j|d< tt| j| j|ffS tt| �| j| j|ffS d S )Nrh �_isautoFr� ) r r� r r� � RebuildProxyr� r r� r �r- rB r r r r v s ��zBaseProxy.__reduce__c C s | � � S r )r )r- �memor r r � __deepcopy__� s zBaseProxy.__deepcopy__c C s dt | �j| jjt| �f S )Nz <%s object, typeid %r at %#x>)r r5 r r* r, r/ r r r r6 � s �zBaseProxy.__repr__c C s8 z | � d�W S ty2 t| �dd� d Y S 0 dS )zV Return representation of the referent (or a fall-back if that fails) r6 Nr z; '__str__()' failed>)r r� r� r/ r r r rO � s zBaseProxy.__str__)NNNTF)r5 r7 r8 r9 r� r ZForkAwareThreadLockr r. r r r r r r r r r r6 rO r r r r r � s" � ) r c C s� t t�� dd�}|rT|j|jkrTt�d|� d|d< |j|jvrT|j|j |j|j< |� dd�opt t�� dd� }| ||fd|i|��S ) z5 Function used for unpickling proxy objects. rx Nz*Rebuild a proxy owned by manager, token=%rTr r` Z _inheritingF) r r rw r+ r r� r, rm rk �pop)rT r� rq rB r� r` r r r r � s � �r c C sn t |�}z|| |f W S ty( Y n0 i }|D ]}td||f |� q2t| tf|�}||_||| |f< |S )zB Return a proxy type whose methods are given by `exposed` zOdef %s(self, /, *args, **kwds): return self._callmethod(%r, args, kwds))r� r� �execr r r� )r r� �_cacheZdicZmeth� ProxyTyper r r � MakeProxyType� s �� r% c C s� t | d }|du rJ|| j|d�}z t|dd| f�}W |�� n |�� 0 |du r`|dur`|j}|du rrt�� j}td| j |�} | | |||||d�} d| _ | S )z* Return an auto-proxy for `token` r Nr� r\ z AutoProxy[%s])r� rh r` r T) ri r+ rE r� r� r rw rh r% r* r ) r� rq r� rh r� r` r r� r� r$ r� r r r r� � s �r� c @ s e Zd Zdd� Zdd� ZdS )� Namespacec K s | j �|� d S r )r� �updater r r r r. � s zNamespace.__init__c C sZ t | j�� �}g }|D ]$\}}|�d�s|�d||f � q|�� d| jjd�|�f S )NrV z%s=%rz%s(%s)z, ) r% r� r" � startswithrR r� r4 r5 r� )r- r" rS r r� r r r r6 � s zNamespace.__repr__N)r5 r7 r8 r. r6 r r r r r& � s r& c @ s8 e Zd Zd dd�Zdd� Zdd� Zdd � Zeee�Zd S ) �ValueTc C s || _ || _d S r )� _typecode�_value)r- r r� �lockr r r r. � s zValue.__init__c C s | j S r �r+ r/ r r r r� � s z Value.getc C s || _ d S r r- �r- r� r r r r� � s z Value.setc C s dt | �j| j| jf S )Nz %s(%r, %r))r r5 r* r+ r/ r r r r6 � s zValue.__repr__N)T) r5 r7 r8 r. r� r� r6 r r� r r r r r) � s r) c C s t � | |�S r )r )r �sequencer, r r r �Array� s r0 c @ s8 e Zd ZdZdd� Zdd� Zdd� Zdd � Zd d � Zd S ) � IteratorProxy)�__next__r< �throwr� c C s | S r r r/ r r r �__iter__ s zIteratorProxy.__iter__c G s | � d|�S )Nr2 r �r- rA r r r r2 s zIteratorProxy.__next__c G s | � d|�S )Nr< r r5 r r r r< s zIteratorProxy.sendc G s | � d|�S )Nr3 r r5 r r r r3 s zIteratorProxy.throwc G s | � d|�S )Nr� r r5 r r r r� s zIteratorProxy.closeN) r5 r7 r8 r� r4 r2 r< r3 r� r r r r r1 � s r1 c @ s2 e Zd ZdZd dd�Zdd� Zdd � Zd d � ZdS ) � AcquirerProxy)�acquire�releaseTNc C s" |d u r|fn||f}| � d|�S �Nr7 r )r- Zblockingr� rA r r r r7 s zAcquirerProxy.acquirec C s | � d�S �Nr8 r r/ r r r r8 s zAcquirerProxy.releasec C s | � d�S r9 r r/ r r r r� s zAcquirerProxy.__enter__c C s | � d�S r: r r� r r r r� s zAcquirerProxy.__exit__)TN)r5 r7 r8 r� r7 r8 r� r� r r r r r6 s r6 c @ s6 e Zd ZdZd dd�Zd dd�Zdd � Zdd d �ZdS )�ConditionProxy)r7 r8 r~ �notify� notify_allNc C s | � d|f�S �Nr~ r r� r r r r~ s zConditionProxy.waitr c C s | � d|f�S )Nr< r )r- �nr r r r< s zConditionProxy.notifyc C s | � d�S )Nr= r r/ r r r r= s zConditionProxy.notify_allc C sd |� }|r|S |d ur$t �� | }nd }d }|s`|d urN|t �� }|dkrNq`| �|� |� }q,|S )Nr )�time� monotonicr~ )r- Z predicater� rD ZendtimeZwaittimer r r �wait_for! s zConditionProxy.wait_for)N)r )N)r5 r7 r8 r� r~ r< r= rB r r r r r; s r; c @ s2 e Zd ZdZdd� Zdd� Zdd� Zd d d �ZdS ) � EventProxy)r} r� r r~ c C s | � d�S )Nr} r r/ r r r r} 6 s zEventProxy.is_setc C s | � d�S �Nr� r r/ r r r r� 8 s zEventProxy.setc C s | � d�S )Nr r r/ r r r r : s zEventProxy.clearNc C s | � d|f�S r> r r� r r r r~ < s zEventProxy.wait)N)r5 r7 r8 r� r} r� r r~ r r r r rC 4 s rC c @ sN e Zd ZdZddd�Zdd� Zdd� Zed d � �Zed d � �Z ed d� �Z dS )� BarrierProxy)�__getattribute__r~ �abort�resetNc C s | � d|f�S r> r r� r r r r~ B s zBarrierProxy.waitc C s | � d�S )NrG r r/ r r r rG D s zBarrierProxy.abortc C s | � d�S )NrH r r/ r r r rH F s zBarrierProxy.resetc C s | � dd�S )NrF )�partiesr r/ r r r rI H s zBarrierProxy.partiesc C s | � dd�S )NrF )� n_waitingr r/ r r r rJ K s zBarrierProxy.n_waitingc C s | � dd�S )NrF )�brokenr r/ r r r rK N s zBarrierProxy.broken)N) r5 r7 r8 r� r~ rG rH r rI rJ rK r r r r rE @ s rE c @ s( e Zd ZdZdd� Zdd� Zdd� ZdS ) �NamespaceProxy)rF � __setattr__� __delattr__c C s0 |d dkrt �| |�S t �| d�}|d|f�S )Nr rV r rF )�objectrF �r- r� � callmethodr r r � __getattr__U s zNamespaceProxy.__getattr__c C s4 |d dkrt �| ||�S t �| d�}|d||f�S )Nr rV r rM )rO rM rF )r- r� r� rQ r r r rM Z s zNamespaceProxy.__setattr__c C s0 |d dkrt �| |�S t �| d�}|d|f�S )Nr rV r rN )rO rN rF rP r r r rN _ s zNamespaceProxy.__delattr__N)r5 r7 r8 r� rR rM rN r r r r rL S s rL c @ s4 e Zd ZdZdd� Zdd� Zeee�Zee j �Z dS )� ValueProxy)r� r� c C s | � d�S )Nr� r r/ r r r r� h s zValueProxy.getc C s | � d|f�S rD r r. r r r r� j s zValueProxy.setN) r5 r7 r8 r� r� r� r r� r �types� GenericAlias�__class_getitem__r r r r rS f s rS � BaseListProxy)�__add__� __contains__� __delitem__� __getitem__�__len__�__mul__� __reversed__�__rmul__� __setitem__rR �count�extend�index�insertr! �remove�reverser� �__imul__c @ s e Zd Zdd� Zdd� ZdS )� ListProxyc C s | � d|f� | S )Nrb r r. r r r �__iadd__x s zListProxy.__iadd__c C s | � d|f� | S )Nrg r r. r r r rg { s zListProxy.__imul__N)r5 r7 r8 ri rg r r r r rh w s rh � DictProxy)rY rZ r[ r4 r\ r` r r� r� r" r# r! �popitem� setdefaultr' r$ r4 �Iterator� ArrayProxy)r\ r[ r` � PoolProxy) Zapply� apply_asyncr� �imap�imap_unorderedr� �map� map_async�starmap� starmap_asyncr� Z AsyncResult)rp rt rv rq rr c @ s e Zd Zdd� Zdd� ZdS )ro c C s | S r r r/ r r r r� � s zPoolProxy.__enter__c C s | � � d S r )r� r� r r r r� � s zPoolProxy.__exit__N)r5 r7 r8 r� r� r r r r ro � s c @ s e Zd ZdZdS )r a( Subclass of `BaseManager` which supports a number of shared object types. The types registered are those intended for the synchronization of threads, plus `dict`, `list` and `Namespace`. The `multiprocessing.Manager()` function creates started instances of this class. N)r5 r7 r8 r9 r r r r r � s r �QueueZ JoinableQueueru ro �RLock� Semaphore�BoundedSemaphore� Condition�Barrier�Poolr% r� )r� r� )r� c @ sL e Zd ZdZg fdd�Zdd� Zdd� Zdd � Zd d � Zd d � Z dd� Z dS )�_SharedMemoryTrackerz+Manages one or more shared memory segments.c C s || _ || _d S r �Zshared_memory_context_name� segment_names)r- r r� r r r r. � s z _SharedMemoryTracker.__init__c C s( t �d|�dt� � �� | j�|� dS )z6Adds the supplied shared memory block name to tracker.zRegister segment � in pid N)r r� r r� rR �r- � segment_namer r r �register_segment� s z%_SharedMemoryTracker.register_segmentc C sB t �d|�dt� � �� | j�|� t�|�}|�� |�� dS )z�Calls unlink() on the shared memory block with the supplied name and removes it from the list of blocks being tracked.zDestroy segment r� N) r r� r r� re r � SharedMemoryr� �unlink)r- r� Zsegmentr r r �destroy_segment� s z$_SharedMemoryTracker.destroy_segmentc C s" | j dd� D ]}| �|� qdS )z<Calls destroy_segment() on all tracked shared memory blocks.N)r� r� r� r r r r� � s z_SharedMemoryTracker.unlinkc C s( t �d| jj� dt� � �� | �� d S )NzCall z .__del__ in )r r� r4 r5 r r� r/ r r r �__del__� s z _SharedMemoryTracker.__del__c C s | j | jfS r r r/ r r r r0 � s z!_SharedMemoryTracker.__getstate__c C s | j |� d S r )r. r1 r r r r3 � s z!_SharedMemoryTracker.__setstate__N) r5 r7 r8 r9 r. r� r� r� r� r0 r3 r r r r r~ � s r~ c @ sJ e Zd Zejg d� Zdd� Zdd� Zdd� Zdd � Zd d � Z d d � Z dS )�SharedMemoryServer)� track_segment�release_segment� list_segmentsc O s` t j| g|�R i |�� | j}t|t�r2t�|�}td|� dt� � ��| _ t � dt� � �� d S )NZshm_rV z"SharedMemoryServer started by pid ) rX r. r+ rI re �os�fsdecoder~ r �shared_memory_contextr r� )r- rA �kwargsr+ r r r r. � s �zSharedMemoryServer.__init__c O s: t | j| d d�r | j|d< tj| ||g|�R i |��S )z�Create a new distributed-shared object (not backed by a shared memory block) and return its id to be used in a Proxy Object.r Z_shared_memory_proxyr� )r� rf r� rX rZ )r- r? r* rA r� r r r rZ � s zSharedMemoryServer.createc C s | j �� t�| |�S )zACall unlink() on all tracked shared memory, terminate the Server.)r� r� rX rY r� r r r rY s zSharedMemoryServer.shutdownc C s | j �|� dS )z?Adds the supplied shared memory block name to Server's tracker.N)r� r� �r- r? r� r r r r� s z SharedMemoryServer.track_segmentc C s | j �|� dS )z�Calls unlink() on the shared memory block with the supplied name and removes it from the tracker instance inside the Server.N)r� r� r� r r r r� s z"SharedMemoryServer.release_segmentc C s | j jS )zbReturns a list of names of shared memory blocks that the Server is currently tracking.)r� r� r� r r r r� s z SharedMemoryServer.list_segmentsN) r5 r7 r8 rX r� r. rZ rY r� r� r� r r r r r� � s � r� c @ s< e Zd ZdZeZdd� Zdd� Zdd� Zdd � Z d d � Z d S ) r a� Like SyncManager but uses SharedMemoryServer instead of Server. It provides methods for creating and returning SharedMemory instances and for creating a list-like object (ShareableList) backed by shared memory. It also provides methods that create and return Proxy Objects that support synchronization across processes (i.e. multi-process-safe locks and semaphores). c O sT t jdkr ddlm} |�� tj| g|�R i |�� t�| j j � dt � � �� d S )N�posixr )�resource_trackerz created by pid ) r� r � r� Zensure_runningr r. r r� r4 r5 r )r- rA r� r� r r r r. ' s z SharedMemoryManager.__init__c C s t �| jj� dt� � �� d S )Nz.__del__ by pid )r r� r4 r5 r r/ r r r r� 3 s zSharedMemoryManager.__del__c C sh | j jtjkrP| j jtjkr&td��n*| j jtjkr>td��ntd�| j j���| �| j | j | j | j �S )z@Better than monkeypatching for now; merge into Server ultimatelyz"Already started SharedMemoryServerz!SharedMemoryManager has shut downr� ) r� r� r� r� r� r r� rL r� r� r� r� r� r/ r r r r� 7 s � �z SharedMemoryManager.get_serverc C s� | j | j| jd��h}tjdd|d�}zt|dd|jf� W n0 tyj } z|�� |�W Y d}~n d}~0 0 W d � n1 s�0 Y |S )zoReturns a new SharedMemory instance with the specified size in bytes, to be tracked by the manager.r� NT)rZ �sizer� ) r� r� r� r r� rE r � BaseExceptionr� )r- r� r� Zsmsr� r r r r� D s 8z SharedMemoryManager.SharedMemoryc C s� | j | j| jd��f}t�|�}zt|dd|jjf� W n2 tyh } z|j� � |�W Y d}~n d}~0 0 W d � n1 s~0 Y |S )z�Returns a new ShareableList instance populated with the values from the input sequence, to be tracked by the manager.r� Nr� ) r� r� r� r � ShareableListrE Zshmr r� r� )r- r/ r� Zslr� r r r r� P s 8z!SharedMemoryManager.ShareableListN) r5 r7 r8 r9 r� r� r. r� r� r� r� r r r r r s )NNNTF)T)U�__all__r� rn r� r Zqueuer@ rT r� r r� r r� r �contextr r r r r r r r � ImportErrorZ HAS_SHMEMrR r r� Z view_typesr% r( Z view_typerO r rE r> r� rM rU rW rX r� rr rs Z XmlListenerZ XmlClientri r r� r r r r% r� r& r) r0 r1 r6 r; rC rE rL rS rW rh rj r� rn Z BasePoolProxyro r rw ru ro rx ry rz r{ r| r} r� r~ r� r r r r r �<module> s� H � w 4 � � � �%-
Save File
Cancel