← Back
Editing: managers.cpython-310.pyc
o 0�i�� � @ sP g d �Z ddlZddlZddlZddlZddlZddlZddlZddlZddlm Z ddl m Z ddl m Z ddlmZmZmZ ddl mZ dd l mZ dd l mZ dd l mZ zdd l mZ W n eyk d ZY nw dZe �d� dd� Ze�eje� dd� dD �Z e d e ur�dd� Z e D ]Z e�e e � q�G dd� de �Z!di fdd�Z"d d � Z#G d d � d e$�Z%d d!� Z&d"d#� Z'G d$d%� d%e �Z(G d&d'� d'e �Z)e j*e j+fe j,e j-fd(�Z.G d)d*� d*e �Z/G d+d,� d,e0�Z1G d-d.� d.e �Z2d/d0� Z3i fd1d2�Z4 dmd3d4�Z5G d5d6� d6e �Z6G d7d8� d8e �Z7dnd9d:�Z8G d;d<� d<e2�Z9G d=d>� d>e2�Z:G d?d@� d@e:�Z;G dAdB� dBe2�Z<G dCdD� dDe2�Z=G dEdF� dFe2�Z>G dGdH� dHe2�Z?e4dIdJ�Z@G dKdL� dLe@�ZAe4dMdN�ZBdOdPieB_Ce4dQdR�ZDe4dSdT�ZEdUdUdUdPdPdV�eE_CG dWdS� dSeE�ZFG dXdY� dYe/�ZGeG�dZejH� eG�d[ejH� eG�d\ejIe<� eG�d]ejJe:� eG�d^ejKe:� eG�d_ejLe:� eG�d`ejMe:� eG�daejNe;� eG�dbejOe=� eG�dcejPeF� eG�dde eA� eG�deeQeB� eG�d8e7e?� eG�d:e8eD� eG�d6e6e>� eGjdPe9d df� eGjdUd dg� e�r&G dhdi� di�ZRG djdk� dke(�ZSG dld� de/�ZTdS dS )o)� BaseManager� SyncManager� BaseProxy�Token� N)�getpid)� format_exc� )� connection)� reduction�get_spawning_popen� ProcessError)�pool)�process)�util)� get_context)� shared_memoryFT�SharedMemoryManagerc C s t j | j| �� ffS �N)�array�typecode�tobytes)�a� r �?/opt/alt/python310/lib64/python3.10/multiprocessing/managers.py� reduce_array/ � r c C s g | ] }t ti |�� ��qS r )�type�getattr��.0�namer r r � <listcomp>3 � r! )�items�keys�valuesc C s t t | �ffS r )�list��objr r r �rebuild_as_list5 � r) c @ s4 e Zd ZdZdZdd� Zdd� Zdd� Zd d � Zd S ) r z3 Type to uniquely identify a shared object ��typeid�address�idc C s |||| _ | _| _d S r r+ )�selfr, r- r. r r r �__init__D s zToken.__init__c C s | j | j| jfS r r+ �r/ r r r � __getstate__G � zToken.__getstate__c C s |\| _ | _| _d S r r+ �r/ �stater r r � __setstate__J r zToken.__setstate__c C s d| j j| j| j| jf S )Nz %s(typeid=%r, address=%r, id=%r))� __class__�__name__r, r- r. r1 r r r �__repr__M s �zToken.__repr__N) r8 � __module__� __qualname__�__doc__� __slots__r0 r2 r6 r9 r r r r r > s r r c C s4 | � ||||f� | �� \}}|dkr|S t||��)zL Send a message to manager using connection `c` and return response �#RETURN)�send�recv�convert_to_error)�cr. � methodname�args�kwds�kind�resultr r r �dispatchU s rH c C s^ | dkr|S | dv r(t |t�std�|| t|����| dkr$td| �S t|�S td�| ��S )N�#ERROR)� #TRACEBACK�#UNSERIALIZABLEz.Result {0!r} (kind '{1}') type is {2}, not strrK zUnserializable message: %s z Unrecognized message type {!r})� isinstance�str� TypeError�formatr � RemoteError� ValueError)rF rG r r r rA _ s �� rA c @ s e Zd Zdd� ZdS )rP c C s dt | jd � d S )NzM --------------------------------------------------------------------------- r zK---------------------------------------------------------------------------)rM rD r1 r r r �__str__o s zRemoteError.__str__N)r8 r: r; rR r r r r rP n s rP c C s2 g }t | �D ]}t| |�}t|�r|�|� q|S )z4 Return a list of names of methods of `obj` )�dirr �callable�append)r( �tempr �funcr r r � all_methodsv s �rX c C s dd� t | �D �S )zP Return a list of names of methods of `obj` which do not start with '_' c S s g | ] }|d dkr|�qS )r �_r r r r r r! � r" z"public_methods.<locals>.<listcomp>)rX r' r r r �public_methods� s rZ c @ s� e Zd ZdZg d�Zdd� Zdd� Zdd� Zd d � Zd d � Z d d� Z dd� Z dd� Z dd� Z e e e d�Zdd� Zdd� Zdd� Zd d � Zd d � Zd d!� Zd"d#� Zd$d%� Zd&d'� Zd(S ))�ServerzM Server class which runs in a process controlled by a manager object ) �shutdown�create�accept_connection� get_methods� debug_info�number_of_objects�dummy�incref�decrefc C sx t |t�std�|t|����|| _t�|�| _t | \}}||dd�| _ | j j | _ ddi| _ i | _ i | _t�� | _d S )Nz&Authkey {0!r} is type {1!s}, not bytes� )r- Zbacklog�0�Nr )rL �bytesrN rO r �registryr �AuthenticationString�authkey�listener_client�listenerr- � id_to_obj�id_to_refcount�id_to_local_proxy_obj� threading�Lock�mutex)r/ ri r- rk � serializer�Listener�Clientr r r r0 � s �� zServer.__init__c C s� t �� | _| t�� _zGt j| jd�}d|_|� � z| j� � s*| j� d� | j� � r W n t t fy6 Y nw W tjtjkrKt�d� tjt_tjt_t�d� dS tjtjkret�d� tjt_tjt_t�d� w )z( Run the server forever )�targetTr zresetting stdout, stderrr N)rq �Event� stop_eventr �current_process�_manager_server�Thread�accepter�daemon�start�is_set�wait�KeyboardInterrupt� SystemExit�sys�stdout� __stdout__r �debug� __stderr__�stderr�exit)r/ r} r r r � serve_forever� s2 ���� � zServer.serve_foreverc C sF z| j �� }W n ty Y q w tj| j|fd�}d|_|�� q)NT�rw rD )rm Zaccept�OSErrorrq r| �handle_requestr~ r )r/ rB �tr r r r} � s ��zServer.accepterc C s: d }z*t �|| j� t �|| j� |�� }|\}}}}|| jv s&J d| ��t| |�}W n ty: dt� f}Y n!w z ||g|�R i |��} W n tyV dt� f}Y nw d| f}z|� |� W d S ty� } z-z |� dt� f� W n ty~ Y nw t � d|� t � d|� t � d| � W Y d } ~ d S d } ~ ww )Nz%r unrecognizedrJ r> zFailure to send message: %rz ... request was %r� ... exception was %r) r Zdeliver_challengerk Zanswer_challenger@ �publicr � Exceptionr r? r �info) r/ rB �request�ignore�funcnamerD rE rW �msgrG �er r r �_handle_request� s< � � � ��zServer._handle_requestc C sJ z z| � |� W n ty Y nw W |�� dS W |�� dS |�� w )z) Handle a new connection N)r� r� �close�r/ �connr r r r� � s �� �zServer.handle_requestc C s� t �dt�� j� |j}|j}| j}| j� � �sdz�d }}|� }|\}}} } z || \}} } W n& t yU } zz | j | \}} } W n t yJ | �w W Y d} ~ nd} ~ ww || vret d|t |�| f ��t||�}z || i | ��}W n ty� } z d|f}W Y d}~n*d}~ww | o�| �|d�}|r�| �|||�\}}t|| j|�}d||ff}nd|f}W n` t y� |du r�dt� f}n(z| j| }|| |||g| �R i | ��}d|f}W n ty� dt� f}Y nw Y n& t�y t �dt�� j� t�d � Y n t�y dt� f}Y nw zz||� W n t�y) |d t� f� Y nw W n1 t�y\ } z$t �d t�� j� t �d |� t �d |� |�� t�d� W Y d}~nd}~ww | j� � rdS dS )zQ Handle requests from the proxies in a particular process/thread z$starting server thread to service %rNz+method %r of %r object is not in exposed=%rrI �#PROXYr> rJ z$got EOF -- exiting thread serving %rr rK z exception in thread serving %rz ... message was %rr� r )r r� rq �current_threadr r@ r? rn ry r� �KeyErrorrp �AttributeErrorr r r� �getr] r r- r �fallback_mapping�EOFErrorr� r� r� r� )r/ r� r@ r? rn rC r( r� �identrD rE �exposed� gettypeid�keZfunction�resr� r� r, ZridentZrexposed�tokenZ fallback_funcrG r r r � serve_client� s� � � � ��� �� ��� ��� ���� ��� ���zServer.serve_clientc C s |S r r �r/ r� r� r( r r r �fallback_getvalue? � zServer.fallback_getvaluec C � t |�S r �rM r� r r r � fallback_strB � zServer.fallback_strc C r� r )�reprr� r r r � fallback_reprE r� zServer.fallback_repr)rR r9 � #GETVALUEc C s d S r r �r/ rB r r r rb N r� z Server.dummyc C s� | j �; g }t| j�� �}|�� |D ] }|dkr1|�d|| j| t| j| d �dd� f � qd�|�W d � S 1 sAw Y dS )zO Return some info --- useful to spot problems with refcounting rf z %s: refcount=%s %sr N�K � ) rs r& ro r$ �sortrU rM rn �join)r/ rB rG r$ r� r r r r` Q s ���$�zServer.debug_infoc C s t | j�S )z* Number of shared objects )�lenro r� r r r ra a s zServer.number_of_objectsc C s` z)z t �d� |�d� W n ddl}|�� Y W | j�� dS W | j�� dS | j�� w )z' Shutdown this process z!manager received shutdown message�r> Nr N)r r� r? � traceback� print_excry �set)r/ rB r� r r r r\ h s �zServer.shutdownc O s | j �q | j| \}}}}|du r"|st|�dkr td��|d } n||i |��} |du r1t| �}|durLt|t�sDtd�|t |����t |�t |� }dt | � } t � d|| � | t|�|f| j| < | | jvrmd| j| < W d � n1 sww Y | �|| � | t|�fS )z> Create a new shared object and return its id Nr z4Without callable, must have one non-keyword argumentr z,Method_to_typeid {0!r}: type {1!s}, not dictz%xz&%r callable returned object with id %r)rs ri r� rQ rZ rL �dictrN rO r r& r. r r� r� rn ro rc �tuple) r/ rB r, rD rE rT r� �method_to_typeid� proxytyper( r� r r r r] u s: �� �� � � z Server.createc C s t | j|j d �S )zL Return the methods of the shared object indicated by token r )r� rn r. )r/ rB r� r r r r_ � s zServer.get_methodsc C s" |t �� _|�d� | �|� dS )z= Spawn a new thread to serve this connection r� N)rq r� r r? r� )r/ rB r r r r r^ � s zServer.accept_connectionc C s� | j �R z | j| d7 < W n5 tyD } z)|| jv r8d| j|< | j| | j|< | j| \}}}t�d|� n|�W Y d }~n d }~ww W d � d S W d � d S 1 sXw Y d S )Nr z&Server re-enabled tracking & INCREF %r)rs ro r� rp rn r r� )r/ rB r� r� r( r� r� r r r rc � s$ � ����� "�z Server.increfc C s� || j vr|| jv rt�d|� d S | j�2 | j | dkr,td�|| j| | j | ���| j | d8 < | j | dkr@| j |= W d � n1 sJw Y || j vryd| j|< t�d|� | j� | j|= W d � d S 1 srw Y d S d S )NzServer DECREF skipping %rr z+Id {0!s} ({1!r}) has refcount {2:n}, not 1+r )Nr Nzdisposing of obj with id %r)ro rp r r� rs �AssertionErrorrO rn )r/ rB r� r r r rd � s0 ��� � "��z Server.decrefN)r8 r: r; r< r� r0 r� r} r� r� r� r� r� r� r� rb r` ra r\ r] r_ r^ rc rd r r r r r[ � s2 Q� $ r[ c @ s e Zd ZdgZdZdZdZdS )�State�valuer r � N)r8 r: r; r= �INITIAL�STARTED�SHUTDOWNr r r r r� � s r� )�pickleZ xmlrpclibc @ s� e Zd ZdZi ZeZ d"dd�Zdd� Zdd � Z d#d d �Z e d#d d��Z dd� Z d$dd�Zdd� Zdd� Zdd� Zdd� Zedd � �Zed d � �Ze d%d d!��ZdS )&r z! Base class for managers Nr� c C s\ |d u r t �� j}|| _t �|�| _t� | _tj| j_ || _ t | \| _ | _ |p*t� | _d S r )r rz rk �_addressrj �_authkeyr� �_stater� r� � _serializerrl Z _Listener�_Clientr �_ctx)r/ r- rk rt �ctxr r r r0 � s zBaseManager.__init__c C sb | j jtjkr&| j jtjkrtd��| j jtjkr td��td�| j j���t| j | j | j | j �S )zX Return server object with serve_forever() method and address attribute �Already started server�Manager has shut down�Unknown state {!r}) r� r� r� r� r� r r� rO r[ � _registryr� r� r� r1 r r r � get_server� s � �zBaseManager.get_serverc C s8 t | j \}}|| j| jd�}t|dd� tj| j_dS )z> Connect manager object to the server process �rk Nrb ) rl r� r� r� rH r� r� r� r� )r/ ru rv r� r r r �connect s zBaseManager.connectr c C s0 | j jtjkr&| j jtjkrtd��| j jtjkr td��td�| j j���|dur2t|�s2t d��t j dd�\}}| j j t| �j| j| j| j| j|||fd�| _d �d d � | jjD ��}t| �jd | | j_| j�� |�� |�� | _|�� tj| j _t j | t| �j | j| j| j| j | j fd d�| _ dS )z@ Spawn a server process for this manager object r� r� r� Nz initializer must be a callableF)Zduplexr� �:c s s � | ]}t |�V qd S r r� )r �ir r r � <genexpr>0 s � z$BaseManager.start.<locals>.<genexpr>�-r �rD Z exitpriority)!r� r� r� r� r� r r� rO rT rN r ZPiper� ZProcessr � _run_serverr� r� r� r� �_processr� Z _identityr8 r r r� r@ r �Finalize�_finalize_managerr� r\ )r/ � initializer�initargs�reader�writerr� r r r r s> � �� � �zBaseManager.startc C s^ t � t jt j� |dur||� | �||||�}|�|j� |�� t�d|j� |� � dS )z@ Create a server, report its address and run it Nzmanager serving at %r) �signal�SIGINT�SIG_IGN�_Serverr? r- r� r r� r� ) �clsri r- rk rt r� r� r� �serverr r r r� B s zBaseManager._run_serverc O sl | j jtjks J d��| j| j| jd�}zt|dd|f| |�\}}W |�� n|�� w t || j|�|fS )zP Create a new shared object; return the token and exposed tuple zserver not yet startedr� Nr] ) r� r� r� r� r� r� r� rH r� r )r/ r, rD rE r� r. r� r r r �_createY s zBaseManager._createc C s2 | j dur| j �|� | j �� sd| _ dS dS dS )zC Join the manager process (if it has been spawned) N)r� r� �is_alive�r/ �timeoutr r r r� e s �zBaseManager.joinc C �4 | j | j| jd�}z t|dd�W |�� S |�� w )zS Return some info about the servers shared objects and connections r� Nr` �r� r� r� rH r� r� r r r � _debug_infon � zBaseManager._debug_infoc C r� )z5 Return the number of shared objects r� Nra r� r� r r r �_number_of_objectsx r� z BaseManager._number_of_objectsc C sf | j jtjkr | �� | j jtjkr1| j jtjkr td��| j jtjkr(td��td�| j j���| S )NzUnable to start serverr� r� ) r� r� r� r� r r� r r� rO r1 r r r � __enter__� s �zBaseManager.__enter__c C � | � � d S r )r\ �r/ �exc_typeZexc_valZexc_tbr r r �__exit__� � zBaseManager.__exit__c C s� | � � rYt�d� z|||d�}z t|dd� W |�� n|�� w W n ty, Y nw | jdd� | � � rYt�d� t| d�rYt�d � | �� | jdd� | � � rYt�d � t j |_ zt j |= W dS tyn Y dS w ) zQ Shutdown the manager process; will be registered as a finalizer z#sending shutdown message to managerr� Nr\ g �?)r� zmanager still alive� terminatez'trying to `terminate()` manager processz#manager still alive after terminate)r� r r� rH r� r� r� �hasattrr� r� r� r� r �_address_to_localr� )r r- rk r5 r� r� r r r r� � s2 � �z BaseManager._finalize_managerc C � | j S r )r� r1 r r r r- � s zBaseManager.addressTc s� d| j vr | j�� | _� du rt� |pt� dd�}|p t� dd�}|rFt|�� �D ] \}}t|�tu s9J d| ��t|�tu sEJ d| ��q)|||� f| j�< |rc� �fdd�} �| _ t | �| � dS dS )z9 Register a typeid with the manager type r� N� _exposed_�_method_to_typeid_z%r is not a stringc sf t �d�� | j�g|�R i |��\}}� || j| | j|d�}| j|j| jd�}t|d d|jf� |S )Nz)requesting creation of a shared %r object��managerrk r� r� rd ) r r� r� r� r� r� r- rH r. )r/ rD rE r� Zexp�proxyr� �r� r, r r rV � s �z"BaseManager.register.<locals>.temp) �__dict__r� �copy� AutoProxyr r& r# r rM r8 �setattr) r� r, rT r� r� r� � create_method�keyr� rV r r r �register� s& � � �zBaseManager.register)NNr� Nrg r )NNNNT)r8 r: r; r< r� r[ r� r0 r� r� r � classmethodr� r� r� r� r� r� r� � staticmethodr� �propertyr- r r r r r r � s6 � + � �r c @ � e Zd Zdd� Zdd� ZdS )�ProcessLocalSetc C s t �| dd� � d S )Nc S � | � � S r )�clearr' r r r �<lambda>� s z*ProcessLocalSet.__init__.<locals>.<lambda>)r �register_after_forkr1 r r r r0 � r zProcessLocalSet.__init__c C s t | �dfS rg )r r1 r r r � __reduce__� r� zProcessLocalSet.__reduce__N)r8 r: r; r0 r r r r r r � � r c @ s� e Zd ZdZi Ze�� Z d dd�Zdd� Z d i fd d �Z d d � Z dd� Z e dd� �Zdd� Zdd� Zdd� Zdd� Zdd� ZdS ) r z. A base for proxies of shared objects NTFc C s� t j�! t j�|jd �}|d u r t�� t� f}|t j|j< W d � n1 s'w Y |d | _|d | _ || _ | j j | _ || _ || _t| d | _|| _|d urYt�|�| _n| j d urd| j j| _nt�� j| _|rp| �� t�| t j� d S )Nr r )r �_mutexr� r� r- r ZForkAwareLocalr �_tls�_idset�_tokenr. �_id�_managerr� rl r� �_owned_by_managerr rj r� rz rk �_increfr � _after_fork) r/ r� rt r rk r� rc � manager_ownedZ tls_idsetr r r r0 � s. � � zBaseProxy.__init__c C sd t �d� t�� j}t�� jdkr|dt�� j 7 }| j| jj | j d�}t |d d|f� || j _ d S )Nz making connection to managerZ MainThread�|r� r^ )r r� r rz r rq r� r� r r- r� rH r r )r/ r r� r r r �_connect s zBaseProxy._connectr c C s� z| j j}W n ty t�dt�� j� | �� | j j}Y nw |� | j |||f� |� � \}}|dkr7|S |dkrm|\}}| j j |j d } | jj|_| || j| j | j|d�} | j|j| jd�}t|dd|jf� | S t||��) zV Try to call a method of the referent and return a copy of the result z#thread %r does not own a connectionr> r� ���r r� Nrd )r r r� r r� rq r� r r" r? r r@ r r� r, r r- r� r� r� rH r. rA ) r/ rC rD rE r� rF rG r� r� r� r r r r � _callmethod% s2 � � � zBaseProxy._callmethodc C � | � d�S )z9 Get a copy of the value of the referent r� �r$ r1 r r r � _getvalueC s zBaseProxy._getvaluec C s� | j r t�d| jj� d S | j| jj| jd�}t|d d| j f� t�d| jj� | j � | j � | j o5| j j }tj| tj| j| j|| j| j | jfdd�| _d S )Nz%owned_by_manager skipped INCREF of %rr� rc z INCREF %r� r� )r r r� r r. r� r- r� rH r r �addr r� r� r �_decrefr Z_close)r/ r� r5 r r r r I s � �zBaseProxy._increfc C s� |� | j� |d u s|jtjkrBzt�d| j� || j|d�}t|d d| jf� W n t yA } z t�d|� W Y d }~n d }~ww t�d| j� |sbt |d�rdt�dt � � j � |j�� |`d S d S d S )Nz DECREF %rr� rd z... decref failed %sz%DECREF %r -- manager already shutdownr z-thread %r has no more proxies so closing conn)�discardr. r� r� r� r r� r- rH r� r� rq r� r r r� )r� rk r5 ZtlsZidsetr� r� r� r r r r* ] s$ ��� �zBaseProxy._decrefc C sJ d | _ z| �� W d S ty$ } zt�d| � W Y d }~d S d }~ww )Nzincref failed: %s)r r r� r r� )r/ r� r r r r v s ��zBaseProxy._after_forkc C sZ i }t � d ur | j|d< t| dd�r!| j|d< tt| j| j|ffS tt| �| j| j|ffS )Nrk �_isautoFr� ) r r� r r� � RebuildProxyr r r� r �r/ rE r r r r ~ s ��zBaseProxy.__reduce__c C r r )r' )r/ Zmemor r r � __deepcopy__� r� zBaseProxy.__deepcopy__c C s dt | �j| jjt| �f S )Nz <%s object, typeid %r at %#x>)r r8 r r, r. r1 r r r r9 � s �zBaseProxy.__repr__c C s4 z| � d�W S ty t| �dd� d Y S w )zV Return representation of the referent (or a fall-back if that fails) r9 Nr# z; '__str__()' failed>)r$ r� r� r1 r r r rR � s �zBaseProxy.__str__�NNNTF)r8 r: r; r< r� r ZForkAwareThreadLockr r0 r" r$ r' r r r* r r r/ r9 rR r r r r r � s$ �) r c C s� t t�� dd�}|r*|j|jkr*t�d|� d|d< |j|jvr*|j|j |j|j< |� dd�o8t t�� dd� }| ||fd|i|��S ) z5 Function used for unpickling proxy objects. r{ Nz*Rebuild a proxy owned by manager, token=%rTr rc Z _inheritingF) r r rz r- r r� r. rp rn �pop)rW r� rt rE r� rc r r r r- � s � �r- c C sn t |�}z|| |f W S ty Y nw i }|D ] }td||f |� qt| tf|�}||_||| |f< |S )zB Return a proxy type whose methods are given by `exposed` zOdef %s(self, /, *args, **kwds): return self._callmethod(%r, args, kwds))r� r� �execr r r� )r r� �_cacheZdicZmeth� ProxyTyper r r � MakeProxyType� s" ��� r5 c C s� t | d }|du r%|| j|d�}zt|dd| f�}W |�� n|�� w |du r0|dur0|j}|du r9t�� j}td| j |�} | | |||||d�} d| _ | S )z* Return an auto-proxy for `token` r Nr� r_ z AutoProxy[%s])r rk rc r T) rl r- rH r� r� r rz rk r5 r, r, ) r� rt r rk r� rc r r� r� r4 r r r r r � s �r c @ r )� Namespacec K s | j �|� d S r )r �updater. r r r r0 � r3 zNamespace.__init__c C sZ t | j�� �}g }|D ]\}}|�d�s |�d||f � q |�� d| jjd�|�f S )NrY z%s=%rz%s(%s)z, ) r& r r# � startswithrU r� r7 r8 r� )r/ r# rV r r� r r r r9 � s �zNamespace.__repr__N)r8 r: r; r0 r9 r r r r r6 � r r6 c @ s8 e Zd Zd dd�Zdd� Zdd� Zdd � Zeee�Zd S ) �ValueTc C � || _ || _d S r )� _typecode�_value)r/ r r� �lockr r r r0 � � zValue.__init__c C r� r �r< r1 r r r r� � s z Value.getc C s || _ d S r r? �r/ r� r r r r� � � z Value.setc C s dt | �j| j| jf S )Nz %s(%r, %r))r r8 r; r< r1 r r r r9 � s zValue.__repr__N�T) r8 r: r; r0 r� r� r9 r r� r r r r r9 � s r9 c C s t � | |�S r )r )r �sequencer= r r r �Array� r� rD c @ s8 e Zd ZdZdd� Zdd� Zdd� Zdd � Zd d � Zd S ) � IteratorProxy)�__next__r? �throwr� c C � | S r r r1 r r r �__iter__ r� zIteratorProxy.__iter__c G � | � d|�S )NrF r& �r/ rD r r r rF r� zIteratorProxy.__next__c G rJ )Nr? r& rK r r r r? r� zIteratorProxy.sendc G rJ )NrG r& rK r r r rG r� zIteratorProxy.throwc G rJ )Nr� r& rK r r r r� r� zIteratorProxy.closeN) r8 r: r; r� rI rF r? rG r� r r r r rE s rE c @ s2 e Zd ZdZd dd�Zdd� Zdd � Zd d � ZdS ) � AcquirerProxy)�acquire�releaseTNc C s" |d u r|fn||f}| � d|�S �NrM r& )r/ Zblockingr� rD r r r rM s zAcquirerProxy.acquirec C r% �NrN r& r1 r r r rN rA zAcquirerProxy.releasec C r% rO r& r1 r r r r� rA zAcquirerProxy.__enter__c C r% rP r& r� r r r r� rA zAcquirerProxy.__exit__)TN)r8 r: r; r� rM rN r� r� r r r r rL s rL c @ s6 e Zd ZdZd dd�Zd dd�Zdd � Zd d d �ZdS )�ConditionProxy)rM rN r� �notify� notify_allNc C � | � d|f�S �Nr� r& r� r r r r� # r* zConditionProxy.waitr c C rT )NrR r& )r/ �nr r r rR % r* zConditionProxy.notifyc C r% )NrS r& r1 r r r rS ' rA zConditionProxy.notify_allc C sj |� }|r|S |d urt �� | }nd }d }|s3|d ur)|t �� }|dkr) |S | �|� |� }|r|S )Nr )�time� monotonicr� )r/ Z predicater� rG ZendtimeZwaittimer r r �wait_for) s" ��zConditionProxy.wait_forr )r )r8 r: r; r� r� rR rS rY r r r r rQ ! s rQ c @ s2 e Zd ZdZdd� Zdd� Zdd� Zd d d �ZdS ) � EventProxy)r� r� r r� c C r% )Nr� r& r1 r r r r� > rA zEventProxy.is_setc C r% �Nr� r& r1 r r r r� @ rA zEventProxy.setc C r% )Nr r& r1 r r r r B rA zEventProxy.clearNc C rT rU r& r� r r r r� D r* zEventProxy.waitr )r8 r: r; r� r� r� r r� r r r r rZ < s rZ c @ sN e Zd ZdZddd�Zdd� Zdd� Zed d � �Zed d � �Z ed d� �Z dS )� BarrierProxy)�__getattribute__r� �abort�resetNc C rT rU r& r� r r r r� J r* zBarrierProxy.waitc C r% )Nr^ r& r1 r r r r^ L rA zBarrierProxy.abortc C r% )Nr_ r& r1 r r r r_ N rA zBarrierProxy.resetc C � | � dd�S )Nr] )�partiesr& r1 r r r ra P � zBarrierProxy.partiesc C r` )Nr] )� n_waitingr& r1 r r r rc S rb zBarrierProxy.n_waitingc C r` )Nr] )�brokenr& r1 r r r rd V rb zBarrierProxy.brokenr ) r8 r: r; r� r� r^ r_ r ra rc rd r r r r r\ H s r\ c @ s( e Zd ZdZdd� Zdd� Zdd� ZdS ) �NamespaceProxy)r] � __setattr__� __delattr__c C s0 |d dkr t �| |�S t �| d�}|d|f�S )Nr rY r$ r] )�objectr] �r/ r � callmethodr r r � __getattr__] � zNamespaceProxy.__getattr__c C s4 |d dkr t �| ||�S t �| d�}|d||f�S )Nr rY r$ rf )rh rf r] )r/ r r� rj r r r rf b s zNamespaceProxy.__setattr__c C s0 |d dkr t �| |�S t �| d�}|d|f�S )Nr rY r$ rg )rh rg r] ri r r r rg g rl zNamespaceProxy.__delattr__N)r8 r: r; r� rk rf rg r r r r re [ s re c @ s4 e Zd ZdZdd� Zdd� Zeee�Zee j �Z dS )� ValueProxy)r� r� c C r% )Nr� r& r1 r r r r� p rA zValueProxy.getc C rT r[ r& r@ r r r r� r r* zValueProxy.setN) r8 r: r; r� r� r� r r� r �types� GenericAlias�__class_getitem__r r r r rm n s rm � BaseListProxy)�__add__� __contains__� __delitem__� __getitem__�__len__�__mul__� __reversed__�__rmul__� __setitem__rU �count�extend�index�insertr1 �remove�reverser� �__imul__c @ r )� ListProxyc C � | � d|f� | S )Nr| r& r@ r r r �__iadd__� � zListProxy.__iadd__c C r� )Nr� r& r@ r r r r� � r� zListProxy.__imul__N)r8 r: r; r� r� r r r r r� s r� � DictProxy)rs rt ru rI rv rz r r r� r# r$ r1 �popitem� setdefaultr7 r% rI �Iterator� ArrayProxy)rv ru rz � PoolProxy) Zapply� apply_asyncr� �imap�imap_unorderedr� �map� map_async�starmap� starmap_asyncr� Z AsyncResult)r� r� r� r� r� c @ r )r� c C rH r r r1 r r r r� � r� zPoolProxy.__enter__c C r� r )r� r� r r r r� � r� zPoolProxy.__exit__N)r8 r: r; r� r� r r r r r� � r c @ s e Zd ZdZdS )r a( Subclass of `BaseManager` which supports a number of shared object types. The types registered are those intended for the synchronization of threads, plus `dict`, `list` and `Namespace`. The `multiprocessing.Manager()` function creates started instances of this class. N)r8 r: r; r< r r r r r � s r �QueueZ JoinableQueuerx rr �RLock� Semaphore�BoundedSemaphore� Condition�Barrier�Poolr& r� )r� r )r c @ sL e Zd ZdZg fdd�Zdd� Zdd� Zdd � Zd d � Zd d � Z dd� Z dS )�_SharedMemoryTrackerz+Manages one or more shared memory segments.c C r: r �Zshared_memory_context_name� segment_names)r/ r r� r r r r0 � r> z _SharedMemoryTracker.__init__c C s( t �d|�dt� � �� | j�|� dS )z6Adds the supplied shared memory block name to tracker.zRegister segment � in pid N)r r� r r� rU �r/ � segment_namer r r �register_segment� s z%_SharedMemoryTracker.register_segmentc C sB t �d|�dt� � �� | j�|� t�|�}|�� |�� dS )z�Calls unlink() on the shared memory block with the supplied name and removes it from the list of blocks being tracked.zDestroy segment r� N) r r� r r� r r � SharedMemoryr� �unlink)r/ r� Zsegmentr r r �destroy_segment� s z$_SharedMemoryTracker.destroy_segmentc C s" | j dd� D ]}| �|� qdS )z<Calls destroy_segment() on all tracked shared memory blocks.N)r� r� r� r r r r� � s �z_SharedMemoryTracker.unlinkc C s( t �d| jj� dt� � �� | �� d S )NzCall z .__del__ in )r r� r7 r8 r r� r1 r r r �__del__� s z _SharedMemoryTracker.__del__c C s | j | jfS r r� r1 r r r r2 � r� z!_SharedMemoryTracker.__getstate__c C s | j |� d S r )r0 r4 r r r r6 � r* z!_SharedMemoryTracker.__setstate__N) r8 r: r; r< r0 r� r� r� r� r2 r6 r r r r r� � s r� c @ sJ e Zd Zejg d� Zdd� Zdd� Zdd� Zdd � Zd d � Z d d � Z dS )�SharedMemoryServer)� track_segment�release_segment� list_segmentsc O s` t j| g|�R i |�� | j}t|t�rt�|�}td|� dt� � ��| _ t � dt� � �� d S )NZshm_rY z"SharedMemoryServer started by pid ) r[ r0 r- rL rh �os�fsdecoder� r �shared_memory_contextr r� )r/ rD �kwargsr- r r r r0 � s �zSharedMemoryServer.__init__c O s: t | j| d d�r| j|d< tj| ||g|�R i |��S )z�Create a new distributed-shared object (not backed by a shared memory block) and return its id to be used in a Proxy Object.r# Z_shared_memory_proxyr� )r� ri r� r[ r] )r/ rB r, rD r� r r r r] s zSharedMemoryServer.createc C s | j �� t�| |�S )zACall unlink() on all tracked shared memory, terminate the Server.)r� r� r[ r\ r� r r r r\ s zSharedMemoryServer.shutdownc C � | j �|� dS )z?Adds the supplied shared memory block name to Server's tracker.N)r� r� �r/ rB r� r r r r� s z SharedMemoryServer.track_segmentc C r� )z�Calls unlink() on the shared memory block with the supplied name and removes it from the tracker instance inside the Server.N)r� r� r� r r r r� s z"SharedMemoryServer.release_segmentc C s | j jS )zbReturns a list of names of shared memory blocks that the Server is currently tracking.)r� r� r� r r r r� s z SharedMemoryServer.list_segmentsN) r8 r: r; r[ r� r0 r] r\ r� r� r� r r r r r� � s � r� c @ s< e Zd ZdZeZdd� Zdd� Zdd� Zdd � Z d d � Z d S ) r a� Like SyncManager but uses SharedMemoryServer instead of Server. It provides methods for creating and returning SharedMemory instances and for creating a list-like object (ShareableList) backed by shared memory. It also provides methods that create and return Proxy Objects that support synchronization across processes (i.e. multi-process-safe locks and semaphores). c O sT t jdkrddlm} |�� tj| g|�R i |�� t�| j j � dt � � �� d S )N�posixr )�resource_trackerz created by pid ) r� r � r� Zensure_runningr r0 r r� r7 r8 r )r/ rD r� r� r r r r0 / s z SharedMemoryManager.__init__c C s t �| jj� dt� � �� d S )Nz.__del__ by pid )r r� r7 r8 r r1 r r r r� ; s zSharedMemoryManager.__del__c C sd | j jtjkr&| j jtjkrtd��| j jtjkr td��td�| j j���| �| j | j | j | j �S )z@Better than monkeypatching for now; merge into Server ultimatelyz"Already started SharedMemoryServerz!SharedMemoryManager has shut downr� ) r� r� r� r� r� r r� rO r� r� r� r� r� r1 r r r r� ? s � �z SharedMemoryManager.get_serverc C s� | j | j| jd��/}tjdd|d�}z t|dd|jf� W n ty/ } z|�� |�d}~ww W d � |S 1 s;w Y |S )zoReturns a new SharedMemory instance with the specified size in bytes, to be tracked by the manager.r� NT)r] �sizer� ) r� r� r� r r� rH r � BaseExceptionr� )r/ r� r� Zsmsr� r r r r� L s ��� ��z SharedMemoryManager.SharedMemoryc C s� | j | j| jd��.}t�|�}z t|dd|jjf� W n ty. } z|j� � |�d}~ww W d � |S 1 s:w Y |S )z�Returns a new ShareableList instance populated with the values from the input sequence, to be tracked by the manager.r� Nr� ) r� r� r� r � ShareableListrH Zshmr r� r� )r/ rC r� Zslr� r r r r� X s ��� ��z!SharedMemoryManager.ShareableListN) r8 r: r; r< r� r� r0 r� r� r� r� r r r r r # s r0 rB )U�__all__r� rq r� r �queuerW rn r� r r� r r� r �contextr r r r r r r r � ImportErrorZ HAS_SHMEMrU r r Z view_typesr& r) Z view_typerh r rH rA r� rP rX rZ r[ r� ru rv Z XmlListenerZ XmlClientrl r r� r r r- r5 r r6 r9 rD rE rL rQ rZ r\ re rm rq r� r� r r� Z BasePoolProxyr� r r� rx rr r� r� r� r� r� r� r� r� r� r r r r r �<module> s� � P � w 4 � � � �%-�
Save File
Cancel