Dashboard
PHP:
8.2.30
OS:
Linux
User:
dh_nv8b2m
/
/
usr
/
lib
/
python3
/
dist-packages
/
sphinx
/
util
/
__pycache__
📤 Upload
📝 New File
📁 New Folder
Close
Editing: parallel.cpython-310.pyc
o �$�a � @ s d Z ddlZddlZddlZddlZddlZddlmZ ddlm Z m Z m Z m Z m Z mZ zddlZW n ey= dZY nw ddlmZ ddlmZ e�e�Zeoaejdkoaejdko`e�� d k ZG d d � d �Z G d d � d �Z ddee de de de e fdd�Z dS )z� sphinx.util.parallel ~~~~~~~~~~~~~~~~~~~~ Parallel building utilities. :copyright: Copyright 2007-2021 by the Sphinx team, see AUTHORS. :license: BSD, see LICENSE for details. � N)�sqrt)�Any�Callable�Dict�List�Optional�Sequence)�SphinxParallelError)�logging�posix)� � �Darwinc @ sJ e Zd ZdZddeddfdd�Zdded ed eddfd d �Zdd d�Z dS )� SerialTaskszEHas the same interface as ParallelTasks, but executes tasks directly.� �nproc�returnNc C � d S �N� ��selfr r r �6/usr/lib/python3/dist-packages/sphinx/util/parallel.py�__init__* � zSerialTasks.__init__� task_func�arg� result_funcc C s, |d ur ||�}n|� }|r||� d S d S r r )r r r r �resr r r �add_task- s �zSerialTasks.add_taskc C r r r �r r r r �join5 r zSerialTasks.join�r �NN�r N) �__name__� __module__� __qualname__�__doc__�intr r r r r! r r r r r ' s r c @ sz e Zd ZdZdeddfdd�Zdeded eddfd d �Zdd ed ed eddfdd�Z ddd�Z ddd�Z de fdd�Z dS )� ParallelTasksz1Executes *nproc* tasks in parallel after forking.r r Nc C s4 || _ i | _i | _i | _i | _i | _d| _d| _d S )Nr )r � _result_funcs�_args�_procs�_precvs�_precvsWaiting� _pworking�_taskidr r r r r < s zParallelTasks.__init__�pipe�funcr c C s� z(t �� }|�� � |d u r|� }n||�}W d � n1 s w Y d}W n% tyM } zd}t�|j|�d �� }|t�� f}W Y d }~nd }~ww t � |j � |� ||j |f� d S )NFTr ) r � LogCollector�collect� BaseException� traceback�format_exception_only� __class__�strip� format_exc�convert_serializable�logs�send) r r2 r3 r � collector�ret�failed�err�errmsgr r r �_processM s" � ��� zParallelTasks._processr r c C st | j }| j d7 _ |pdd� | j|< || j|< t�d�\}}tj| j|||fd�}|| j|< || j|< | � � d S )Nr c S r r r )r �resultr r r �<lambda>` s z(ParallelTasks.add_task.<locals>.<lambda>F)�target�args) r1 r+ r, �multiprocessing�Pipe�ProcessrD r- r/ � _join_one)r r r r �tid�precv�psend�procr r r r ] s � zParallelTasks.add_taskc C sD z| j r| �� s t�d� | j sW d S W d S ty! | �� � w )Ng{�G�z�?)r0 rL �time�sleep� Exception� terminater r r r r! i s � �zParallelTasks.joinc C sT t | j�D ]"}| j| �� | j�|� | j�|� | j�|� | jd8 _qd S )Nr )�listr. r- rT r+ �popr0 )r rM r r r rT s s �zParallelTasks.terminatec C s� d}| j �� D ]D\}}|�� rK|�� \}}}|r t|� �|D ]}t�|� q | j�|�| j �|�|� | j | � � | j �|� | j d8 _ d} nq| j rx| j | jk rx| j �� \}} | | j |< | j | �� | j d7 _ | j rx| j | jk sU|S )NFr T)r. �items�poll�recvr �logger�handler+ rV r, r- r! r0 r/ r �popitem�start) r � joined_anyrM r2 �excr= rE �log�newtid�newprecvr r r rL { s, � �zParallelTasks._join_oner# r$ )r% r& r' r( r) r r r rD r r! rT �boolrL r r r r r* 9 s r* � � argumentsr �maxbatchr c sj t � �}|| ��|krtt|| | ����dkr d�t|��\}}|r)|d7 }� �fdd�t|�D �S )Nr r c s$ g | ]}� |� |d � � �qS r" r )�.0�i�re � chunksizer r � <listcomp>� s $ z make_chunks.<locals>.<listcomp>)�lenr) r �divmod�range)re r rf �nargs�nchunks�restr ri r � make_chunks� s rr )rd )!r( �os�platform�sysrQ r7 �mathr �typingr r r r r r rI � ImportError� sphinx.errorsr � sphinx.utilr � getLoggerr% rZ �name� version_info�system�parallel_availabler r* �strr) rr r r r r �<module> s0 � ��([
Save
Cancel