Dashboard
PHP:
8.2.30
OS:
Linux
User:
dh_nv8b2m
/
/
usr
/
lib
/
python3
/
dist-packages
/
mercurial
/
__pycache__
📤 Upload
📝 New File
📁 New Folder
Close
Editing: bundle2.cpython-310.pyc
o �]Lb�Z � @ s& d Z ddlmZmZ ddlZddlZddlZddlZddlZddl Z ddl Z ddl m Z ddl mZmZ ddlmZmZmZmZmZmZmZmZmZmZmZm Z m Z m Z ddl m Z m!Z! dd l"m#Z# e j$Z$e j%Z%e j&Z'e j(Z)d Z*d Z+d Z,d Z-d Z.d Z/dZ0e�1d�Z2dd� Z3dd� Z4dd� Z5dd� Z6i Z7d�dd�Z8G dd � d e9�Z:G d d � d e9�Z;G d d � d e<�Z=d!d"� Z>d�d#d$�Z?G d%d&� d&e9�Z@d�d(d)�ZAd*d+� ZBd,d-� ZCd.d/� ZDd0d1� ZEd2d3� ZFd4d5� ZGd6dd7d8d9d:�ZHg d;�ZIG d<d=� d=e9�ZJG d>d?� d?e9�ZKd�d@dA�ZLG dBdC� dCeK�ZMdDeMiZNi ZOdEdF� ZPePdG�dHdI� �ZQG dJdK� dKe9�ZRdLZSG dMdN� dNeK�ZTG dOdP� dPe9�ZUdQdR� ZVG dSdT� dTeK�ZWG dUdV� dVeW�ZXdddWddeYeZe j[�\� ��dXddYdZd[� Z]d�d]d^�Z^d_d`� Z_dadb� Z` d�dcdd�Zadedf� Zbdgdh� Zcdidj� Zddkdl� Zedmdn� Zfdodp� Zgdqdr� Zhdsdt� Zidudv� Zjd�dxdy�Zk d�dzd{�Zld|d}� Zme8d~d�d�d�� �ZneYg d��d�d�� e j[�\� D � �Zoe8d�eo�d�d�� �Zpe8d�d��d�d�� �Zqe8d��d�d�� �Zre8d��d�d�� �Zse8d��d�d�� �Zte8d��d�d�� �Zue8d��d�d�� �Zve8d��d�d�� �ZwG d�d�� d�ejx�Zye8d�d��d�d�� �Zze8d�d��d�d�� �Z{e8d�d��d�d�� �Z|e8d�d��d�d�� �Z}e8d�d��d�d�� �Z~e8d�d��d�d�� �Ze8d��d�d�� �Z�e8d��d�d�� �Z�e8d�d��d�d�� �Z�e8d��d�dÄ �Z�e8d�dŃd�dDŽ �Z�e8dȃd�dʄ �Z�e ��dˡZ�e8d̃d�d΄ �Z�e8dσd�dф �Z�e8d�dӃd�dՄ �Z�d�dׄ Z�dS )�a� Handling of the new bundle2 format The goal of bundle2 is to act as an atomically packet to transmit a set of payloads in an application agnostic way. It consist in a sequence of "parts" that will be handed to and processed by the application layer. General format architecture =========================== The format is architectured as follow - magic string - stream level parameters - payload parts (any number) - end of stream marker. the Binary format ============================ All numbers are unsigned and big-endian. stream level parameters ------------------------ Binary format is as follow :params size: int32 The total number of Bytes used by the parameters :params value: arbitrary number of Bytes A blob of `params size` containing the serialized version of all stream level parameters. The blob contains a space separated list of parameters. Parameters with value are stored in the form `<name>=<value>`. Both name and value are urlquoted. Empty name are obviously forbidden. Name MUST start with a letter. If this first letter is lower case, the parameter is advisory and can be safely ignored. However when the first letter is capital, the parameter is mandatory and the bundling process MUST stop if he is not able to proceed it. Stream parameters use a simple textual format for two main reasons: - Stream level parameters should remain simple and we want to discourage any crazy usage. - Textual data allow easy human inspection of a bundle2 header in case of troubles. Any Applicative level options MUST go into a bundle2 part instead. Payload part ------------------------ Binary format is as follow :header size: int32 The total number of Bytes used by the part header. When the header is empty (size = 0) this is interpreted as the end of stream marker. :header: The header defines how to interpret the part. It contains two piece of data: the part type, and the part parameters. The part type is used to route an application level handler, that can interpret payload. Part parameters are passed to the application level handler. They are meant to convey information that will help the application level object to interpret the part payload. The binary format of the header is has follow :typesize: (one byte) :parttype: alphanumerical part name (restricted to [a-zA-Z0-9_:-]*) :partid: A 32bits integer (unique in the bundle) that can be used to refer to this part. :parameters: Part's parameter may have arbitrary content, the binary structure is:: <mandatory-count><advisory-count><param-sizes><param-data> :mandatory-count: 1 byte, number of mandatory parameters :advisory-count: 1 byte, number of advisory parameters :param-sizes: N couple of bytes, where N is the total number of parameters. Each couple contains (<size-of-key>, <size-of-value) for one parameter. :param-data: A blob of bytes from which each parameter key and value can be retrieved using the list of size couples stored in the previous field. Mandatory parameters comes first, then the advisory ones. Each parameter's key MUST be unique within the part. :payload: payload is a series of `<chunksize><chunkdata>`. `chunksize` is an int32, `chunkdata` are plain bytes (as much as `chunksize` says)` The payload part is concluded by a zero size chunk. The current implementation always produces either zero or one chunk. This is an implementation limitation that will ultimately be lifted. `chunksize` can be negative to trigger special case processing. No such processing is in place yet. Bundle processing ============================ Each part is processed in order using a "part handler". Handler are registered for a certain part type. The matching of a part to its handler is case insensitive. The case of the part type is used to know if a part is mandatory or advisory. If the Part type contains any uppercase char it is considered mandatory. When no handler is known for a Mandatory part, the process is aborted and an exception is raised. If the part is advisory and no handler is known, the part is ignored. When the process is aborted, the full bundle is still read from the stream to keep the channel usable. But none of the part read from an abort are processed. In the future, dropping the stream may become an option for channel we do not care to preserve. � )�absolute_import�divisionN� )�_)�hex�short)� bookmarks� changegroup�encoding�error�obsolete�phases�pushkey�pycompat� requirements�scmutil� streamclone�tags�url�util)� stringutil�urlutil)� repositorys >is >Bs >Is >BB� � s [^a-zA-Z0-9_:-]c C �" | � dd�r| �d| � dS dS )z(debug regarding output stream (bundling)� devel� bundle2.debugs bundle2-output: %s N�� configbool�debug��ui�message� r# �3/usr/lib/python3/dist-packages/mercurial/bundle2.py�outdebug� � �r% c C r )z"debug on input stream (unbundling)r r s bundle2-input: %s Nr r r# r# r$ �indebug� r& r' c C s t �| �r t| ��dS )z9raise ValueError if a parttype contains invalid characterN)�_parttypeforbidden�search� ValueError��parttyper# r# r$ �validateparttype� s �r- c C s dd| S )z�return a struct format to read part parameter sizes The number parameters is variable so we need to build that format dynamically. � >s BBr# )�nbparamsr# r# r$ �_makefpartparamsizes� s r0 r# c s t �� � �fdd�}|S )z�decorator that register a function as a bundle2 part handler eg:: @parthandler('myparttype', ('mandatory', 'param', 'handled')) def myparttypehandler(...): '''process a part of type "my part".''' ... c s* �� � }|tvs J �| t|< t� �| _| S �N)�lower�parthandlermapping� frozenset�params)�func� lparttype�r5 r, r# r$ � _decorator� s z parthandler.<locals>._decorator)r- )r, r5 r9 r# r8 r$ � parthandler� s r: c @ sN e Zd ZdZdd� Zddd�Zdd� Zd d � Zd d � Zd d� Z dd� Z e Z dS )�unbundlerecordsa� keep record of what happens during and unbundle New records are added using `records.add('cat', obj)`. Where 'cat' is a category of record and obj is an arbitrary object. `records['cat']` will return all entries of this category 'cat'. Iterating on the object itself will yield `('category', obj)` tuples for all entries. All iterations happens in chronological order. c C s i | _ g | _i | _d S r1 )� _categories� _sequences�_replies��selfr# r# r$ �__init__ � zunbundlerecords.__init__Nc C sF | j �|g ��|� | j�||f� |dur!| �|��||� dS dS )z�add a new record of a given category. The entry can then be retrieved in the list returned by self['category'].N)r< � setdefault�appendr= � getreplies�add)r@ �category�entry� inreplytor# r# r$ rF s �zunbundlerecords.addc C s | j �|t� �S )z3get the records that are replies to a specific part)r> rC r; )r@ �partidr# r# r$ rE s zunbundlerecords.getrepliesc C s t | j�|d��S )Nr# )�tupler< �get)r@ �catr# r# r$ � __getitem__ s zunbundlerecords.__getitem__c C � t | j�S r1 )�iterr= r? r# r# r$ �__iter__# � zunbundlerecords.__iter__c C rO r1 )�lenr= r? r# r# r$ �__len__& rR zunbundlerecords.__len__c C rO r1 )�boolr= r? r# r# r$ � __nonzero__) rR zunbundlerecords.__nonzero__r1 ) �__name__� __module__� __qualname__�__doc__rA rF rE rN rQ rT rV �__bool__r# r# r# r$ r; � s r; c @ s* e Zd ZdZd dd�Zdd� Zdd � Zd S ) �bundleoperationaP an object that represents a single bundling process Its purpose is to carry unbundle-related objects and states. A new object should be created at the beginning of each bundle processing. The object is to be returned by the processing function. The object has very little content now it will ultimately contain: * an access to the repo the bundle is applied to, * a ui object, * a way to retrieve a transaction to add changes to the repo, * a way to record the result of processing each part, * a way to construct a bundle response when applicable. T� c C s> || _ |j| _t� | _d | _|| _i | _|| _i | _|| _ d S r1 ) �repor! r; �records�reply� captureoutput�hookargs�_gettransaction�modes�source)r@ r^ �transactiongetterra re r# r# r$ rA ? s zbundleoperation.__init__c C s. | � � }| jr| j�|j� | j|_d | _|S r1 )rc rb �update)r@ � transactionr# r# r$ �gettransactionK s z bundleoperation.gettransactionc C s$ | j d u r t�d��| j �|� d S )Ns@ attempted to add hookargs to operation after transaction started)rb r �ProgrammingErrorrg )r@ rb r# r# r$ � addhookargsZ s �zbundleoperation.addhookargsN)Tr] )rW rX rY rZ rA ri rk r# r# r# r$ r\ / s r\ c @ s e Zd ZdS )�TransactionUnavailableN)rW rX rY r# r# r# r$ rl c s rl c C s t � �)z�default method to get a transaction while processing a bundle Raise an exception to highlight the fact that no transaction was expected to be created�rl r# r# r# r$ �_notransactiong s rn c s� t |t�r2d� jd< |d urd� jvr|� jd< |d ur&d� jvr&|� jd< t| |� fdd�|d�S t| � fdd�|d�}t||� ||fi |�� |S ) N� 1� bundle2s source� urlc � � S r1 r# r# ��trr# r$ �<lambda>w � z applybundle.<locals>.<lambda>�re c rr r1 r# r# rs r# r$ ru z rv )� isinstance� unbundle20rb � processbundler\ �_processchangegroup)r^ � unbundlerrt re r �kwargs�opr# rs r$ � applybundleo s r c @ s$ e Zd Zdd� Zdd� Zdd� ZdS )� partiteratorc C s( || _ || _|| _d | _d| _d | _d S )Nr )r^ r~ r| �iterator�count�current)r@ r^ r~ r| r# r# r$ rA � s zpartiterator.__init__c s � fdd�}|� � _ � j S )Nc 3 sD � t � j�� d�} | D ]\}}|� _|� _|V |�� d � _q d S )Nr )� enumerater| � iterpartsr� r� �consume)�itrr� �pr? r# r$ r6 � s � �z$partiterator.__enter__.<locals>.func)r� )r@ r6 r# r? r$ � __enter__� s zpartiterator.__enter__c C s� | j sd S t|t�rNd}z| jr| j�� | j D ]}|�� qW n ty+ d}Y nw d|_g }d }| jjd urD| jj�� }| jjj }||_ ||_ |rN|�| j j �d| j � d S )NFTs% bundle2-input-bundle: %i parts total )r� rx � Exceptionr� r� �duringunbundle2r~ r` � salvageoutput� capabilities� _replycaps�_bundle2salvagedoutputr^ r! r r� )r@ �type�exc�tb� seekerror�part�salvaged� replycapsr# r# r$ �__exit__� s4 � � �zpartiterator.__exit__N)rW rX rY rA r� r� r# r# r# r$ r� s r� r] c C s� |du r|du r t }t| ||d�}|j | jjrKdg}|jr(|�dt|j� � |jdu s2|jt u r8|�d� n|�d� |�d� | j�d� |�� t | ||� |S ) a, This function process a bundle, apply effect to/from a repo It iterates over each part then searches for and uses the proper handling code to process the part. Parts are processed in order. Unknown Mandatory part will abort the process. It is temporarily possible to provide a prebuilt bundleoperation to the function. This is used to ensure output is properly propagated in case of an error during the unbundling. This output capturing part will likely be reworked and this ability will probably go away in the process. Nrw s bundle2-input-bundle:s %i paramss no-transactions with-transaction� r] ) rn r\ r5 r! � debugflagrD rS rc r �join� processparts)r^ r| rf r~ re �msgr# r# r$ rz � s rz c C sF t | ||��}|D ]}t||� q W d � d S 1 s w Y d S r1 )r� � _processpart)r^ r~ r| �partsr� r# r# r$ r� � s �"�r� c K s0 |j | j|||fi |��}| j�dd|i� |S )N� changegroup� return)�applyr^ r_ rF )r~ �cgrt re r r} �retr# r# r$ r{ � s ��r{ c C s� d}�zz?t �|j�}|d u rd}tj|jd��t| jd|j � |j|j }|r@t |�}|� � dd� |� }tj|j|d��d}W nq tjy� } zd|j rP� t| jd | � W Y d }~W | jj r�d |j g}|j sp|�d � t|j�}t|j�| }|s�|r�|�d � |r�|�d | � |r�|�d| � |�d� |�d| � | j�d� |�� d S d S d }~ww W | jj �rd |j g}|j s�|�d � t|j�}t|j�| }|s�|r�|�d � |r�|�d | � |r�|�d| � |�d� |�d| � | j�d� |�� |S | jj �r\d |j g}|j �s|�d � t|j�}t|j�| }|�s-|�rK|�d � |�r<|�d | � |�rF|�d| � |�d� |�d| � | j�d� |�� w w )Ns unknowns unsupported-typer+ s found a handler for part %ss unsupported-params (%s)s , )r, r5 s supporteds% ignoring unsupported advisory part %ss bundle2-input-part: "%s"� (advisory)� (params:� %i mandatory� %i advisory� )s %s r] )r3 rL r� r �BundleUnknownFeatureErrorr' r! � mandatorykeysr5 �list�sortr� � mandatoryr� rD rS r ) r~ r� �status�handler� unknownparamsr� r� �nbmp�nbapr# r# r$ � _gethandler� s� � ���� � �r� c C s� t | |�}|du r dS d}| jr | jdur | jjddd� d}z*|| |� W |dur/| j�� }|rH| jjd|dd�}|jdt� |j �dd � dS dS |durS| j�� }|rk| jjd|dd�}|jdt� |j �dd � w w ) z�process a single part from a bundle The part is guaranteed to have been fully consumed when the function exits (even if an exception is raised).NT)r �subprocr] � outputF��datar� � in-reply-to�r� ) r� ra r` r! � pushbuffer� popbuffer�newpart�addparamr �bytestr�id)r~ r� r� �output�outpartr# r# r$ r� & s2 ��� ��r� c C sj i }| � � D ],}|s qd|vr|d}}n |�dd�\}}|�d�}t�|�}dd� |D �}|||< q|S )z�decode a bundle2 caps bytes blob into a dictionary The blob is a list of capabilities (one per line) Capabilities may have values using a line of the form:: capability=value1,value2,value3 The values are always a list.� =r# r � ,c S � g | ]}t �|��qS r# ��urlreq�unquote��.0�vr# r# r$ � <listcomp>V � z decodecaps.<locals>.<listcomp>)� splitlines�splitr� r� )�blob�caps�line�key�valsr# r# r$ � decodecapsC s r� c C s\ g }t | �D ]"}| | }t�|�}dd� |D �}|r#d|d�|�f }|�|� qd�|�S )z2encode a bundle2 caps dictionary into a bytes blobc S r� r# )r� �quoter� r# r# r$ r� a r� z encodecaps.<locals>.<listcomp>� %s=%sr� r� )�sortedr� r� r� rD )r� �chunks�car� r# r# r$ � encodecaps[ s r� )r] � UN)� HG10UNr� )� HG10s BZ)� HG10GZs GZ)r] � HG20r� � HG10BZr� )r� r� r� c @ sn e Zd ZdZdZddd�Zddd�Zed d � �Zdd d �Z d d� Z dd� Z dd� Z dd� Z dd� Zdd� ZdS )�bundle20z�represent an outgoing bundle2 container Use the `addparam` method to add stream level parameter. and `newpart` to populate it. Then call `getchunks` to retrieve all the binary chunks of data that compose the bundle2 container.r� r# c C s: || _ g | _g | _t|�| _tj�d�| _d | _ d| _ d S )Nr� T) r! �_params�_parts�dictr� r � compengines� forbundletype� _compengine� _compopts�prefercompressed)r@ r! r� r# r# r$ rA s zbundle20.__init__Nc C sH |dv rdS t dd� | jD ��rJ �| �d|� tj�|�| _|| _dS )z$setup core part compression to <alg>)Nr� Nc s s � | ] \}}|� � d kV qdS )� compressionN)r2 )r� �nr� r# r# r$ � <genexpr>� s � z*bundle20.setcompression.<locals>.<genexpr>s Compression)�anyr� r� r r� r� r� r� )r@ �alg�compoptsr# r# r$ �setcompression� s zbundle20.setcompressionc C rO )z*total number of parts added to the bundler)rS r� r? r# r# r$ �nbparts� � zbundle20.nbpartsc C sH |st �d��|dd� t�tj�vrt �d| ��| j�||f� dS )z add a stream level parameters empty parameter namer r s non letter first character: %sN)r rj r r� �string� ascii_lettersr� rD )r@ �name�valuer# r# r$ r� � s ��zbundle20.addparamc C s* |j du sJ �t| j�|_ | j�|� dS )z_add a new part to the bundle2 container Parts contains the actual applicative payload.N)r� rS r� rD )r@ r� r# r# r$ �addpart� s zbundle20.addpartc O s$ t |g|�R i |��}| �|� |S )aq create a new part and add it to the containers As the part is directly added to the containers. For now, this means that any failure to properly initialize the part after calling ``newpart`` should result in a failure of the whole bundling process. You can still fall back to manually create and add if you need better control.)� bundlepartr� )r@ �typeid�argsr} r� r# r# r$ r� � s zbundle20.newpartc c s� � | j jr+d| j g}| jr|�dt| j� � |�dt| j� � | j �d�|�� t | j d| j � | jV | � � }t | j d| � t t t|��V |rQ|V | j �| �� | j�D ]}|V q[d S )Ns bundle2-output-bundle: "%s",s (%i params)s %i parts total r] s start emission of %s streams bundle parameter: %s)r! r� � _magicstringr� rD rS r� r r� r% � _paramchunk�_pack�_fstreamparamsizer� �compressstream� _getcorechunkr� )r@ r� �param�chunkr# r# r$ � getchunks� s& � ��zbundle20.getchunksc C sP g }| j D ] \}}t�|�}|dur t�|�}d||f }|�|� qd�|�S )z1return a encoded version of all stream parametersNr� � )r� r� r� rD r� )r@ �blocks�parr� r# r# r$ r� � s zbundle20._paramchunkc c sb � t | jd� | jD ]}t | jd|j � |j| jd�D ]}|V q q t | jd� ttd�V dS )zUyield chunk for the core part of the bundle (all but headers and parameters)s start of partss bundle part: "%s"�r! s end of bundler N)r% r! r� r� r r� �_fpartheadersize)r@ r� r r# r# r$ r � s � � zbundle20._getcorechunkc C s. g }| j D ]}|j�d�r|�|�� � q|S )z�return a list with a copy of all output parts in the bundle This is meant to be used during error handling to make sure we preserve server outputr� )r� r� � startswithrD �copy)r@ r� r� r# r# r$ r� � s �zbundle20.salvageoutput�r# r1 )rW rX rY rZ r� rA r� �propertyr� r� r� r� r r� r r� r# r# r# r$ r� v s r� c @ s( e Zd ZdZdd� Zdd� Zdd� ZdS ) � unpackermixinz6A mixin to extract bytes and struct data from a streamc C s || _ d S r1 )�_fp)r@ �fpr# r# r$ rA � rR zunpackermixin.__init__c C � | � t�|��}t||�S )a unpack this struct format from the stream This method is meant for internal usage by the bundle2 protocol only. They directly manipulate the low level stream including bundle2 level instruction. Do not use it to implement higher-level logic or methods.)� _readexact�struct�calcsize�_unpack�r@ �formatr� r# r# r$ r � s zunpackermixin._unpackc C s t �| j|�S )a read exactly <size> bytes from the stream This method is meant for internal usage by the bundle2 protocol only. They directly manipulate the low level stream including bundle2 level instruction. Do not use it to implement higher-level logic or methods.)r � readexactlyr )r@ �sizer# r# r$ r s zunpackermixin._readexactN)rW rX rY rZ rA r r r# r# r# r$ r � s r c C s� |du r t �|d�}|dd� |dd� }}|dkr+| �d||f � t�td���t�|�}|du r=t�td�| ��|| |�}t| d | � |S ) z7return a valid unbundler object for a given magicstringN� r � s HGs6 error: invalid magic: %r (version %r), should be 'HG' s not a Mercurial bundles unknown bundle version %ss start processing of %s stream) r r r r �Abortr � formatmaprL r' )r! r � magicstring�magic�version�unbundlerclassr| r# r# r$ � getunbundler s �� r! c sl e Zd ZdZdZ� fdd�Zejdd� �Zdd� Z d d � Z d d � Z ddd�Z dd� Z dd� Zdd� Z� ZS )ry z|interpret a bundle2 stream This class is fed with a binary stream and yields parts through its `iterparts` methods.r� c s. || _ tj�d�| _d| _tt| ��|� dS )z<If header is specified, we do not read it out of the stream.r� N) r! r r� r� r� � _compressed�superry rA �r@ r! r �� __class__r# r$ rA ) s zunbundle20.__init__c C sP t | jd� i }| �t�d }|dk rt�d| ��|r&| �|�}| �|�}|S )z%dictionary of stream level parameterss! reading bundle2 stream parametersr � negative bundle param size: %i)r' r! r r� r �BundleValueErrorr �_processallparams)r@ r5 � paramssizer# r# r$ r5 0 s � zunbundle20.paramsc C sf t �� }|�d�D ]'}|�dd�}dd� |D �}t|�dk r#|�d� | j|� |d ||d < q |S ) � r r� r c S r� r# r� )r� �ir# r# r$ r� D r� z0unbundle20._processallparams.<locals>.<listcomp>r Nr )r �sortdictr� rS rD � _processparam)r@ � paramsblockr5 r� r# r# r$ r) ? s z unbundle20._processallparamsc C s� |st d��|dd� t�tj�vrt d| ��zt|�� }W n! tyA |dd� �� r:t | j d| � Y dS t j |fd��w || ||� dS )a� process a parameter, applying its effect if needed Parameter starting with a lower case letter are advisory and will be ignored when unknown. Those starting with an upper case letter are mandatory and will this function will raise a KeyError when unknown. Note: no option are currently supported. Any input will be either ignored or failing. zempty parameter namer r z non letter first character: %ss ignoring unknown parameter %s)r5 N) r* r r� r� r� �b2streamparamsmapr2 �KeyError�islowerr' r! r r� )r@ r� r� r� r# r# r$ r. K s � �zunbundle20._processparamc c sL � | j V dt| �vs J �| �t�d }|dk r t�d| ��|rY| �|�}| �|� g }|�d�D ]}|�dd�\}}|� � dkrG|� |� q2d� |�}t tt |��V |V nt t|�V | j�| j�| _d}|dk r�ttkssJ �| �t�d }t t|�V |r�d}n|d7 }qi|tkr�qi|dk r�t�d ��| �|�V |dk smd S d S ) aW utility to transfer a bundle2 as binary This is made necessary by the fact the 'getbundle' command over 'ssh' have no way to know then the reply end, relying on the bundle to be interpreted to know its end. This is terrible and we are sorry, but we needed to move forward to get general delta enabled. r5 r r' r r� r r� r s negative chunk size: %iN)r� �varsr r� r r( r r) r� r2 rD r� r� rS r� �decompressorreaderr r � _fpayloadsize� flaginterrupt) r@ r* r5 � outparamsr� �kr� � emptycountr r# r# r$ �_forwardchunkse sJ �� � �zunbundle20._forwardchunksFc c s~ � |rt nt}| j | j�| j�| _t| jd� | �� }|dur7|| j|| j�}|V |� � | �� }|dus t| jd� dS )z'yield all parts contained in the streams! start extraction of bundle2 partsNs end of bundle2 stream) �seekableunbundlepart� unbundlepartr5 r� r4 r r' r! �_readpartheaderr� )r@ �seekable�cls� headerblockr� r# r# r$ r� � s � �zunbundle20.iterpartsc C �F | � t�d }|dk rt�d| ��t| jd| � |r!| �|�S dS )�Qreads a part header size and return the bytes blob returns None if emptyr � negative part header size: %is part header size: %iN�r r r r( r' r! r �r@ � headersizer# r# r$ r= � � � zunbundle20._readpartheaderc C s | j | jS r1 )r5 r" r? r# r# r$ � compressed� s zunbundle20.compressedc C s t �| jd�r | j�� S dS )zclose underlying file�closeN)r � safehasattrr rI r? r# r# r$ rI � s �zunbundle20.close)F)rW rX rY rZ r� rA r � propertycacher5 r) r. r: r� r= rH rI � __classcell__r# r# r% r$ ry ! s 1ry s 20c s � fdd�}|S )z/register a handler for a stream level parameterc s � t vsJ �| t� < | S r1 )r r0 )r6 �r� r# r$ � decorator� s z'b2streamparamhandler.<locals>.decoratorr# )r� rN r# rM r$ �b2streamparamhandler� s rO r� c C sB |t jjvrtj|f|fd��t j�|�| _|dur d| _dS dS )z<read compression parameter and install payload decompression)r5 �valuesNT)r r� �supportedbundletypesr r� r� r� r" )r| r r� r# r# r$ �processcompression� s �rR c @ s~ e Zd ZdZ ddd�Zdd� Zd d � Zed d � �Zej d d � �Zedd� �Z edd� �Z ddd�Z dd� Z dd� ZdS )r� a A bundle2 part contains application level payload The part `type` is used to route the part to the application level handler. The part payload is contained in ``part.data``. It could be raw bytes or a generator of byte chunks. You can add parameters to the part using the ``addparam`` method. Parameters can be either mandatory (default) or advisory. Remote side should be able to safely ignore the advisory ones. Both data and parameters cannot be modified after the generation has begun. r# r] Tc C s� t |� d | _|| _|| _t|�| _t|�| _t� | _| j| j D ]\}}|| jv r1t � d| ��| j� |� q!d | _ || _ d S )N� duplicated params: %s)r- r� r� �_datar� �_mandatoryparams�_advisoryparams�set� _seenparamsr rj rF � _generatedr� )r@ r, �mandatoryparams�advisoryparamsr� r� �pname�__r# r# r$ rA � s zbundlepart.__init__c C s0 d| j j| j jf }d|t| �| j| j| jf S )Nz%s.%sz2<%s object at %x; id: %s; type: %s; mandatory: %s>)r& rX rW r� r� r� )r@ r? r# r# r$ �__repr__ s �zbundlepart.__repr__c C s. t �| jd�r J �| �| j| j| j| j| j�S )z�return a copy of the part The new part have the very same content but no partid assigned yet. Parts with generated data cannot be copied.�next) r rJ r� r& r� rU rV rT r� r? r# r# r$ r s �zbundlepart.copyc C � | j S r1 )rT r? r# r# r$ r� s zbundlepart.datac C s | j d ur t�d��|| _d S )N� part is being generated)rY r �ReadOnlyPartErrorrT )r@ r� r# r# r$ r� # s c C rO r1 )rK rU r? r# r# r$ rZ ) r� zbundlepart.mandatoryparamsc C rO r1 )rK rV r? r# r# r$ r[ . r� zbundlepart.advisoryparamsc C sX | j dur t�d��|| jv rtd| ��| j�|� | j}|r#| j}|�||f� dS )z�add a parameter to the part If 'mandatory' is set to True, the remote handler must claim support for this parameter or the unbundling will be aborted. The 'name' and 'value' cannot exceed 255 bytes each. Nra rS ) rY r rb rX r* rF rV rU rD )r@ r� r� r� r5 r# r# r$ r� 3 s zbundlepart.addparamc c s� � | j d ur t�d��d| _ |jr}d| j g}| js |�d� t| j�}t| j �}|s-|rI|�d� |r;|�d| � |rD|�d| � |�d� | j sR|�d � n t � | j d �s`t � | j d �rf|�d � n |�d t| j � � |�d� |� d�|�� | jr�| j�� }n| j�� }t|dt�| j�|f � ttt|��|tt| j�g}| j}| j }|�ttt|�t|��� g } |D ]\} } | �t| �� | �t| �� q�|D ]\} } | �t| �� | �t| �� q�ttt| �d �g| �R � } |�| � |D ]\} } |�| � |�| � q�|D ]\} } |�| � |�| � �q zd�|�} W n t�y0 td| ��w t|dt| � � ttt| ��V | V z | � � D ]}t|dt|� � tt t|��V |V �qJW ng t �yq |� d� � t �y� } zMt �!|�}|� d| � t"�#� d }d| }t$dd|fgdd�}d|_tt d �V |j%|d �D ]}|V �q�t|d � tt d�V t�&||� W Y d }~nd }~ww t|d � tt d�V d | _ d S ) Ns part can only be consumed onceFs bundle2-output-part: "%s"r� r� r� r� r� s empty payloadr_ � __next__s streamed payloads %i bytes payloadr� r] s part %s: "%s"r z8Found a non-bytes trying to build bundle part header: %rs header chunk size: %i� payload chunk size: %is bundle2-generatorexit s5 bundle2-input-stream-interrupt: encoding exception %ss unexpected error: %s� error:abort� messager� r ���r s closing payload chunkT)'rY r rj r� r� r� rD rS rZ r[ r� r rJ r r� �upperr2 r% r r� r� r� �_fparttypesize�_fpartid�_fpartparamcountr0 � TypeErrorr �_payloadchunksr5 � GeneratorExit� BaseExceptionr � forcebytestr�sys�exc_infor� r � raisewithtb)r@ r! r� r� r� r, �header�manpar�advpar�parsizesr� r� � paramsizes� headerchunkr r� �bexcr� � interpartr# r# r$ r F s� � � � ��� � � � �� zbundlepart.getchunksc c sn � t �| jd�st �| jd�r*t �| j�}|�t�}|r(|V |�t�}|s dS dS t| j�r5| jV dS dS )zmyield chunks of a the part payload Exists to handle the different methods to provide data to a part.r_ rc N)r rJ r� � chunkbuffer�read�preferedchunksizerS )r@ �buffr r# r# r$ rm � s �� � �zbundlepart._payloadchunksN)r# r# r] T)r] T)rW rX rY rZ rA r^ r r r� �setterrZ r[ r� r rm r# r# r# r$ r� � s( � nr� rg c s0 e Zd ZdZ� fdd�Zdd� Zdd� Z� ZS )�interrupthandlerz�read one part and process it with restricted capability This allows to transmit exception raised on the producer size during part iteration while the consumer is reading a part. Part processed in this manner only have access to a ui object,c s t t| ��|� || _d S r1 )r# r� rA r! r$ r% r# r$ rA � s zinterrupthandler.__init__c C rA )rB r rC s part header size: %i NrD rE r# r# r$ r= � rG z interrupthandler._readpartheaderc C s� | j �d� t| j d� | �� }|d u r t| j d� d S t| j || j�}t| j �}d}z zt||� W n tt fy? d}� w W |sG|� � n|sO|� � w w | j �d� d S )Ns< bundle2-input-stream-interrupt: opening out of band context s0 bundle2 stream interruption, looking for a part.s" no part found during interruption.FTs< bundle2-input-stream-interrupt: closing out of band context ) r! r r' r= r< r �interruptoperationr� � SystemExit�KeyboardInterruptr� )r@ r@ r� r~ � hardabortr# r# r$ �__call__� s6 � ���� ��zinterrupthandler.__call__)rW rX rY rZ rA r= r� rL r# r# r% r$ r� � s r� c @ s, e Zd ZdZdd� Zedd� �Zdd� ZdS ) r� zpA limited operation to be use by part handler during interruption It only have access to an ui object. c C s || _ d | _d| _d S )NF)r! r` ra )r@ r! r# r# r$ rA rB zinterruptoperation.__init__c C s t �d���Ns' no repo access from stream interruption)r rj r? r# r# r$ r^ s zinterruptoperation.repoc C s t d��r� rm r? r# r# r$ ri s z!interruptoperation.gettransactionN)rW rX rY rZ rA r r^ ri r# r# r# r$ r� � s r� c c s � | � dd�}| j}t�t�}|j}|j}tj}|j }||||��d } t | d| � | r�| dkrL|| �} t | �| k rHt � td�t | �| f ��| V n| tkrWt| |�� nt �d| ��||�} t | �|k rut � td�t | �| f ��|| �d } |r�|d| � | s-dS dS ) z�Reads bundle2 part payload data into chunks. Part payload data consists of framed chunks. This function takes a file handle and emits those chunks. r r r rd s6 stream ended unexpectedly (got %d bytes, expected %d)s negative payload chunk size: %ss& bundle2-input: payload chunk size: %i N)r r r �Structr5 r �unpackr r r} r' rS r r r r6 r� r( ) r! �fh�dologr � headerstructrF r� r r} � chunksize�sr# r# r$ �decodepayloadchunks sL � � ��� �� �r� c sZ e Zd ZdZ� fdd�Zdd� Zdd� Zdd � Zd d � Zd d � Z dd� Z ddd�Z � Z S )r< z a bundle part read from a bundlec s� t t| ��|� t�|d�ot�|d�| _|| _|| _d| _d| _ d| _ d | _ d | _ d | _ d | _d | _d| _| �� d | _d| _d S )N�seeks tellr Fr# )r# r< rA r rJ � _seekabler! � _headerdata� _headeroffset� _initialized�consumedr� r� rZ r[ r5 r� � _readheader� _mandatory�_pos�r@ r! rt r r% r# r$ rA K s$ � zunbundlepart.__init__c C s& | j }| j||| � }|| | _ |S )z+return the next <size> byte from the header)r� r� )r@ r �offsetr� r# r# r$ � _fromheadera s zunbundlepart._fromheaderc C r )zaread given format from header This automatically compute the size of the format to read.)r� r r r r r# r# r$ � _unpackheaderh s zunbundlepart._unpackheaderc C sH t |�| _t |�| _t�| j�| _| j�| j� tdd� |D ��| _dS )z7internal function to setup all logic related parametersc s s � | ]}|d V qdS )r Nr# )r� r� r# r# r$ r� w � � z+unbundlepart._initparams.<locals>.<genexpr>N) rK rZ r[ r r- r5 rg r4 r� )r@ rZ r[ r# r# r$ � _initparamso s zunbundlepart._initparamsc C sb | � t�d }| �|�| _t| jd| j � | � t�d | _t| jdt� | j� � | j| j� � k| _ | j� � | _| � t �\}}t| jd|| � t || �}| � |�}tt|ddd� |ddd� ��}|d|� }||d� }g }|D ]\} } |�| �| �| �| �f� qvg } |D ]\} } | �| �| �| �| �f� q�| �|| � t�| �� �| _d| _dS ) z$read the header and setup the objectr s part type: "%s"s part id: "%s"s part parameters: %iNr r T)r� ri r� r� r' r! rj r� r r� r2 r� rk r0 r� �ziprD r� r r| rm �_payloadstreamr� ) r@ �typesize�mancount�advcount� fparamsizesrx �mansizes�advsizes� manparamsr� r� � advparamsr# r# r$ r� y s. " zunbundlepart._readheaderc C s t | j| j�S )z+Generator of decoded chunks in the payload.)r� r! r r? r# r# r$ rm � s zunbundlepart._payloadchunksc C s@ | j rdS | �d�}|r | jt|�7 _| �d�}|s dS dS )z�Read the part payload until completion. By consuming the part data, the underlying stream read offset will be advanced to the next part (or end of stream). Nr )r� r} r� rS )r@ r r# r# r$ r� � s �zunbundlepart.consumeNc C s| | j s| �� |du r| j�� }n| j�|�}| jt|�7 _|du s*t|�|k r<| js9| jr9| j�d| j � d| _|S )zread payload dataNs* bundle2-input-part: total payload size %i T) r� r� r� r} r� rS r� r! r )r@ r r� r# r# r$ r} � s �zunbundlepart.readr1 ) rW rX rY rZ rA r� r� r� r� rm r� r} rL r# r# r% r$ r< H s #r< c sZ e Zd ZdZ� fdd�Zddd�Zdd� Zd d � Zej fd d �Z dd d�Z dd� Z � Z S )r; a� A bundle2 part in a bundle that is seekable. Regular ``unbundlepart`` instances can only be read once. This class extends ``unbundlepart`` to enable bi-directional seeking within the part. Bundle2 part data consists of framed chunks. Offsets when seeking refer to the decoded data, not the offsets in the underlying bundle2 stream. To facilitate quickly seeking within the decoded data, instances of this class maintain a mapping between offsets in the underlying stream and the decoded payload. This mapping will consume memory in proportion to the number of chunks within the payload (which almost certainly increases in proportion with the size of the part). c s g | _ tt| ��|||� d S r1 )� _chunkindexr# r; rA r� r% r# r$ rA � s z seekableunbundlepart.__init__r c c s� � t | j�dkr|dksJ d��| j�d| �� f� n|t | j�k s(J d| ��| �| j| d � | j| d }t| j| j�D ] }|d7 }|t |�7 }|t | j�kr]| j�|| �� f� |V q@dS )z/seek to specified chunk and start yielding datar s Must start with chunk 0s Unknown chunk %dr N)rS r� rD �_tellfp�_seekfpr� r! r )r@ �chunknum�posr r# r# r$ rm � s �� �z#seekableunbundlepart._payloadchunksc C s^ t | j�D ]%\}\}}||kr|df S ||kr*|d || j|d d f S qtd��)z>for a given payload position, return a chunk number and offsetr r s Unknown chunk)r� r� r* )r@ r� r �ppos�fposr# r# r$ � _findchunk� s "�z seekableunbundlepart._findchunkc C r` r1 )r� r? r# r# r$ �tell� s zseekableunbundlepart.tellc C s2 |t jkr|}n2|t jkr| j| }n'|t jkr3| js)| �d�}|r)| �d�}|s"| jd d | }ntd|f ��|| jd d krT| jsT| �d�}|rT| �d�}|sMd| krf| jd d ksktd�� td��| j|kr�| � |�\}}t � | � |��| _ | �|�}t|�|kr�t�td���|| _d S d S )Nr rg r s Unknown whence value: %ri� s Offset out of ranges Seek failed )�os�SEEK_SET�SEEK_CURr� �SEEK_ENDr� r} r� r* r� r r| rm r� rS r r r )r@ r� �whence�newposr �internaloffset�adjustr# r# r$ r� � s: � � � �zseekableunbundlepart.seekc C s | j r | j�||�S ttd���)a move the underlying file pointer This method is meant for internal usage by the bundle2 protocol only. They directly manipulate the low level stream including bundle2 level instruction. Do not use it to implement higher-level logic or methods.s File pointer is not seekable)r� r r� �NotImplementedErrorr )r@ r� r� r# r# r$ r� s z seekableunbundlepart._seekfpc C sT | j r(z| j�� W S ty' } z|jtjkrd| _ n� W Y d}~dS d}~ww dS )a, return the file offset, or None if file is not seekable This method is meant for internal usage by the bundle2 protocol only. They directly manipulate the low level stream including bundle2 level instruction. Do not use it to implement higher-level logic or methods.FN)r� r r� �IOError�errno�ESPIPE)r@ �er# r# r$ r� & s ���z seekableunbundlepart._tellfp)r )rW rX rY rZ rA rm r� r� r� r� r� r� r� rL r# r# r% r$ r; � s r; )s aborts unsupportedcontents pushraced� pushkey)s https https)s heads)s v2) r� � bookmarkss error� listkeysr� � digests� remote-changegroup� hgtagsfnodes� phases� streamFc C s� |dvr t �d��t�� }ttt�| ���|d< t� | tj �r-tdd� tj D ��}||d< |r3d|d< | j � d d �}|d krBd |d < d| j �dd�v rP|�d� |d krm| j jd ddd�}| j �d d�}|rh|sm|�d� |S )a_ return the bundle2 capabilities for a given repo Exists to allow extensions (like evolution) to mutate the capabilities. The returned value is used for servers advertising their capabilities as well as clients advertising their capabilities to servers as part of bundle2 requests. The ``role`` argument specifies which is which. )s client� servers& role argument must be client or serverr� c s s � | ]}d | V qdS )s V%iNr# r� r# r# r$ r� Z r� z getrepocaps.<locals>.<genexpr>� obsmarkersr# s pushbackr� s concurrent-push-modes check-related)s relateds checkheadsr� r s legacy.exchanges uncompressedT)� untrusteds bundle2.streamr� )r rj r� r rK r� r �supportedincomingversionsr � isenabled� exchangeopt�formatsr! �config� configlist�popr )r^ � allowpushback�roler� �supportedformat�cpmode�streamsupported�featuresupportedr# r# r$ � getrepocapsI s0 � � r� c C s2 | � d�}|s |dkr i S t�| � d��}t|�S )z0return the bundle capabilities of a peer as dictrp r] )�capabler� r� r� )�remote�raw�capsblobr# r# r$ � bundle2capsv s r� c C s | � dd�}dd� |D �S )zIextract the list of supported obsmarkers versions from a bundle2caps dictr� r# c S s& g | ]}|� d �rt|dd� ��qS )� Vr N)r �int�r� �cr# r# r$ r� � s & z%obsmarkersversion.<locals>.<listcomp>�rL )r� �obscapsr# r# r$ �obsmarkersversion s r� c C s� |� d�rt�||d|�} t| | ||||| d�S |� d�s$t�d| ��i } d|v r.d| d< t| | �} | �|| � t| || |||� | � � } tj | | ||d �S ) Nr� � 01)�vfs� compressionr� r� s unknown bundle type: %s� obsolescence)s V1r� �r� ) r r �makechangegroup� writebundler rj r� r� �_addpartsfromoptsr � writechunks)r! r^ re �filename� bundletype�outgoing�optsr� r� r� r� r� �bundle� chunkiterr# r# r$ �writenewbundle� s* � r� c C sv |� dd�rU|� d�}|d u rt�|�}t�||||�}|jd|�� d�}|�d|j� d|jv r>|jdd|jd d d � |� d �rU|� d |j �rU|jd dt j d d � t j|jv ra|�dd� |� dd �rnt||dd� |� dd�rzt|||� |� dd�r�t|||� |� dd �r�|j�|j�} t|| |� dd�d � |� d d �r�t �||j�} t �| �} |jd| d� d S d S )Nr� Ts cg.version�r� � version� clcount� nbchanges� %dFr� r� s %ln and secret()� targetphase� exp-sidedataro s streamv2)�streams tagsfnodescaches revbranchcacher� s obsolescence-mandatory� phase-heads)rL r � safeversionr� r� r r� r �extras�revs� ancestorsofr �secretr �REPO_FEATURE_SIDE_DATA�features�addpartbundlestream2�addparttagsfnodescache�addpartrevbranchcache�obsstore�relevantmarkers�missing�buildobsmarkerspart�subsetphaseheads� binaryencode) r! r^ �bundlerre r� r� � cgversionr� r� � obsmarkers� headsbyphase� phasedatar# r# r$ r� � sJ �� � � �r� c C s^ t �| �� �}g }|jD ]}|j|dd�}|r |�||g� q |r-|jdd�|�d� d S d S )NF)�computemissingr� r] r� )r �hgtagsfnodescache� unfilteredr �getfnode�extendr� r� )r^ r r� �cacher� �node�fnoder# r# r$ r � s ��r c st | � � }| �� j}t�dd� �� |jD ]}|�|�|��\}}� | | �|� q� fdd�}|j d|� dd� d S )Nc S s t � t � fS r1 )rW r# r# r# r$ ru � s z'addpartrevbranchcache.<locals>.<lambda>c 3 st � t � �� �D ]0\} \}}t�| �}t�t|�t|�t|��V |V t |�D ]}|V q't |�D ]}|V q1qd S r1 )r� �itemsr � fromlocal� rbcstruct�packrS )�branch�nodes�closed� utf8branchr� �� branchesdatar# r$ �generate s � ��z'addpartrevbranchcache.<locals>.generate� cache:rev-branch-cacheFr� ) �revbranchcacher � changelog� collections� defaultdictr � branchinfo�revrF r� ) r^ r r� r �clr r rI r$ r# r" r$ r � s r c C s" dd� | D �} t �d�t| ���S )Nc S s g | ]}|d kr|�qS )s sharedr# )r� �reqr# r# r$ r� � z+_formatrequirementsspec.<locals>.<listcomp>r� )r� r� r� r� )r r# r# r$ �_formatrequirementsspec s r/ c C s t | �} dt�d�| f }|S )Ns %s%ss requirements=)r/ r� r� )r r5 r# r# r$ �_formatrequirementsparams s r0 c C s( d}| j rd�dd� t| j �D ��}|S )z\Formats a repo's wanted sidedata categories into a bytestring for capabilities exchange.r] r� c s s � | ]}t �|�V qd S r1 )r r� r� r# r# r$ r� s � �z0format_remote_wanted_sidedata.<locals>.<genexpr>)�_wanted_sidedatar� r� )r^ �wantedr# r# r$ � format_remote_wanted_sidedata s �r3 c C s | � d�}t|�S )N� exp-wanted-sidedata)r� �read_wanted_sidedata)r� �sidedata_categoriesr# r# r$ �read_remote_wanted_sidedata% s r7 c C s | r t | �d��S t � S )Nr� )rW r� )� formattedr# r# r$ r5 * s r5 c K s |� dd�sd S t�|�stjtd�td�d��d| _|� d�}|� d�}|j�dd �}|s0|r9|s9t�td ���d}|j rTt | j �}|sLt�td ���|j j |v rTd }t� ||||�\}} } t�|�} t| �} | jd | d�} | jdd| d d� | jdd| d d� | jd| d d� d S )Nr� Fs< stream data requested but server does not allow this featuresr well-behaved clients should not be requesting stream data from servers not advertising it; the client may be buggy��hint� includepats� excludepats� experimentals server.stream-narrow-cloness, server does not support narrow stream clonessP server has obsolescence markers, but client cannot receive them via stream cloneT� stream2r� � bytecountr� r� � filecount� requirements)rL r �allowservergenerationr r r r� r! r r r� r� �_version� generatev2�streamed_requirementsr/ r� r� ) r r^ r} r; r< � narrowstream�includeobsmarkers�remoteversions� filecount� bytecount�itr r� r# r# r$ r 0 sN ��� � �� � r Tc C sL |sdS t | j�}t�|�}|du rtd��tj|d|d�}| jd||d�S )z�add an obsmarker part to the bundler with <markers> No part is created if markers is empty. Raises ValueError if the bundler doesn't support any known obsmarker format. Ns0 bundler does not support common obsmarker formatT)r r� r� )r� r� r � commonversionr* � encodemarkersr� )r �markersr� rH r r� r# r# r$ r i s r c s� |dkr5t | �}|�|�� |jd� �� d�}|�d� j� d� jv r0|jdd� jd dd � |�� } n9|d u s;J �� jd krGt�t d ���t | \�} | t j j vr\t�t d �| ��t j �| ��� ���fdd�} | � } tj| | ||d�S )z�Write a bundle file and return its filename. Existing files will not be overwritten. If no filename is specified, a temporary file is created. bz2 compression can be turned off. The bundle file will be deleted in case of errors. r� r� r� r� r� r� r� Fr� Nr� s. old bundle types only supports v1 changegroupss# unknown stream compression type: %sc 3 s( � �V �� � �� ��D ]} | V q d S r1 )r� r )r �r� � compenginer� rt r# r$ r� � s ��z writebundle.<locals>.chunkiterr� )r� r� r� r r� r r� r r r � bundletypesr r� rQ r� r r� ) r! r� r� r� r� r� r� r� r� r� �compr# rO r$ r� z s, � � r� c C s� dd� | j d D �}d}d}|D ] }|dkrd} n|dk r%||d 7 }q|dkr/||d 7 }q|dkr:d| }|S |dk rBd| }|S )z:logic to combine 0 or more addchangegroup results into onec S s g | ]}|� d d��qS )r� r r� )r� �rr# r# r$ r� � r. z-combinechangegroupresults.<locals>.<listcomp>r� r r rg )r_ )r~ �results� changedheads�resultr� r# r# r$ �combinechangegroupresults� s$ ��rW r� )r� r� r� r4 � treemanifestr� c C sn ddl m} | �� }|j�dd�}t�||d�}d}d|jv r't|j�d��}d|jv r_t� | j �s_t | j j �dkrAt �td ���| j j�tj� |�| j j| j j| j j�| j j_t�| j � i }|j�d �}|durqt|�|d < |j�d �} t| �|d < t| ||| jdfd|i|��} | j dur�| j j ddd�} | j dt � |j!�dd� | j dd| dd� |�"� r�J �dS )z$apply a changegroup part on the repor )� localrepor� r� Nr� rX r s[ bundle contains tree manifests, but local repo is non-empty and does not use tree manifestsr� � targetphaser4 r6 rp � expectedtotal� reply:changegroupFr� r� r� � %i)#� rY ri r5 rL r r! r� r �istreemanifestr^ rS r' r r r r rF �TREEMANIFEST_REQUIREMENT�resolvestorevfsoptionsr! r �svfs�options�writereporequirementsr5 r{ re r` r� r� r r� r� r} ) r~ �inpartrY rt �unpackerversionr� � nbchangesets� extrakwargsrZ �remote_sidedatar� r� r# r# r$ �handlechangegroup� sV �� � ��� �rj )rq � sizer� c C s g | ]}d | �qS )� digest:%sr# )r� r8 r# r# r$ r� s r� r� c C s z|j d }W n ty t�td�d ��w t�|�}|jtd vr.t�td�|j ��z t |j d �}W n t yG t�td�d �� tyV t�td�d ��w i }|j � dd�� � D ]"}d | }z|j | }W n ty t�td�| ��w |||< qbt �t�| j|�||�} | �� } d d lm} | �| jj| |�} t| tj�s�t�td �t�|� ��t| | | | jd �} | j dur�| j � d�}|j dt � |j!�dd� |j dd| dd� z| �"� W n tj�y } zt�td�t�|�|j#f ��d}~ww |�$� �r J �dS )a� apply a bundle10 on the repo, given an url and validation information All the information about the remote bundle to import are given as parameters. The parameters include: - url: the url to the bundle10. - size: the bundle10 file size. It is used to validate what was retrieved by the client matches the server knowledge about the bundle. - digests: a space separated list of the digest types provided as parameters. - digest:<digest-type>: the hexadecimal representation of the digest with that name. Like the size, it is used to validate what was retrieved by the client matches what the server knows about the bundle. When multiple digest types are given, all of them are checked. rq s& remote-changegroup: missing "%s" paramr� s+ remote-changegroup does not support %s urlsrk s0 remote-changegroup: invalid value for param "%s"r� r] rl r )�exchanges %s: not a bundle version 1.0rp Nr\ r� Fr� r� r] s bundle at %s is corrupted: %s)%r5 r1 r r r r r �schemer� r� r* rL r� r � digestchecker�openr! ri r^ rm � readbundler^ rx r � cg1unpacker� hidepasswordr{ re r` r� r� r r� r� �validater" r} )r~ re �raw_url� parsed_urlr �digests�typr r� � real_partrt rm r� r� r� r� r# r# r$ �handleremotechangegroup sx � �� � �� �� � � ����rz r\ )r� r� c C s4 t |jd �}t |jd �}| j�dd|i|� d S )Nr� r� r� �r� r5 r_ rF )r~ re r� �replytor# r# r$ �handlereplychangegroupS s r} s check:bookmarksc C s� t �| j|�}d}d}d}|D ]9\}}| jj�|�}||krH|du r+||t|�f } n|du r8||t|�f } n ||t|�t|�f } t�| ��qdS )z�check location of bookmarks This part is to be used to detect push race regarding bookmark, it contains binary encoded (bookmark, node) tuple. If the local state does not marks the one in the part, a PushRaced exception is raised s] remote repository changed while pushing - please try again (bookmark "%s" move from %s to %s)sb remote repository changed while pushing - please try again (bookmark "%s" is missing, expected %s)sf remote repository changed while pushing - please try again (bookmark "%s" set on %s, expected missing)N)r � binarydecoder^ � _bookmarksrL r r � PushRaced) r~ re �bookdata� msgstandard� msgmissing�msgexist�bookr � currentnode�finalmsgr# r# r$ �handlecheckbookmarksZ s, ��� � ��r� s check:headsc C s| |� d�}g }t|�dkr |�|� |� d�}t|�dks |r!J �| j�dd�r,| �� t|�t| j�� �kr<t � d��dS )z�check that head of the repo did not change This is used to detect a push race when using unbundle. This replaces the "heads" argument of unbundle.� r= � bundle2lazylocking�: remote repository changed while pushing - please try againN) r} rS rD r! r ri r� r^ �headsr r� )r~ re �hr� r# r# r$ �handlecheckheads� s ���r� s check:updated-headsc C s� |� d�}g }t|�dkr |�|� |� d�}t|�dks |r!J �| j�dd�r,| �� t� }| j�� � � D ]}|� |� q6|D ] }||vrKt � d��q@dS )aN check for race on the heads touched by a push This is similar to 'check:heads' but focus on the heads actually updated during the push. If other activities happen on unrelated heads, it is ignored. This allow server with high traffic to avoid push contention as long as unrelated parts of the graph are involved.r� r= r� r� N) r} rS rD r! r ri rW r^ � branchmap� iterheadsrg r r� )r~ re r� r� � currentheads�lsr# r# r$ �handlecheckupdatedheads� s& � ���r� s check:phasesc C s� t �|�}| j�� }|j}|j}d}t�|�D ]*\}}|D ]#} |�||� | ��} | |kr@|t | �t j | t j | f } t � | ��q qdS )zjcheck that phase boundaries of the repository did not change This is used to detect a push race. sQ remote repository changed while pushing - please try again (%s is %s expected %s)N)r r~ r^ r r' � _phasecacher � iteritems�phaser+ r � phasenamesr r� ) r~ re � phasetonodes�unfir, � phasecacher� � expectedphaser r� � actualphaser� r# r# r$ �handlecheckphases� s& �� ���r� r� c C s* |� � �� D ] }| j�td�| � qdS )z3forward output captured on the server to the clients remote: %s N)r} r� r! r� r )r~ re r� r# r# r$ � handleoutput� s �r� s replycapsc C s, t |�� �}| jdu rt| j|�| _dS dS )zqNotify that a reply bundle should be created The payload contains the capabilities information for the replyN)r� r} r` r� r! )r~ re r� r# r# r$ �handlereplycaps� s �r� c @ s e Zd ZdZdS )� AbortFromPartz=Sub-class of Abort that denotes an error from a bundle2 part.N)rW rX rY rZ r# r# r# r$ r� � s r� re )rf � hintc C s t |jd |j�d�d��)z*Used to transmit abort error over the wirerf r� r9 )r� r5 rL �r~ re r# r# r$ �handleerrorabort� s �r� s error:pushkey)� namespace� key� new� old� retr� c C sH i }dD ]}|j �|�}|dur|||< qtj|j d fi t�|����)z=Used to transmit failure of a mandatory pushkey over the wire�r� r� r� r� r� Nr� )r5 rL r � PushkeyFailedr � strkwargs)r~ re r} r� r� r# r# r$ �handleerrorpushkey� s ���r� s error:unsupportedcontent)� parttype� paramsc C sX i }|j �d�}|dur||d< |j �d�}|dur!|�d�|d< tjdi t�|����)z4Used to transmit unknown content error over the wirer� Nr� � r# )r5 rL r� r r� r r� )r~ re r} r, r5 r# r# r$ � handleerrorunsupportedcontent� s r� s error:pushraced)rf c C s t �td�|jd ��)z.Used to transmit push race error over the wires push failed:rf )r � ResponseErrorr r5 r� r# r# r$ �handleerrorpushraced s r� r� )r� c C s. |j d }t�|�� �}| j�d||f� dS )z6retrieve pushkey namespace content stored in a bundle2r� r� N)r5 r � decodekeysr} r_ rF )r~ re � namespacerS r# r# r$ �handlelistkeys s r� r� �r� r� r� r� c C s t j}||jd �}||jd �}||jd �}||jd �}| j�dd�r*| �� | j� ||||�}||||d�}| j�d|� | j d urb| j � d �} | j d t � |j�d d � | j dd| d d � |jr�|s�i } dD ]}||jv ry|j| | |< qktjddd|j it �| ����d S d S )zprocess a pushkey requestr� r� r� r� r= r� r� r� N� reply:pushkeyr� Fr� r� r] r� rJ r� r# )r �decoder5 r! r ri r^ r_ rF r` r� r� r r� r� r� r r� r� ) r~ re �decr� r� �old�newr� �record�rpartr} r# r# r$ � handlepushkey s8 � ����r� r� c s� t ��j|�}�jj�dd�}�j�dd�}|dkr���� }�jj}|rmg � |D ]0\}}|j � � } d| d< d| d< || d< t |�|d ��| d < t |d urN|nd �| d < � � | � q(� D ]} �jj dddit�| ��� q[|D ]\}}t �|�r�td�| } t�| ��qo|��j��� |� |r�� �fdd�} �j�| � d S d S |dkr�|D ]\}}||d�} �j�d| � q�d S t�d| ��)ad transmit bookmark information The part contains binary encoded bookmark information. The exact behavior of this part can be controlled by the 'bookmarks' mode on the bundle operation. When mode is 'apply' (the default) the bookmark information is applied as is to the unbundling repository. Make sure a 'check:bookmarks' part is issued earlier to check for push races in such update. This behavior is suitable for pushing. When mode is 'records', the information is recorded into the 'bookmarks' records of the bundle operation. This behavior is suitable for pulling. r� s bookmarks-pushkey-compatr� s applyro s pushkeycompatr� r� r] r� Nr� � prepushkey�throwTs$ cannot accept divergent bookmark %s!c s& � D ]}�j jdi t�|��� qd S )Nr� )r� )r^ �hookr r� )�unused_successrb ��allhooksr~ r# r$ �runhookk s �z handlebookmark.<locals>.runhooks records)s bookmarks nodes unknown bookmark mode: %s)r� )r r~ r^ r! r rd rL ri r rb r r rD r� r r� � isdivergentr r r � applychanges� _afterlockr_ rF rj ) r~ re �changes� pushkeycompat� bookmarksmodert � bookstorer� r rb r� r� r� r# r� r$ �handlebookmark7 sX � ��� �� ��r� r� c C s$ t �|�}t �| j�� | j|� dS )z%apply phases from bundle part to repoN)r r~ � updatephasesr^ r ri )r~ re r r# r# r$ � handlephases{ s r� r� c C �4 t |jd �}t |jd �}| j�dd|i|� dS )�(retrieve the result of a pushkey requestr� r� r� Nr{ �r~ re r� rJ r# r# r$ �handlepushkeyreply� � r� r� c C s� | � � }|�� }| j�dd�r| j�dt|� � |js*| jjj r*| jj� d� dS | jj� ||�}| j� � | j �dd|i� | jdurc| j�d�}|jd t�|j�d d � |jdd | d d � dS dS ) z&add a stream of obsmarkers to the repor= s obsmarkers-exchange-debugs& obsmarker-exchange: %i bytes received s3 ignoring obsolescence markers, feature not enabled Nr� r� � reply:obsmarkersr� Fr� r] )ri r} r! r� � writenoi18nrS r� r^ r �readonlyr � mergemarkers�invalidatevolatilesetsr_ rF r` r� r� r r� r� )r~ re rt � markerdatar� r� r# r# r$ �handleobsmarker� s* �� ��r� r� )r� r� c C r� )r� r� r� r� Nr{ r� r# r# r$ �handleobsmarkerreply� r� r� r� c C s� | j �dd�r | �� t�| j�� �}d} |�d�}|�d�}t|�dk s,t|�dk r3| j � d� n |� ||� |d7 }q|� � | j � d| � d S ) z|Applies .hgtags fnodes cache entries to the local repo. Payload is pairs of 20 byte changeset nodes and filenodes. r= r� r Tr� s1 ignoring incomplete received .hgtags fnodes data r s' applied %i hgtags fnodes cache entries N) r! r ri r r r^ r r} rS r �setfnode�write)r~ re r r� r r r# r# r$ �handlehgtagsfnodes� s � r� s >IIIr% c C s dS )z�Legacy part, ignored for compatibility with bundles from or for Mercurial before 5.7. Newer Mercurial computes the cache efficiently enough during unbundling that the additional transfer is unnecessary.Nr# r� r# r# r$ � handlerbc� rv r� s pushvarsc C sL | j �dd�r$i }|jD ]\}}|�� }d| }|||< q | �|� dS dS )z5unbundle a bundle2 containing shellvars on the servers pushs pushvars.servers USERVAR_N)r! r r[ rh rk )r~ r� rb r� r� r# r# r$ �bundle2getvars� s �r� r> )rA r@ r? c C s� t �|jd �}|r|�d�ng }t|jd �}t|jd �}| j}t|�r/td�}t� |��|j � d� t � |||||� d S )NrA r� r@ r? s1 cannot apply stream clone to non empty repositorys applying stream bundle )r� r� r5 r� r� r^ rS r r r r! r r � applybundlev2)r~ r� r rI rJ r^ r� r# r# r$ �handlestreamv2bundle� s r� c C s� t � }|j} |�d|�D ] } |�| �| �� q |rItj|||||d�} | j|jht |�dddd�} | j d| d�} | � d|� t � |�rI| � d d � tj|jv r_| � d d � t|�}| � d |� | S ) aK generates bundle2 for widening a narrow clone bundler is the bundle to which data should be added repo is the localrepository instance oldmatcher matches what the client already has newmatcher matches what the client needs (including what it already has) common is set of common heads between server and client known is a set of revs known on the client side (used in ellipses) cgversion is the changegroup version to send ellipses is boolean value telling whether to send ellipses data or not returns bundle2 of the data required for extending s ::%ln)� oldmatcher�matcher� fullnodesFs narrow_widen)r' r� r� r� rX ro r� r4 )rW r' r� rF r r � getbundlerr$ �nullidr� r� r� r r_ r r r r3 )r r^ r� � newmatcher�common�knownr �ellipses� commonnodesr, rS �packer�cgdatar� r2 r# r# r$ � widen_bundle� s8 �� r� r r1 )NNr] )FN)NNN)T)�rZ � __future__r r r( r� r� �rer� r rq �i18nr r r r r^ r r r r r r r r r r r r r r �utilsr r � interfacesr �urlerrr� r r� r� r r� r ri rj r5 rk r~ �compiler( r% r' r- r0 r3 r: �objectr; r\ � RuntimeErrorrl rn r r� rz r� r{ r� r� r� r� rQ �bundlepriorityr� r r! ry r r0 rO rR r� r6 r� r� r� r< r; rK r� �DIGESTS�keysr� r� r� r� r� r� r r r/ r0 r3 r7 r5 r r r� rW rj �_remotechangegroupparamsrz r} r� r� r� r� r� r� r r� r� r� r� r� r� r� r� r� r� r� r� r� r� r r� r� r� r� r# r# r# r$ �<module> sH @ 04 G% * � | ! l48x|� - �%5 9 �-� 7�� N % � C
Save
Cancel