← Back
Editing: scanner.cpython-37.pyc
B b�`M� � @ sL d dgZ ddlmZ ddlT G dd� de�ZG dd� d�ZG dd � d �Zd S ) �Scanner� ScannerError� )�MarkedYAMLError)�*c @ s e Zd ZdS )r N)�__name__� __module__� __qualname__� r r �?/opt/alt/python37/lib64/python3.7/site-packages/yaml/scanner.pyr s c @ s e Zd Zdd� ZdS )� SimpleKeyc C s( || _ || _|| _|| _|| _|| _d S )N)� token_number�required�index�line�column�mark)�selfr r r r r r r r r �__init__& s zSimpleKey.__init__N)r r r r r r r r r # s r c @ sz e Zd Zdd� Zdd� Zdd� Zdd� Zd d � Zd d � Zd d� Z dd� Z dd� Z dd� Z dd� Z dd� Zdd� Zdd � Zd d � Zd d � Zd!d"� Zd#d$� Zd%d&� Zd'd(� Zd)d*� Zd+d,� Zd-d.� Zd/d0� Zd1d2� Zd3d4� Z d5d6� Z d7d8� Z d9d:� Z d;d<� Z d=d>� Z!d?d@� Z"dAdB� Z#dCdD� Z$dEdF� Z%dGdH� Z&dIdJ� Z'dKdL� Z(dMdN� Z)dOdP� Z*dQdR� Z+dSdT� Z,dUdV� Z-dWdX� Z.dYdZ� Z/d[d\� Z0d]d^� Z1d_d`� Z2dadb� Z3dcdd� Z4dedf� Z5dgdh� Z6didj� Z7dkdl� Z8dmdn� Z9dodp� Z:dqdr� Z;dsdt� Z<dudv� Z=dwdx� Z>dydz� Z?d{d|� Z@d}d~dd�d�d�d�d�d�d�d�d�d�d�d�d�d�d�d��ZAd�d�d�d��ZBd�d�� ZCd�d�� ZDd�d�� ZEd�d�� ZFd�d�� ZGd�d�� ZHd�d�� ZId�d�� ZJd�d�� ZKd�S )�r c C s< d| _ d| _g | _| �� d| _d| _g | _d| _i | _dS )zInitialize the scanner.F� ���TN) �done� flow_level�tokens�fetch_stream_start� tokens_taken�indent�indents�allow_simple_key�possible_simple_keys)r r r r r 0 s zScanner.__init__c G sJ x| � � r| �� qW | jrF|s$dS x |D ]}t| jd |�r*dS q*W dS )NTr F)�need_more_tokens�fetch_more_tokensr � isinstance)r �choices�choicer r r � check_tokenq s zScanner.check_tokenc C s. x| � � r| �� qW | jr&| jd S d S d S )Nr )r r r )r r r r � peek_token} s zScanner.peek_tokenc C s: x| � � r| �� qW | jr6| jd7 _| j�d�S d S )Nr r )r r r r �pop)r r r r � get_token� s zScanner.get_tokenc C s2 | j r dS | jsdS | �� | �� | jkr.dS d S )NFT)r r �stale_possible_simple_keys�next_possible_simple_keyr )r r r r r � s zScanner.need_more_tokensc C s� | � � | �� | �| j� | �� }|dkr4| �� S |dkrL| �� rL| �� S |dkrd| �� rd| � � S |dkr|| � � r|| � � S |dkr�| � � S |dkr�| � � S |dkr�| �� S |dkr�| �� S |d kr�| �� S |dkr�| �� r�| �� S |d kr�| �� r�| �� S |d k�r| �� �r| �� S |d k�r*| �� S |d k�r<| �� S |dk�rN| �� S |dk�rh| j�sh| �� S |dk�r�| j�s�| � � S |dk�r�| � � S |dk�r�| � � S | � � �r�| � � S t!dd d| | �"� ��d S )N� �%�-�.�[�{�]�}�,�?�:r �&�!�|�>�'�"z!while scanning for the next tokenz.found character %r that cannot start any token)#�scan_to_next_tokenr( � unwind_indentr �peek�fetch_stream_end�check_directive�fetch_directive�check_document_start�fetch_document_start�check_document_end�fetch_document_end�fetch_flow_sequence_start�fetch_flow_mapping_start�fetch_flow_sequence_end�fetch_flow_mapping_end�fetch_flow_entry�check_block_entry�fetch_block_entry� check_key� fetch_key� check_value� fetch_value� fetch_alias� fetch_anchor� fetch_tagr � fetch_literal� fetch_folded� fetch_single� fetch_double� check_plain� fetch_plainr �get_mark)r �chr r r r � s^ zScanner.fetch_more_tokensc C s: d }x0| j D ]&}| j | }|d ks,|j|k r |j}q W |S )N)r r )r Zmin_token_number�level�keyr r r r) s z Scanner.next_possible_simple_keyc C s` xZt | j�D ]L}| j| }|j| jks6| j|j dkr |jrPtd|jd| �� ��| j|= q W d S )Ni zwhile scanning a simple keyzcould not find expected ':')�listr r r r r r rY )r r[ r\ r r r r( s z"Scanner.stale_possible_simple_keysc C s^ | j o| j| jk}| jrZ| �� | jt| j� }t||| j | j | j| � � �}|| j | j < d S )N) r r r r �remove_possible_simple_keyr �lenr r r r rY r )r r r r\ r r r �save_possible_simple_key' s z Scanner.save_possible_simple_keyc C s@ | j | jkr<| j| j }|jr2td|jd| �� ��| j| j = d S )Nzwhile scanning a simple keyzcould not find expected ':')r r r r r rY )r r\ r r r r^ 8 s z"Scanner.remove_possible_simple_keyc C sD | j r d S x4| j|kr>| �� }| j�� | _| j�t||�� q W d S )N)r r rY r r& r �appendZ BlockEndToken)r r r r r r r< E s zScanner.unwind_indentc C s& | j |k r"| j�| j � || _ dS dS )NTF)r r ra )r r r r r � add_indent] s zScanner.add_indentc C s$ | � � }| j�t||| jd�� d S )N)�encoding)rY r ra ZStreamStartTokenrc )r r r r r r g s zScanner.fetch_stream_startc C sB | � d� | �� d| _i | _| �� }| j�t||�� d| _d S )Nr FT) r< r^ r r rY r ra ZStreamEndTokenr )r r r r r r> s s zScanner.fetch_stream_endc C s, | � d� | �� d| _| j�| �� � d S )Nr F)r< r^ r r ra �scan_directive)r r r r r@ � s zScanner.fetch_directivec C s | � t� d S )N)�fetch_document_indicatorZDocumentStartToken)r r r r rB � s z Scanner.fetch_document_startc C s | � t� d S )N)re ZDocumentEndToken)r r r r rD � s zScanner.fetch_document_endc C sH | � d� | �� d| _| �� }| �d� | �� }| j�|||�� d S )Nr F� )r< r^ r rY �forwardr ra )r � TokenClass� start_mark�end_markr r r re � s z Scanner.fetch_document_indicatorc C s | � t� d S )N)�fetch_flow_collection_startZFlowSequenceStartToken)r r r r rE � s z!Scanner.fetch_flow_sequence_startc C s | � t� d S )N)rk ZFlowMappingStartToken)r r r r rF � s z Scanner.fetch_flow_mapping_startc C sJ | � � | jd7 _d| _| �� }| �� | �� }| j�|||�� d S )Nr T)r` r r rY rg r ra )r rh ri rj r r r rk � s z#Scanner.fetch_flow_collection_startc C s | � t� d S )N)�fetch_flow_collection_endZFlowSequenceEndToken)r r r r rG � s z Scanner.fetch_flow_sequence_endc C s | � t� d S )N)rl ZFlowMappingEndToken)r r r r rH � s z Scanner.fetch_flow_mapping_endc C sJ | � � | jd8 _d| _| �� }| �� | �� }| j�|||�� d S )Nr F)r^ r r rY rg r ra )r rh ri rj r r r rl � s z!Scanner.fetch_flow_collection_endc C s< d| _ | �� | �� }| �� | �� }| j�t||�� d S )NT)r r^ rY rg r ra ZFlowEntryToken)r ri rj r r r rI � s zScanner.fetch_flow_entryc C s� | j sF| js td d d| �� ��| �| j�rF| �� }| j�t||�� n d| _| � � | �� }| � � | �� }| j�t ||�� d S )Nz%sequence entries are not allowed hereT) r r r rY rb r r ra ZBlockSequenceStartTokenr^ rg ZBlockEntryToken)r r ri rj r r r rK � s zScanner.fetch_block_entryc C s� | j sD| js td d d| �� ��| �| j�rD| �� }| j�t||�� | j | _| � � | �� }| � � | �� }| j�t ||�� d S )Nz!mapping keys are not allowed here) r r r rY rb r r ra �BlockMappingStartTokenr^ rg �KeyToken)r r ri rj r r r rM s zScanner.fetch_keyc C s | j | jkr|| j| j }| j| j = | j�|j| j t|j|j�� | j st| �|j �rt| j�|j| j t |j|j�� d| _ n\| j s�| j s�t d d d| � � ��| j s�| �| j �r�| � � }| j�t ||�� | j | _ | �� | � � }| �� | � � }| j�t||�� d S )NFz#mapping values are not allowed here)r r r �insertr r rn r rb r rm r r rY ra r^ rg Z ValueToken)r r\ r ri rj r r r rO ! s2 zScanner.fetch_valuec C s$ | � � d| _| j�| �t�� d S )NF)r` r r ra � scan_anchorZ AliasToken)r r r r rP Y s zScanner.fetch_aliasc C s$ | � � d| _| j�| �t�� d S )NF)r` r r ra rp Z AnchorToken)r r r r rQ d s zScanner.fetch_anchorc C s" | � � d| _| j�| �� � d S )NF)r` r r ra �scan_tag)r r r r rR o s zScanner.fetch_tagc C s | j dd� d S )Nr7 )�style)�fetch_block_scalar)r r r r rS z s zScanner.fetch_literalc C s | j dd� d S )Nr8 )rr )rs )r r r r rT } s zScanner.fetch_foldedc C s$ d| _ | �� | j�| �|�� d S )NT)r r^ r ra �scan_block_scalar)r rr r r r rs � s zScanner.fetch_block_scalarc C s | j dd� d S )Nr9 )rr )�fetch_flow_scalar)r r r r rU � s zScanner.fetch_singlec C s | j dd� d S )Nr: )rr )ru )r r r r rV � s zScanner.fetch_doublec C s$ | � � d| _| j�| �|�� d S )NF)r` r r ra �scan_flow_scalar)r rr r r r ru � s zScanner.fetch_flow_scalarc C s" | � � d| _| j�| �� � d S )NF)r` r r ra � scan_plain)r r r r rX � s zScanner.fetch_plainc C s | j dkrdS d S )Nr T)r )r r r r r? � s zScanner.check_directivec C s. | j dkr*| �d�dkr*| �d�dkr*dS d S )Nr rf z---u T)r �prefixr= )r r r r rA � s z Scanner.check_document_startc C s. | j dkr*| �d�dkr*| �d�dkr*dS d S )Nr rf z...u T)r rx r= )r r r r rC � s zScanner.check_document_endc C s | � d�dkS )Nr u )r= )r r r r rJ � s zScanner.check_block_entryc C s | j r dS | �d�dkS d S )NTr u )r r= )r r r r rL � s zScanner.check_keyc C s | j r dS | �d�dkS d S )NTr u )r r= )r r r r rN � s zScanner.check_valuec C s6 | � � }|dkp4| � d�dko4|dkp4| j o4|dkS )Nu -?:,[]{}#&*!|>'"%@`r u r, z?:)r= r )r rZ r r r rW � s zScanner.check_plainc C s� | j dkr | �� dkr | �� d}xb|s�x| �� dkr@| �� q*W | �� dkrhx| �� dkrf| �� qPW | �� r~| js�d| _q$d}q$W d S )Nr u F� �#u T)r r= rg �scan_line_breakr r )r �foundr r r r; � s zScanner.scan_to_next_tokenc C s� | � � }| �� | �|�}d }|dkr:| �|�}| � � }n>|dkrV| �|�}| � � }n"| � � }x| �� dkrv| �� q`W | �|� t||||�S )NZYAMLZTAGu )rY rg �scan_directive_name�scan_yaml_directive_value�scan_tag_directive_valuer= �scan_directive_ignored_lineZDirectiveToken)r ri �name�valuerj r r r rd s zScanner.scan_directivec C s� d}| � |�}x`d| kr$dksZn d| kr:dksZn d| krPdksZn |dkrn|d 7 }| � |�}qW |s�td |d | | �� ��| �|�}| �|� | � � }|d kr�td |d | | �� ��|S ) Nr �0�9�A�Z�a�zz-_r zwhile scanning a directivez6expected alphabetic or numeric character, but found %ru )r= r rY rx rg )r ri �lengthrZ r� r r r r} & s$ D zScanner.scan_directive_namec C s� x| � � dkr| �� qW | �|�}| � � dkrJtd|d| � � | �� ��| �� | �|�}| � � dkr�td|d| � � | �� ��||fS )Nry r- zwhile scanning a directivez%expected a digit or '.', but found %ru z%expected a digit or ' ', but found %r)r= rg �scan_yaml_directive_numberr rY )r ri �major�minorr r r r~ ; s z!Scanner.scan_yaml_directive_valuec C s� | � � }d| kr dks4n td|d| | �� ��d}x*d| � |� krTdkrbn n |d7 }q:W t| �|��}| �|� |S )Nr� r� zwhile scanning a directivez expected a digit, but found %rr r )r= r rY �intrx rg )r ri rZ r� r� r r r r� L s z"Scanner.scan_yaml_directive_numberc C sP x| � � dkr| �� qW | �|�}x| � � dkr<| �� q&W | �|�}||fS )Nry )r= rg �scan_tag_directive_handle�scan_tag_directive_prefix)r ri �handlerx r r r r Y s z Scanner.scan_tag_directive_valuec C s6 | � d|�}| �� }|dkr2td|d| | �� ��|S )N� directivery zwhile scanning a directivezexpected ' ', but found %r)�scan_tag_handler= r rY )r ri r� rZ r r r r� c s z!Scanner.scan_tag_directive_handlec C s6 | � d|�}| �� }|dkr2td|d| | �� ��|S )Nr� u zwhile scanning a directivezexpected ' ', but found %r)� scan_tag_urir= r rY )r ri r� rZ r r r r� l s z!Scanner.scan_tag_directive_prefixc C sr x| � � dkr| �� qW | � � dkr@x| � � dkr>| �� q(W | � � }|dkrftd|d| | �� ��| �� d S )Nry rz u zwhile scanning a directivez0expected a comment or a line break, but found %r)r= rg r rY r{ )r ri rZ r r r r� u s z#Scanner.scan_directive_ignored_linec C s | � � }| �� }|dkr d}nd}| �� d}| �|�}x`d| krNdks�n d| krddks�n d | krzd ks�n |d kr�|d 7 }| �|�}q:W |s�td | |d| | � � ��| �|�}| �|� | �� }|dkr�td | |d| | � � ��| � � }||||�S )Nr �alias�anchorr r� r� r� r� r� r� z-_r zwhile scanning an %sz6expected alphabetic or numeric character, but found %ru ?:,]}%@`)rY r= rg r rx ) r rh ri Z indicatorr� r� rZ r� rj r r r rp � s2 D zScanner.scan_anchorc C s& | � � }| �d�}|dkrdd }| �d� | �d|�}| �� dkrZtd|d| �� | � � ��| �� n~|dkr~d }d }| �� ndd}d }x,|d kr�|d kr�d }P |d7 }| �|�}q�W d }|r�| �d|�}n d }| �� | �d|�}| �� }|d k�r td |d| | � � ��||f}| � � }t|||�S )Nr �<� �tagr8 zwhile parsing a tagzexpected '>', but found %ru r6 Fu Tzwhile scanning a tagzexpected ' ', but found %r)rY r= rg r� r r� ZTagToken) r ri rZ r� �suffixr� Z use_handler� rj r r r rq � sH zScanner.scan_tagc C s� |dkrd}nd}g }| � � }| �� | �|�\}}| �|� | jd }|dk rTd}|d krv| �� \}} } t|| �} n|| d } | �| �\}} d} x�| j| k�rv| � � dk�rv|� |� | � � dk} d}x| � |�d kr�|d7 }q�W |� | � |�� | �|� | � � } | �| �\}} | j| k�rr| � � dk�rr|�rf| d k�rf| �rf| � � dk�rf|�sp|� d � n |� | � q�P q�W |dk �r�|� | � |dk�r�|� |� td�|�d|| |�S ) Nr8 TFr � r* z r u � ry )rY rg � scan_block_scalar_indicators� scan_block_scalar_ignored_liner � scan_block_scalar_indentation�max�scan_block_scalar_breaksr r= �extendra rx r{ � ScalarToken�join)r rr �folded�chunksri �chomping� incrementZ min_indent�breaks� max_indentrj r � line_breakZleading_non_spacer� r r r rt � sP zScanner.scan_block_scalarc C s� d }d }| � � }|dkrn|dkr&d}nd}| �� | � � }|dkr�t|�}|dkrdtd|d| �� ��| �� n\|dkr�t|�}|dkr�td|d| �� ��| �� | � � }|dkr�|dkr�d}nd}| �� | � � }|d kr�td|d | | �� ��||fS ) Nz+-�+TF� 0123456789r z while scanning a block scalarz<expected indentation indicator in the range 1-9, but found 0u z9expected chomping or indentation indicators, but found %r)r= rg r� r rY )r ri r� r� rZ r r r r� sF z$Scanner.scan_block_scalar_indicatorsc C sr x| � � dkr| �� qW | � � dkr@x| � � dkr>| �� q(W | � � }|dkrftd|d| | �� ��| �� d S )Nry rz u z while scanning a block scalarz0expected a comment or a line break, but found %r)r= rg r rY r{ )r ri rZ r r r r� D s z&Scanner.scan_block_scalar_ignored_linec C sh g }d}| � � }xL| �� dkr\| �� dkrB|�| �� � | � � }q| �� | j|kr| j}qW |||fS )Nr u ry )rY r= ra r{ rg r )r r� r� rj r r r r� R s z%Scanner.scan_block_scalar_indentationc C s� g }| � � }x"| j|k r.| �� dkr.| �� qW xJ| �� dkrz|�| �� � | � � }x"| j|k rv| �� dkrv| �� qVW q2W ||fS )Nry u )rY r r= rg ra r{ )r r r� rj r r r r� a s z Scanner.scan_block_scalar_breaksc C s� |dkrd}nd}g }| � � }| �� }| �� |�| �||�� x4| �� |krt|�| �||�� |�| �||�� qBW | �� | � � }td�|�d|||�S )Nr: TFr� )rY r= rg r� �scan_flow_scalar_non_spaces�scan_flow_scalar_spacesr� r� )r rr �doubler� ri �quoterj r r r rv n s zScanner.scan_flow_scalarr* ��� r� � � � �ry r: �\�/� � u u )r� r� �b�tr� �n�v�f�r�ery r: r� r� �N�_�L�Pr� � � )�x�u�Uc C s� g }�x�d}x| � |�dkr&|d7 }qW |rF|�| �|�� | �|� | � � }|s~|dkr~| � d�dkr~|�d� | �d� q|r�|dks�|s�|dkr�|�|� | �� q|�r�|dk�r�| �� | � � }|| jkr�|�| j| � | �� n�|| jk�rz| j| }| �� xBt|�D ]6}| � |�dk�rtd |d || � |�f | �� ���qW t | �|�d �}|�t |�� | �|� n<|d k�r�| � � |� | � ||�� ntd |d | | �� ��q|S qW d S )Nr u '"\ r r9 r� z"\r� �0123456789ABCDEFabcdefz%while scanning a double-quoted scalarz?expected escape sequence of %d hexdecimal numbers, but found %r� u z!found unknown escape character %r)r= ra rx rg �ESCAPE_REPLACEMENTS� ESCAPE_CODES�ranger rY r� �chrr{ r� �scan_flow_scalar_breaks)r r� ri r� r� rZ �k�coder r r r� � sL z#Scanner.scan_flow_scalar_non_spacesc C s� g }d}x| � |�dkr"|d7 }q W | �|�}| �|� | � � }|dkr\td|d| �� ��nT|dkr�| �� }| �||�}|dkr�|�|� n|s�|�d � |�|� n |�|� |S ) Nr z r r* z while scanning a quoted scalarz found unexpected end of streamu r� ry ) r= rx rg r rY r{ r� ra r� ) r r� ri r� r� � whitespacesrZ r� r� r r r r� � s( z Scanner.scan_flow_scalar_spacesc C s� g }xx| � d�}|dks |dkr@| �d�dkr@td|d| �� ��x| �� dkrX| �� qBW | �� dkrv|�| �� � q|S qW d S ) Nrf z---z...u z while scanning a quoted scalarz#found unexpected document separatorz u )rx r= r rY rg ra r{ )r r� ri r� rx r r r r� � s z Scanner.scan_flow_scalar_breaksc C s g }| � � }|}| jd }g }x�d}| �� dkr2P xV| �|�}|dks||dkrn| �|d �d| jrfdnd ks|| jr~|dkr~P |d7 }q4W |dkr�P d | _|�|� |�| �|�� | �|� | � � }| � ||�}|r�| �� dks�| js | j |k r P q W t d� |�d ||�S ) Nr r rz u r4 z,[]{}r� z,?[]{}FT) rY r r= r r r� ra rx rg �scan_plain_spacesr r� r� )r r� ri rj r �spacesr� rZ r r r rw � s< zScanner.scan_plainc C s. g }d}x| � |�dkr"|d7 }q W | �|�}| �|� | � � }|dk�r| �� }d| _| �d�}|dksr|dkr�| � d�d kr�d S g } x`| � � d kr�| � � dkr�| �� q�| �| �� � | �d�}|dks�|dkr�| � d�d kr�d S q�W |d kr�|�|� n| �s|�d� |�| � n|�r*|�|� |S ) Nr ry r u Trf z---z...u u r� )r= rx rg r{ r ra r� ) r r ri r� r� r� rZ r� rx r� r r r r� s> zScanner.scan_plain_spacesc C s� | � � }|dkr*td| |d| | �� ��d}| � |�}|dkr�x`d| krVdks�n d| krld ks�n d | kr�d ks�n |d kr�|d7 }| � |�}qBW |dkr�| �|� td| |d| | �� ��|d7 }| �|�}| �|� |S ) Nr6 zwhile scanning a %szexpected '!', but found %rr ry r� r� r� r� r� r� z-_)r= r rY rg rx )r r� ri rZ r� r� r r r r� D s& D zScanner.scan_tag_handlec C s� g }d}| � |�}x�d| kr(dks^n d| kr>dks^n d| krTdks^n |dkr�|d kr�|�| �|�� | �|� d}|�| �||�� n|d 7 }| � |�}qW |r�|�| �|�� | �|� d}|s�td | |d | | �� ��d �|�S )Nr r� r� r� r� r� r� z-;/?:@&=+$,_.!~*'()[]%r+ r zwhile parsing a %szexpected URI, but found %rr� )r= ra rx rg �scan_uri_escapesr rY r� )r r� ri r� r� rZ r r r r� \ s( D zScanner.scan_tag_uric C s� g }| � � }xx| �� dkr�| �� x>td�D ]2}| �|�dkr,td| |d| �|� | � � ��q,W |�t| �d�d�� | �d� qW yt|�� d�}W n8 t k r� } ztd| |t |�|��W d d }~X Y nX |S )Nr+ r� r� zwhile scanning a %szBexpected URI escape sequence of 2 hexdecimal numbers, but found %rr� zutf-8) rY r= rg r� r ra r� rx �bytes�decode�UnicodeDecodeError�str)r r� ri �codesr r� r� �excr r r r� u s (zScanner.scan_uri_escapesc C sN | � � }|dkr6| �d�dkr*| �d� n| �� dS |dkrJ| �� |S dS )Nu r� z r� u r� )r= rx rg )r rZ r r r r{ � s zScanner.scan_line_breakN)Lr r r r r$ r% r' r r r) r( r` r^ r< rb r r> r@ rB rD re rE rF rk rG rH rl rI rK rM rO rP rQ rR rS rT rs rU rV ru rX r? rA rC rJ rL rN rW r; rd r} r~ r� r r� r� r� rp rq rt r� r� r� r� rv r� r� r� r� r� rw r� r� r� r� r{ r r r r r . s� A l ! 8 # $)L( +)%N)�__all__�errorr r r r r r r r r �<module> s
Save File
Cancel