← Back
Editing: text_format.cpython-36.pyc
3 ���h�� � @ s d Z dZddlZddlZddlZejr*eZddlm Z ddl m Z ddl m Z ddd d d gZ e j� e j� e j� e j� fZejd ej�Zejd ej�Zee jje jjg�ZedO�Z dZ G dd� de �Z G dd� de �Z G dd� de!�Z"dPdd�Z#dd� Z$dQdd�Z%dRd d �Z&dSd d �Z'd d � Z(G d d!� d!e!�Z)dTd"d#�Z*dUd$d �Z+dVd%d&�Z,dWd'd(�Z-G d)d*� d*e!�Z.d+d,� Z/d-d.� Z0d/d0� Z1d1d2� Z2G d3d4� d4e!�Z3e3Z4d5d6� Z5d7d8� Z6d9d:� Z7d;d<� Z8d=d>� Z9d?d@� Z:dXdAdB�Z;dYdCdD�Z<dZdEdF�Z=d[dGdH�Z>dIdJ� Z?dKdL� Z@dMdN� ZAdS )\ab Contains routines for printing protocol messages in text format. Simple usage example: # Create a proto object and serialize it to a text proto string. message = my_proto_pb2.MyMessage(foo='bar') text_proto = text_format.MessageToString(message) # Parse a text proto string. message = text_format.Parse(text_proto, my_proto_pb2.MyMessage()) z kenton@google.com (Kenton Varda)� N)� type_checkers)� descriptor)� text_encoding�MessageToString� PrintMessage� PrintField�PrintFieldValue�Mergez-?inf(?:inity)?f?znanf?�'�"zgoogle.protobuf.Anyc @ s e Zd ZdZdS )�Errorz'Top-level module error for text_format.N)�__name__� __module__� __qualname__�__doc__� r r �!/usr/lib/python3.6/text_format.pyr I s r c s2 e Zd ZdZd � fdd� Zdd� Zdd� Z� ZS ) � ParseErrorz3Thrown in case of text parsing or tokenizing error.Nc sr |d k r:|d k r:t |�}|d k r.|dj|�7 }dj||�}|d k rTtt| �j|� ntt| �j� || _|| _d S )Nz:{0}z {0} : {1})�str�format�superr �__init__�_line�_column)�self�message�line�column�loc)� __class__r r r P s zParseError.__init__c C s | j S )N)r )r r r r �GetLine] s zParseError.GetLinec C s | j S )N)r )r r r r � GetColumn` s zParseError.GetColumn)NNN)r r r r r r r! � __classcell__r r )r r r M s r c @ s, e Zd Zdd� Zdd� Zdd� Zdd� Zd S ) � TextWriterc C s t jrtj� | _n tj� | _d S )N)�six�PY2�io�BytesIO�_writer�StringIO)r �as_utf8r r r r f s zTextWriter.__init__c C s( t jr t|t j�r |jd�}| jj|�S )Nzutf-8)r$ r% � isinstance� text_type�encoder( �write)r �valr r r r. l s zTextWriter.writec C s | j j� S )N)r( �close)r r r r r0 r s zTextWriter.closec C s | j j� S )N)r( �getvalue)r r r r r1 u s zTextWriter.getvalueN)r r r r r. r0 r1 r r r r r# d s r# Fc C sL t |�} t| ||||||||| � } | j| � | j� } | j� |rH| j� S | S )a� Convert protobuf message to text format. Floating point values can be formatted compactly with 15 digits of precision (which is the most that IEEE 754 "double" can guarantee) using float_format='.15g'. To ensure that converting to text and back to a proto will result in an identical value, float_format='.17g' should be used. Args: message: The protocol buffers message. as_utf8: Produce text output in UTF8 format. as_one_line: Don't introduce newlines between fields. pointy_brackets: If True, use angle brackets instead of curly braces for nesting. use_index_order: If True, print fields of a proto message using the order defined in source code instead of the field number. By default, use the field number order. float_format: If set, use this to specify floating point number formatting (per the "Format Specification Mini-Language"); otherwise, str() is used. use_field_number: If True, print field numbers instead of names. descriptor_pool: A DescriptorPool used to resolve Any types. indent: The indent level, in terms of spaces, for pretty print. message_formatter: A function(message, indent, as_one_line): unicode|None to custom format selected sub-messages (usually based on message type). Use to pretty print parts of the protobuf for easier diffing. Returns: A string of the text formatted protocol buffer message. )r# �_Printerr r1 r0 �rstrip) r r* � as_one_line�pointy_brackets�use_index_order� float_format�use_field_number�descriptor_pool�indent�message_formatter�out�printer�resultr r r r y s & c C s" | j tjjko | jjo | jj� jS )N)�typer �FieldDescriptor� TYPE_MESSAGE� message_typeZ has_options� GetOptionsZ map_entry)�fieldr r r � _IsMapEntry� s rE c C s( t ||||||||| | � } | j| � d S )N)r2 r ) r r< r: r* r4 r5 r6 r7 r8 r9 r; r= r r r r � s c C s& t |||||||| �} | j| |� dS )z%Print a single field name/value pair.N)r2 r ) rD �valuer< r: r* r4 r5 r6 r7 r; r= r r r r � s c C s& t |||||||| �} | j| |� dS )z0Print a single field value (not including name).N)r2 r ) rD rF r< r: r* r4 r5 r6 r7 r; r= r r r r � s c C sd |dkr ddl m} |j� }ddl m} |j� }y|j| �}W n tk rR dS X |j|�}|� S )a! Returns a protobuf message instance. Args: type_name: Fully-qualified protobuf message type name string. descriptor_pool: DescriptorPool instance. Returns: A Message instance of type matching type_name, or None if the a Descriptor wasn't found matching type_name. Nr )r9 )�symbol_database)�google.protobufr9 ZDefaultrG ZFindMessageTypeByName�KeyErrorZ GetPrototype)Z type_namer9 Zpool_modrG Zdatabase�message_descriptorrB r r r �_BuildMessageFromTypeName� s rK c @ sJ e Zd ZdZddd�Zdd� Zd d � Zd d � Zd d� Zdd� Z dd� Z dS )r2 z)Text format printer for protocol message.r FNc C s@ || _ || _|| _|| _|| _|| _|| _|| _| | _| | _ dS )aZ Initialize the Printer. Floating point values can be formatted compactly with 15 digits of precision (which is the most that IEEE 754 "double" can guarantee) using float_format='.15g'. To ensure that converting to text and back to a proto will result in an identical value, float_format='.17g' should be used. Args: out: To record the text format result. indent: The indent level for pretty print. as_utf8: Produce text output in UTF8 format. as_one_line: Don't introduce newlines between fields. pointy_brackets: If True, use angle brackets instead of curly braces for nesting. use_index_order: If True, print fields of a proto message using the order defined in source code instead of the field number. By default, use the field number order. float_format: If set, use this to specify floating point number formatting (per the "Format Specification Mini-Language"); otherwise, str() is used. use_field_number: If True, print field numbers instead of names. descriptor_pool: A DescriptorPool used to resolve Any types. message_formatter: A function(message, indent, as_one_line): unicode|None to custom format selected sub-messages (usually based on message type). Use to pretty print parts of the protobuf for easier diffing. N) r< r: r* r4 r5 r6 r7 r8 r9 r; ) r r< r: r* r4 r5 r6 r7 r8 r9 r; r r r r � s %z_Printer.__init__c C sh t |j� | j�}|r`|j|j� | jjd| jd |jf � | j |� | jj| j rVdnd� dS dS dS )z5Serializes if message is a google.protobuf.Any field.z%s[%s]� � TFN) rK ZTypeNamer9 �MergeFromStringrF r< r. r: Ztype_url�_PrintMessageFieldValuer4 )r r Zpacked_messager r r �_TryPrintAsAnyMessage. s z _Printer._TryPrintAsAnyMessagec C sV | j || j| j�}|d kr dS | j}|jd| j � |j|� |j| jrLdnd� dS )NFrL rM T)r; r: r4 r< r. )r r Z formattedr< r r r �_TryCustomFormatMessage; s z _Printer._TryCustomFormatMessagec C s� | j r| j|�rdS |jjtkr.| j|�r.dS |j� }| jrL|jdd� d� x�|D ]z\}}t |�r�xht |�D ]$}|j � ||| d�}| j ||� qlW qR|j tjjkr�x&|D ]}| j ||� q�W qR| j ||� qRW dS )zeConvert protobuf message to text format. Args: message: The protocol buffers message. Nc S s | d j S )Nr )�index)�xr r r �<lambda>S s z'_Printer.PrintMessage.<locals>.<lambda>)�key)rU rF )r; rQ � DESCRIPTOR� full_name�_ANY_FULL_TYPE_NAMErP Z ListFieldsr6 �sortrE �sorted� GetEntryClassr �labelr r@ �LABEL_REPEATED)r r ZfieldsrD rF rU Z entry_submsg�elementr r r r F s" z_Printer.PrintMessagec C s� | j }|jd| j � | jr.|jt|j�� n�|jr�|jd� |jj� j rv|j t j j krv|jt j jkrv|j|jj� n |j|j� |jd� n*|j t j jkr�|j|jj� n |j|j� |jt j jkr�|jd� | j||� | jr�|jd� n |jd� dS )z%Print a single field name/value pair.rL �[�]z: rM N)r< r. r: r8 r �number� is_extension�containing_typerC Zmessage_set_wire_formatr? r r@ rA r\ ZLABEL_OPTIONALrB rW � TYPE_GROUP�name�cpp_type�CPPTYPE_MESSAGEr r4 )r rD rF r< r r r r d s* z_Printer.PrintFieldc C s� | j rd}d}nd}d}| jrF| jjd| � | j|� | jj|� nL| jjd| � | jd7 _| j|� | jd8 _| jjd| j | � d S ) N�<�>�{�}z %s z %s � rL )r5 r4 r< r. r r: )r rF ZopenbZclosebr r r rO � s z _Printer._PrintMessageFieldValuec C s< | j }|jtjjkr"| j|� �n|jtjjkrf|jjj |d�}|dk rV|j |j � n|j t |�� n�|jtjj kr�|j d� t|tj�r�|jd�}n|}|jtjjkr�d}n| j}|j tj||�� |j d� nf|jtjjkr�|r�|j d� n |j d� n<|jtk�r*| jdk �r*|j dj| j|�� n|j t |�� dS )z�Print a single field value (not including name). For repeated fields, the value should be a single element. Args: field: The descriptor of the field to be printed. value: The value of the field. Nr zutf-8F�true�falsez{1:{0}})r< rf r r@ rg rO Z CPPTYPE_ENUM� enum_type�values_by_number�getr. re r ZCPPTYPE_STRINGr+ r$ r, r- r? � TYPE_BYTESr* r ZCEscapeZ CPPTYPE_BOOL� _FLOAT_TYPESr7 r )r rD rF r< � enum_valueZ out_valueZ out_as_utf8r r r r � s2 z_Printer.PrintFieldValue) r FFFFNFNN) r r r r r rP rQ r r rO r r r r r r2 � s & !r2 c C s> t | t�s&tjr | jd�} n | jd�} t| jd�||||d�S )a� Parses a text representation of a protocol message into a message. NOTE: for historical reasons this function does not clear the input message. This is different from what the binary msg.ParseFrom(...) does. Example a = MyProto() a.repeated_field.append('test') b = MyProto() text_format.Parse(repr(a), b) text_format.Parse(repr(a), b) # repeated_field contains ["test", "test"] # Binary version: b.ParseFromString(a.SerializeToString()) # repeated_field is now "test" Caller is responsible for clearing the message as needed. Args: text: Message text representation. message: A protocol buffer message to merge into. allow_unknown_extension: if True, skip over missing extensions and keep parsing allow_field_number: if True, both field number and field name are allowed. descriptor_pool: A DescriptorPool used to resolve Any types. Returns: The same message passed as argument. Raises: ParseError: On text parsing problems. zutf-8rM )r9 )r+ r r$ �PY3�decoder- � ParseLines�split)�textr �allow_unknown_extension�allow_field_numberr9 r r r �Parse� s % r| c C s> t | t�s&tjr | jd�} n | jd�} t| jd�||||d�S )a^ Parses a text representation of a protocol message into a message. Like Parse(), but allows repeated values for a non-repeated field, and uses the last one. Args: text: Message text representation. message: A protocol buffer message to merge into. allow_unknown_extension: if True, skip over missing extensions and keep parsing allow_field_number: if True, both field number and field name are allowed. descriptor_pool: A DescriptorPool used to resolve Any types. Returns: The same message passed as argument. Raises: ParseError: On text parsing problems. zutf-8rM )r9 )r+ r r$ ru rv r- � MergeLinesrx )ry r rz r{ r9 r r r r � s c C s t |||d�}|j| |�S )a Parses a text representation of a protocol message into a message. Args: lines: An iterable of lines of a message's text representation. message: A protocol buffer message to merge into. allow_unknown_extension: if True, skip over missing extensions and keep parsing allow_field_number: if True, both field number and field name are allowed. descriptor_pool: A DescriptorPool used to resolve Any types. Returns: The same message passed as argument. Raises: ParseError: On text parsing problems. )r9 )�_Parserrw )�linesr rz r{ r9 �parserr r r rw s rw c C s t |||d�}|j| |�S )a Parses a text representation of a protocol message into a message. Args: lines: An iterable of lines of a message's text representation. message: A protocol buffer message to merge into. allow_unknown_extension: if True, skip over missing extensions and keep parsing allow_field_number: if True, both field number and field name are allowed. descriptor_pool: A DescriptorPool used to resolve Any types. Returns: The same message passed as argument. Raises: ParseError: On text parsing problems. )r9 )r~ r} )r r rz r{ r9 r� r r r r} 3 s r} c @ sn e Zd ZdZddd�Zdd� Zdd � Zd d � Zd d � Zdd� Z dd� Z dd� Z dd� Z e dd� �Zdd� ZdS )r~ z(Text format parser for protocol message.FNc C s || _ || _|| _d S )N)rz r{ r9 )r rz r{ r9 r r r r Q s z_Parser.__init__c C s& t |t�s|jd�}| j|jd�|�S )zBParses a text representation of a protocol message into a message.zutf-8rM )r+ r rv rw rx )r ry r r r r �ParseFromStringY s z_Parser.ParseFromStringc C s d| _ | j||� |S )zBParses a text representation of a protocol message into a message.F)�_allow_multiple_scalars� _ParseOrMerge)r r r r r r rw _ s z_Parser.ParseLinesc C s | j |jd�|�S )zBMerges a text representation of a protocol message into a message.rM )Z _MergeLinesrx )r ry r r r r rN e s z_Parser.MergeFromStringc C s d| _ | j||� |S )zBMerges a text representation of a protocol message into a message.T)r� r� )r r r r r r r} i s z_Parser.MergeLinesc C s& t |�}x|j� s | j||� q W dS )z�Converts a text representation of a protocol message into a message. Args: lines: Lines of a message's text representation. message: A protocol buffer message to merge into. Raises: ParseError: On text parsing problems. N)� Tokenizer�AtEnd� _MergeField)r r r � tokenizerr r r r� o s z_Parser._ParseOrMergec C s� |j }|jd�r�|j� g}x |jd�r6|j|j� � q W dj|�}|jsX|jd|j ��|jj |�}|s�| j rtd}q�|jd| ��n ||j kr�|jd||jf ��|j d� n�|j � }| jr�|j� r�t|dd�}|jj|d�}| r�|jr�|jj|�}nh|jj|d�}|�s8|jj|j� d�}|�r8|jtjjk�r8d}|�r`|jtjjk�r`|jj|k�r`d}|�sz|jd |j|f ��|�r^| j �r�|j �r�|j |j j�}|dk �r�||jk�r�|jd |j||j j|jf ��|j tjj k�r�|jd � | j!}n|j d � | j"}|j#tjj$k�rP|jd��rPx8||||� |jd��r>P |j d � �q$W n ||||� n| j �sjt%�t&|� |jd ��s�|jd � dS )z�Merges a single protocol message field into a message. Args: tokenizer: A tokenizer to parse the field name and values. message: A protocol message to record the data. Raises: ParseError: In case of text parsing problems. r_ �.z+Message type "%s" does not have extensions.Nz�Extension "%s" not registered. Did you import the _pb2 module which defines it? If you are trying to place the extension in the MessageSet field of another message that is in an Any or MessageSet field, that message's _pb2 module must be imported as wellz1Extension "%s" does not extend message type "%s".r` Tz*Message type "%s" has no field named "%s".zbField "%s" is specified along with field "%s", another member of oneof "%s" for message type "%s".�:�,�;)'rV � TryConsume�ConsumeIdentifier�append�joinZ is_extendable�ParseErrorPreviousTokenrW � ExtensionsZ_FindExtensionByNamerz rc �Consume�ConsumeIdentifierOrNumberr{ �isdigit� ParseIntegerZfields_by_numberrq Z_FindExtensionByNumber�fields_by_name�lowerr? r r@ rd rB re r� Zcontaining_oneofZ WhichOneofrf rg �_MergeMessageField�_MergeScalarFieldr\ r] �AssertionError�_SkipFieldContents) r r� r rJ re rD ra Z which_oneofZmergerr r r r� } s� z_Parser._MergeFieldc C s� |j � g}|jd� |j|j � � |jd� |j|j � � |jd� |j � g}x |jd�rj|j|j � � qPW dj|�dj|�fS )zBConsumes a google.protobuf.Any type URL and returns the type name.r� �/)r� r� r� r� r� )r r� �prefixre r r r �_ConsumeAnyTypeUrl� s z_Parser._ConsumeAnyTypeUrlc C s t |�}|jd�rd}n|jd� d}|jjtko:|jd��r | j|�\}}|jd� |jd� |jd�rpd}n|jd� d}t|| j�} | s�t d| ��x2|j|�s�|j � r�|j d |f ��| j || � q�W |j tjjkr�t||j�j� } n t||j�} | j| |d � n||j tjjk�r^|j�r2|j| j� } n*|�rLt||j�j� � } nt||j�j� } n(|j�rr|j| } n t||j�} | j� x8|j|��s�|j � �r�|j d |f ��| j || � �q�W |�r|jjd j} | tjjk�rt||j�| j } | j | j � n| j t||j�| j < d S ) a" Merges a single scalar field into a message. Args: tokenizer: A tokenizer to parse the field value. message: The message of which field is a member. field: The descriptor of the field to be merged. Raises: ParseError: In case of text parsing problems. rh ri rj rk r_ r` r� z$Type %s not found in descriptor poolzExpected "%s".)�type_url_prefixrF N) rE r� r� rB rW rX r� rK r9 r r� r� r� r\ r r@ r] �getattrre �addZPackrb r� r[ Z SetInParentr� rf rg rU Z MergeFromrF )r r� r rD Z is_map_entryZ end_tokenr� Zpacked_type_nameZexpanded_any_end_tokenZexpanded_any_sub_messageZ any_messageZ sub_messageZ value_cpptyperF r r r r� � sb z_Parser._MergeMessageFieldc C s | j }t|d�o|jdkS )N�syntax�proto3)rV �hasattrr� )r rJ r r r �_IsProto3SyntaxA s z_Parser._IsProto3Syntaxc C s | j }d}|jtjjtjjtjjfkr0t|�}n�|jtjjtjj tjj fkrVt |�}n�|jtjj tjj fkrvt|�}n�|jtjjtjjfkr�t|�}n�|jtjjtjjfkr�|j� }nr|jtjjkr�|j� }nZ|jtjjkr�|j� }nB|jtjjkr�|j� }n*|jtjjk�r|j |�}nt d|j ��|j tjj k�rf|j �rR|j!| j"|� nt#||j$�j"|� n�| j%|� }|j �r�| j& �r�|�r�|j'|��r�|j(d|j)j*|j*f ��n ||j!|< nF| j& �r�|�r�|j+|j$��r�|j(d|j)j*|j$f ��nt,||j$|� dS )aH Merges a single scalar field into a message. Args: tokenizer: A tokenizer to parse the field value. message: A protocol message to record the data. field: The descriptor of the field to be merged. Raises: ParseError: In case of text parsing problems. RuntimeError: On runtime errors. NzUnknown field type %dz;Message type "%s" should not have multiple "%s" extensions.z7Message type "%s" should not have multiple "%s" fields.)-rz r? r r@ Z TYPE_INT32Z TYPE_SINT32Z TYPE_SFIXED32� _ConsumeInt32Z TYPE_INT64Z TYPE_SINT64Z TYPE_SFIXED64� _ConsumeInt64Z TYPE_UINT32Z TYPE_FIXED32�_ConsumeUint32Z TYPE_UINT64Z TYPE_FIXED64�_ConsumeUint64Z TYPE_FLOATZ TYPE_DOUBLE� ConsumeFloatZ TYPE_BOOL� ConsumeBoolZ TYPE_STRING� ConsumeStringrr �ConsumeByteStringZ TYPE_ENUM� ConsumeEnum� RuntimeErrorr\ r] rb r� r� r� re r� r� Z HasExtensionr� rV rW ZHasField�setattr)r r� r rD �_rF Zcan_check_presencer r r r� G s\ z_Parser._MergeScalarField)FFN)r r r r r r� rw rN r} r� r� r� r� � staticmethodr� r� r r r r r~ N s mH r~ c C s8 | j d�r,| jd� r,| jd� r,t| � nt| � dS )z}Skips over contents (value or message) of a field. Args: tokenizer: A tokenizer to parse the field name and values. r� rj rh N)r� � LookingAt�_SkipFieldValue�_SkipFieldMessage)r� r r r r� � s r� c C s^ | j d�r6| j� x| j d�r(| j� qW | jd� n| j� t| � | j d�sZ| j d� dS )z�Skips over a complete field (name and value/message). Args: tokenizer: A tokenizer to parse the field name and values. r_ r� r` r� r� N)r� r� r� r� )r� r r r � _SkipField� s r� c C sR | j d�rd}n| jd� d}x$| jd� rB| jd� rBt| � q W | j|� dS )zfSkips over a field message. Args: tokenizer: A tokenizer to parse the field name and values. rh ri rj rk N)r� r� r� r� )r� Z delimiterr r r r� � s r� c C sT | j � rx | j � rq W dS | j� rPt| � rPt| � rP| j� rPtd| j ��dS )z�Skips over a field value. Args: tokenizer: A tokenizer to parse the field name and values. Raises: ParseError: In case an invalid field value is found. NzInvalid field value: )�TryConsumeByteString�TryConsumeIdentifier�_TryConsumeInt64�_TryConsumeUint64�TryConsumeFloatr �token)r� r r r r� � s r� c @ sH e Zd ZdZejd�Zejdej�Zejdej�Z ejdj ddgdd � e D � ��Z ejd �Z ejd �ZdEd d�Zdd� Zdd� Zdd� Zdd� Zdd� Zdd� Zdd � Zd d � Zd d � Zd!d"� Zd#d$� Zd%d&� Zd'd(� Z dFd*d+�Z d,d-� Z d.d/� Z d0d1� Z d2d3� Z!d4d5� Z"d6d7� Z#d8d9� Z$d:d;� Z%d<d=� Z&d>d?� Z'd@dA� Z(dBdC� Z)dDS )Gr� z�Protocol buffer text representation tokenizer. This class handles the lower level string parsing by splitting it into meaningful tokens. It was directly ported from the Java protocol buffer API. z\s+z (\s*#.*$)z (\s|(#.*$))+�|z[a-zA-Z_][0-9a-zA-Z_+-]*z#([0-9+-]|(\.[0-9]))[0-9a-zA-Z_.+-]*c C s g | ]}d j |d��qS )z!{qt}([^{qt}\n\\]|\\.)*({qt}|\\?$))Zqt)r )�.0Zmarkr r r � <listcomp>� s zTokenizer.<listcomp>z [^\d\W]\w*z\w+Tc C sl d| _ d| _d| _d | _d| _t|�| _d| _d| _d| _ d| _ || _ |rP| j pT| j | _| j� | j� d S )Nr � � T���)Z _positionr r Z _token_startr� �iter�_lines� _current_line�_previous_line�_previous_column� _more_lines�_skip_comments�_WHITESPACE_OR_COMMENT� _WHITESPACE�_whitespace_pattern�_SkipWhitespace� NextToken)r r Z skip_commentsr r r r � s zTokenizer.__init__c C s | j |kS )N)r� )r r� r r r r� s zTokenizer.LookingAtc C s | j S )z^Checks the end of the text was reached. Returns: True iff the end was reached. )r� )r r r r r� s zTokenizer.AtEndc C s` xZt | j�| jkrZyt| j�| _W n tk rB d| _d| _d S X | jd7 _d| _qW d S )Nr� Fr� r )�lenr� r �nextr� � StopIterationr� r )r r r r �_PopLine s zTokenizer._PopLinec C sF x@| j � | jj| j| j�}|s"P t|jd��}| j|7 _qW d S )Nr )r� r� �matchr� r r� �group)r r� Zlengthr r r r� s zTokenizer._SkipWhitespacec C s | j |kr| j� dS dS )z�Tries to consume a given piece of text. Args: token: Text to consume. Returns: True iff the text was consumed. TF)r� r� )r r� r r r r� ' s zTokenizer.TryConsumec C s | j |�s| jd| ��dS )z�Consumes a piece of text. Args: token: Text to consume. Raises: ParseError: If the text couldn't be consumed. zExpected "%s".N)r� r )r r� r r r r� 5 s zTokenizer.Consumec C s( | j }| jj|�s | jd��| j� |S )NzExpected comment.)r� �_COMMENTr� r r� )r r> r r r �ConsumeCommentA s zTokenizer.ConsumeCommentc C s: | j dko| jdk}| j}| j� }| j|ko0| }||fS )zCConsumes a comment, returns a 2-tuple (trailing bool, comment str).r )r r r� r� )r Z just_startedZbefore_parsingZcommentZtrailingr r r � ConsumeCommentOrTrailingCommentH s z)Tokenizer.ConsumeCommentOrTrailingCommentc C s& y | j � dS tk r dS X d S )NTF)r� r )r r r r r� X s z Tokenizer.TryConsumeIdentifierc C s( | j }| jj|�s | jd��| j� |S )z�Consumes protocol message field identifier. Returns: Identifier string. Raises: ParseError: If an identifier couldn't be consumed. zExpected identifier.)r� � _IDENTIFIERr� r r� )r r> r r r r� _ s zTokenizer.ConsumeIdentifierc C s& y | j � dS tk r dS X d S )NTF)r� r )r r r r � TryConsumeIdentifierOrNumbern s z&Tokenizer.TryConsumeIdentifierOrNumberc C s, | j }| jj|�s | jd| ��| j� |S )z�Consumes protocol message field identifier. Returns: Identifier string. Raises: ParseError: If an identifier couldn't be consumed. z&Expected identifier or number, got %s.)r� �_IDENTIFIER_OR_NUMBERr� r r� )r r> r r r r� u s z#Tokenizer.ConsumeIdentifierOrNumberc C s& y | j � dS tk r dS X d S )NTF)�ConsumeIntegerr )r r r r �TryConsumeInteger� s zTokenizer.TryConsumeIntegerFc C sP yt | j|d�}W n0 tk rB } z| jt|���W Y dd}~X nX | j� |S )z�Consumes an integer number. Args: is_long: True if the value should be returned as a long integer. Returns: The integer parsed. Raises: ParseError: If an integer couldn't be consumed. )�is_longN)�_ParseAbstractIntegerr� � ValueErrorr r r� )r r� r> �er r r r� � s zTokenizer.ConsumeIntegerc C s& y | j � dS tk r dS X d S )NTF)r� r )r r r r r� � s zTokenizer.TryConsumeFloatc C sL yt | j�}W n0 tk r> } z| jt|���W Y dd}~X nX | j� |S )z�Consumes an floating point number. Returns: The number parsed. Raises: ParseError: If a floating point number couldn't be consumed. N)� ParseFloatr� r� r r r� )r r> r� r r r r� � s zTokenizer.ConsumeFloatc C sL yt | j�}W n0 tk r> } z| jt|���W Y dd}~X nX | j� |S )z�Consumes a boolean value. Returns: The bool parsed. Raises: ParseError: If a boolean value couldn't be consumed. N)� ParseBoolr� r� r r r� )r r> r� r r r r� � s zTokenizer.ConsumeBoolc C s& y | j � dS tk r dS X d S )NTF)r� r )r r r r r� � s z Tokenizer.TryConsumeByteStringc C sF | j � }y tj|d�S tk r@ } z| j|��W Y dd}~X nX dS )z�Consumes a string value. Returns: The string parsed. Raises: ParseError: If a string value couldn't be consumed. zutf-8N)r� r$ r, �UnicodeDecodeError�_StringParseError)r Z the_bytesr� r r r r� � s zTokenizer.ConsumeStringc C s< | j � g}x&| jr0| jd tkr0|j| j � � q W dj|�S )z�Consumes a byte array value. Returns: The array parsed (as a string). Raises: ParseError: If a byte array value couldn't be consumed. r � )�_ConsumeSingleByteStringr� �_QUOTESr� r� )r Zthe_listr r r r� � s zTokenizer.ConsumeByteStringc C s� | j }t|�dk s |d tkr.| jd|f ��t|�dk sJ|d |d krZ| jd|f ��ytj|dd� �}W n0 tk r� } z| jt|���W Y dd}~X nX | j� |S ) aO Consume one token of a string literal. String literals (whether bytes or text) can come in multiple adjacent tokens which are automatically concatenated, like in C or Python. This method only consumes one token. Returns: The token parsed. Raises: ParseError: When the wrong format data is found. r� r z Expected string but found: %rrl z String missing ending quote: %rNr� r� ) r� r� r� r r Z CUnescaper� r r� )r ry r> r� r r r r� � s z"Tokenizer._ConsumeSingleByteStringc C sN yt || j�}W n0 tk r@ } z| jt|���W Y d d }~X nX | j� |S )N)� ParseEnumr� r� r r r� )r rD r> r� r r r r� s zTokenizer.ConsumeEnumc C s t || jd | jd �S )z�Creates and *returns* a ParseError for the previously read token. Args: message: A message to set for the exception. Returns: A ParseError instance. r� )r r� r� )r r r r r r� s z!Tokenizer.ParseErrorPreviousTokenc C s t || jd | jd �S )z9Creates and *returns* a ParseError for the current token.r� )r r r )r r r r r r s zTokenizer.ParseErrorc C s | j dt|� �S )NzCouldn't parse string: )r r )r r� r r r r� s zTokenizer._StringParseErrorc C s� | j | _| j| _| jt| j�7 _| j� | js<d| _dS | jj | j | j�}| rn| j rn| j j | j | j�}|r�|j d�}|| _n| j | j | _dS )z Reads the next meaningful token.r� Nr )r r� r r� r� r� r� r� �_TOKENr� r� r� r� r� )r r� r� r r r r� s zTokenizer.NextTokenN)T)F)*r r r r �re�compiler� � MULTILINEr� r� r� r� r� r� r� r r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r r� r� r r r r r� � sJ r� c C s t | ddd�S )z�Consumes a signed 32bit integer number from tokenizer. Args: tokenizer: A tokenizer used to parse the number. Returns: The integer parsed. Raises: ParseError: If a signed 32bit integer couldn't be consumed. TF)� is_signedr� )�_ConsumeInteger)r� r r r r� 8 s r� c C s t | ddd�S )z�Consumes an unsigned 32bit integer number from tokenizer. Args: tokenizer: A tokenizer used to parse the number. Returns: The integer parsed. Raises: ParseError: If an unsigned 32bit integer couldn't be consumed. F)r� r� )r� )r� r r r r� G s r� c C s& y t | � dS tk r dS X d S )NTF)r� r )r� r r r r� V s r� c C s t | ddd�S )z�Consumes a signed 32bit integer number from tokenizer. Args: tokenizer: A tokenizer used to parse the number. Returns: The integer parsed. Raises: ParseError: If a signed 32bit integer couldn't be consumed. T)r� r� )r� )r� r r r r� ^ s r� c C s& y t | � dS tk r dS X d S )NTF)r� r )r� r r r r� m s r� c C s t | ddd�S )z�Consumes an unsigned 64bit integer number from tokenizer. Args: tokenizer: A tokenizer used to parse the number. Returns: The integer parsed. Raises: ParseError: If an unsigned 64bit integer couldn't be consumed. FT)r� r� )r� )r� r r r r� u s r� c C s, yt | ||d� dS tk r& dS X d S )N)r� r� TF)r� r )r� r� r� r r r �_TryConsumeInteger� s r� c C sR yt | j||d�}W n0 tk rD } z| jt|���W Y dd}~X nX | j� |S )aU Consumes an integer number from tokenizer. Args: tokenizer: A tokenizer used to parse the number. is_signed: True if a signed integer must be parsed. is_long: True if a long integer must be parsed. Returns: The integer parsed. Raises: ParseError: If an integer with given characteristics couldn't be consumed. )r� r� N)r� r� r� r r r� )r� r� r� r> r� r r r r� � s r� c C s2 t | |d�}tdt|� t|� }|j|� |S )a Parses an integer. Args: text: The text to parse. is_signed: True if a signed integer must be parsed. is_long: True if a long integer must be parsed. Returns: The integer value. Raises: ValueError: Thrown Iff the text is not a valid integer. )r� rl )r� �_INTEGER_CHECKERS�intZ CheckValue)ry r� r� r> Zcheckerr r r r� � s r� c C sB y |rt | d�S t | d�S W n tk r< td| ��Y nX dS )a Parses an integer without checking size/signedness. Args: text: The text to parse. is_long: True if the value should be returned as a long integer. Returns: The integer value. Raises: ValueError: Thrown Iff the text is not a valid integer. r zCouldn't parse integer: %sN)r� r� )ry r� r r r r� � s r� c C s� yt | �S tk r� tj| �r@| d dkr6t d�S t d�S nBtj| �rRt d�S yt | jd��S tk r� td| ��Y nX Y nX dS ) z�Parse a floating point number. Args: text: Text to parse. Returns: The number parsed. Raises: ValueError: If a floating point number couldn't be parsed. r �-z-inf�inf�nan�fzCouldn't parse float: %sN)�floatr� �_FLOAT_INFINITYr� � _FLOAT_NANr3 )ry r r r r� � s r� c C s$ | d kr dS | dkrd S t d ��d S )z�Parse a boolean value. Args: text: Text to parse. Returns: Boolean values parsed Raises: ValueError: If text is not a valid boolean. rm �t�1�TrueTrn r� �0�FalseFzExpected "true" or "false".N)rm r� r� r� )rn r� r� r� )r� )ry r r r r� � s r� c C s� | j }yt|d�}W n< tk rP |jj|d�}|dkrLtd|j|f ��Y nFX t| jd�rn| jjdkrn|S |j j|d�}|dkr�td|j|f ��|j S )a& Parse an enum value. The value can be specified by a number (the enum value), or by a string literal (the enum name). Args: field: Enum field descriptor. value: String value. Returns: Enum value number. Raises: ValueError: If the enum value could not be parsed. r Nz%Enum type "%s" has no value named %s.r� r� z+Enum type "%s" has no value with number %d.) ro r� r� Zvalues_by_namerq rW r� �filer� rp ra )rD rF Zenum_descriptorra rt r r r r� s r� )r r ) FFFFNFNr N) r FFFFNFNN)r FFFFNN)r FFFFNN)FFN)FFN)FFN)FFN)FF)FF)FF)F)Br � __author__r& r� r$ ru r� ZlongZgoogle.protobuf.internalr rH r r �__all__ZUint32ValueCheckerZInt32ValueCheckerZUint64ValueCheckerZInt64ValueCheckerr� r� � IGNORECASEr� r� � frozensetr@ Z CPPTYPE_FLOATZCPPTYPE_DOUBLErs r� rX � Exceptionr r �objectr# r rE r r r rK r2 r| r rw r} r~ r� r� r� r� r� Z _Tokenizerr� r� r� r� r� r� r� r� r� r� r� r� r� r r r r �<module>) s� ) J / # A W
Save File
Cancel