← Back
Editing: _tokenizer.cpython-312.pyc
� ]*j � � � U d dl mZ d dlZd dlZd dlmZ d dlmZmZm Z ddl m Z e G d� d� � Z G d � d e � Zi d ej d � �d ej d� �d ej d� �d ej d� �d ej d� �d ej d� �d ej dej � �d ej d� �d ej d � �d ej d � �d ej d � �d! ej d"ej � �d# ej e j" ej ej$ z � �d$ ej d%� �d& ej d'� �d( ej d)� �d* ej d+� � ej d,� ej d-� ej d.� d/��Zd0ed1< G d2� d3� Zy)4� )� annotationsN)� dataclass)� Generator�Mapping�NoReturn� )� Specifierc �, � e Zd ZU ded< ded< ded< y)�Token�str�name�text�int�positionN)�__name__� __module__� __qualname__�__annotations__� � �C/opt/hc_python/lib/python3.12/site-packages/packaging/_tokenizer.pyr r s � � �I� �I��Mr r c �< � � e Zd ZdZ d� fd� Zdd�Z� xZS )�ParserSyntaxErrorz7The provided source text could not be parsed correctly.c �L �� || _ || _ || _ t �| � � y )N)�span�message�source�super�__init__)�selfr r r � __class__s �r r zParserSyntaxError.__init__ s% �� � �� � �� � �� � ���r c � � d| j d z d| j d | j d z z z dz }| j � d| j � d|� �S )N� r �~r �^z )r r r )r �markers r �__str__zParserSyntaxError.__str__" sW � ��t�y�y��|�#�c�T�Y�Y�q�\�D�I�I�a�L�-H�&I�I�C�O���,�,� �v�d�k�k�]�&���A�Ar )r r r r r ztuple[int, int]�return�None)r( r )r r r �__doc__r r' � __classcell__)r! s @r r r s7 �� �A� �� � � � � � � �Br r �LEFT_PARENTHESISz\(�RIGHT_PARENTHESISz\)� LEFT_BRACKETz\[� RIGHT_BRACKETz\]� SEMICOLON�;�COMMA�,� QUOTED_STRINGzk ( ('[^']*') | ("[^"]*") ) �OPz(===|==|~=|!=|<=|>=|<|>)�BOOLOPz \b(or|and)\b�INz\bin\b�NOTz\bnot\b�VARIABLEa� \b( python_version |python_full_version |os[._]name |sys[._]platform |platform_(release|system) |platform[._](version|machine|python_implementation) |python_implementation |implementation_(name|version) |extras? |dependency_groups )\b � SPECIFIER�ATz\@�URLz[^ \t]+� IDENTIFIERz \b[a-zA-Z0-9][a-zA-Z0-9._-]*\b�VERSION_PREFIX_TRAILz\.\*z \+[a-z0-9]+(?:[-_\.][a-z0-9]+)*z[ \t]+�$)�VERSION_LOCAL_LABEL_TRAIL�WS�ENDzdict[str, re.Pattern[str]]� DEFAULT_RULESc � � e Zd ZdZ d d�Zdd�Zdd�dd�Zdd�Zdd�Zd d d � dd �Z e j dd �� Z y )� Tokenizerz�Context-sensitive token parsing. Provides methods to examine the input stream to check whether the next token matches. c �< � || _ || _ d | _ d| _ y )Nr )r �rules� next_tokenr )r r rG s r r zTokenizer.__init__b s � � �� ��� �(,����� r c �H � | j |� r| j � yy)z8Move beyond provided token name, if at current position.N)�check�read)r r s r �consumezTokenizer.consumem s � � �:�:�d� � �I�I�K� r F)�peekc �, � | j �J d|�d| j ��� �|| j v s J d|��� �| j | }|j | j | j � }|�y|s t ||d | j � | _ y)z�Check whether the next token has the provided name. By default, if the check succeeds, the token *must* be read before another check. If `peek` is set to `True`, the token is not loaded and would need to be checked again. zCannot check for z, already have zUnknown token name: Fr T)rH rG �matchr r r )r r rM � expressionrO s r rJ zTokenizer.checkr s� � � ���&� � ��x��t���6I� J� �&� �t�z�z�!�B�%9�$��#B�B�!��Z�Z��%� �� � ����d�m�m�<�� �=��� #�D�%��(�D�M�M� B�D�O�r c �l � | j |� s| j d|� �� �| j � S )zsExpect a certain token name next, failing with a syntax error otherwise. The token is *not* read. z Expected )rJ �raise_syntax_errorrK )r r �expecteds r �expectzTokenizer.expect� s4 � � �z�z�$� ��)�)�I�h�Z�*@�A� A��y�y�{�r c � � | j }|�J �| xj t |j � z c_ d| _ |S )z%Consume the next token and return it.N)rH r �lenr )r �tokens r rK zTokenizer.read� s9 � ������ � � � � � ��U�Z�Z� �(� � ���� r N)� span_start�span_endc �r � |� | j n||� | j n|f}t || j |�� �)z.Raise ParserSyntaxError at the given position.)r r )r r r )r r rX rY r s r rR z Tokenizer.raise_syntax_error� sC � � (� /�D�M�M�Z� %� -�D�M�M�8� �� � ��;�;�� � r c # �� K � | j |� r | j }| j � nd }d �� |�y | j |� s | j d|� d|� d|� �|�� | j � y �w)NzExpected matching z for z, after )rX )rJ r rK rR )r � open_token� close_token�around� open_positions r �enclosing_tokenszTokenizer.enclosing_tokens� sz � �� � �:�:�j� !� �M�M�M� �I�I�K� �M� � � � ��z�z�+�&� � #� #�$�[�M��z�l�(�6�(�S�(� $� � � � � �s �A6A8)r r rG z Mapping[str, re.Pattern[str]]r( r) )r r r( r) )r r rM �boolr( ra )r r rS r r( r )r( r )r r rX � int | NonerY rb r( r )r\ r r] r r^ r r( zGenerator[None, None, None]) r r r r* r rL rJ rT rK rR � contextlib�contextmanagerr` r r r rE rE [ s� � �� �� � -� � � �� 05� �*�� "&� #� �� � � � � � � �$ � � �� ��,/��<?�� $�� �r rE )� __future__r rc �re� dataclassesr �typingr r r � specifiersr r � Exceptionr �compile�VERBOSE�_specifier_regex_str� IGNORECASErC r rE r r r �<module>ro sU �� "� � � !� /� /� !� �� � �� B� � B�*1-�� �� � �5�)�1-������E�*�1-� �J�B�J�J�u�%�1-� �Z�R�Z�Z��&� 1-� �����D�!� 1-� �Z�R�Z�Z�� � 1-� �Z�R�Z�Z� � � � � �1-�" �*�"�*�*�0� 1�#1-�$ �j�b�j�j� �)�%1-�& �*�"�*�*�Y� �'1-�( �:�2�:�:�j� !�)1-�* � �� � � � � � � �+1-�L ������&�&� � � �R�]�]�"��M1-�T �*�"�*�*�U� �U1-�V �:�2�:�:�j� !�W1-�X �*�"�*�*� >�?�Y1-�Z �J�B�J�J�w� /�[1-�\ ",����,N�!O� �"�*�*�Y� � �2�:�:�d� �a1-� �)� 1�hf� fr
Save File
Cancel