← Back
Editing: patcomp.cpython-34.pyc
� i f� � @ s d Z d Z d d l Z d d l Z d d l m Z m Z m Z m Z m Z m Z d d l m Z d d l m Z e j j e j j e � d � Z Gd d � d e � Z d d � Z Gd d � d e � Z i e j d 6e j d 6e j d 6d d 6Z d d � Z d d � Z d d � Z d S)z�Pattern compiler. The grammer is taken from PatternGrammar.txt. The compiler compiles a pattern to a pytree.*Pattern instance. z#Guido van Rossum <guido@python.org>� N� )�driver�literals�token�tokenize�parse�grammar)�pytree)�pygramzPatternGrammar.txtc @ s e Z d Z d S)�PatternSyntaxErrorN)�__name__� __module__� __qualname__� r r �4/opt/alt/python34/lib64/python3.4/lib2to3/patcomp.pyr s r c c sq t j t j t j h } t j t j | � j � } x7 | D]/ } | \ } } } } } | | k r: | Vq: q: Wd S)z6Tokenizes a string suppressing significant whitespace.N) r �NEWLINE�INDENT�DEDENTr �generate_tokens�io�StringIO�readline) �input�skip�tokensZ quintuple�type�value�start�endZ line_textr r r �tokenize_wrapper! s r c @ sX e Z d Z e d d � Z d d d d � Z d d � Z d d d � Z d d � Z d S) �PatternCompilerc C s^ t j | � | _ t j | j � | _ t j | _ t j | _ t j | j d t �| _ d S)z^Initializer. Takes an optional alternative filename for the pattern grammar. �convertN) r Z load_grammarr r ZSymbols�symsZpython_grammarZ pygrammarZpython_symbols�pysymsZDriver�pattern_convert)�selfZ grammar_filer r r �__init__- s zPatternCompiler.__init__Fc C s� t | � } y | j j | d | �} Wn: t j k rd } z t t | � � � WYd d } ~ Xn X| r~ | j | � | f S| j | � Sd S)z=Compiles a pattern string to a nested pytree.*Pattern object.�debugN)r r Z parse_tokensr Z ParseErrorr �str� compile_node)r% r r' Z with_treer �root�er r r �compile_pattern8 s %z PatternCompiler.compile_patternc s� | j � j j k r% | j d } n | j � j j k r� � f d d � | j d d d � D� } t | � d k r} | d St j d d � | D� d d d d �} | j � S| j � j j k r"� f d d � | j D� } t | � d k r� | d St j | g d d d d �} | j � S| j � j j k rl� j | j d d � � } t j | � } | j � S| j � j j k s�t � d } | j } t | � d k r�| d j t j k r�| d j } | d d � } n d } t | � d k r,| d j � j j k r,| d } | d d � } n � j | | � } | d k r�| j � j j k set � | j } | d } | j t j k r�d } t j } n� | j t j k r�d } t j } n� | j t j k rH| d j t j k s�t � t | � d k st � � j | d � } } t | � d k rT� j | d � } qTn d sTt � | d k sl| d k r�| j � } t j | g g d | d | �} q�n | d k r�| | _ n | j � S)zXCompiles a node, recursively. This is one big switch on the node type. r c s g | ] } � j | � � q Sr )r) )�.0�ch)r% r r � <listcomp>P s z0PatternCompiler.compile_node.<locals>.<listcomp>N� r c S s g | ] } | g � q Sr r )r- �ar r r r/ S s �min�maxc s g | ] } � j | � � q Sr )r) )r- r. )r% r r r/ W s � � F���r6 r6 r6 )r4 r5 )r r" ZMatcher�childrenZ Alternatives�lenr �WildcardPattern�optimizeZ AlternativeZ NegatedUnit� compile_basicZNegatedPatternZUnit�AssertionErrorr �EQUALr ZRepeater�STARZHUGE�PLUS�LBRACE�RBRACE�get_int�name) r% �nodeZalts�pZunits�patternrC �nodes�repeatr7 Zchildr2 r3 r )r% r r) D sh )( ( + ' z PatternCompiler.compile_nodeNc C s t | � d k s t � | d } | j t j k rb t t j | j � � } t j t | � | � S| j t j k r|| j } | j � r� | t k r� t d | � � n | d d � r� t d � � n t j t | � S| d k r� d } nF | j d � s3t | j | d � } | d k r3t d | � � q3n | d d � rc| j | d j d � g } n d } t j | | � Sns | j d k r�| j | d � S| j d k r�| d k s�t � | j | d � } t j | g g d d d d �Sd st | � � d S) Nr r zInvalid token: %rz Can't have details for token�any�_zInvalid symbol: %r�(�[r2 r3 F)r8 r< r r �STRINGr( r Z evalStringr r Z LeafPattern�_type_of_literal�NAME�isupper� TOKEN_MAPr � startswith�getattrr# r) r7 Z NodePatternr9 )r% rG rH rD r r Zcontent� subpatternr r r r; � s< z PatternCompiler.compile_basicc C s% | j t j k s t � t | j � S)N)r r �NUMBERr< �intr )r% rD r r r rB � s zPatternCompiler.get_int) r r r �_PATTERN_GRAMMAR_FILEr& r, r) r; rB r r r r r + s G#r rO rM rU ZTOKENc C s9 | d j � r t j S| t j k r1 t j | Sd Sd S)Nr )�isalphar rO r Zopmap)r r r r rN � s rN c C sW | \ } } } } | s' | | j k r= t j | | d | �St j | | d | �Sd S)z9Converts raw node information to a Node or Leaf instance.�contextN)Z number2symbolr ZNodeZLeaf)r Z raw_node_infor r rY r7 r r r r$ � s r$ c C s t � j | � S)N)r r, )rF r r r r, � s r, ) �__doc__� __author__r �osZpgen2r r r r r r � r r �path�join�dirname�__file__rW � Exceptionr r �objectr rO rM rU rQ rN r$ r, r r r r �<module> s$ . �
Save File
Cancel