← Back
Editing: patcomp.cpython-34.pyo
� i f� � @ s d Z d Z d d l Z d d l Z d d l m Z m Z m Z m Z m Z m Z d d l m Z d d l m Z e j j e j j e � d � Z Gd d � d e � Z d d � Z Gd d � d e � Z i e j d 6e j d 6e j d 6d d 6Z d d � Z d d � Z d d � Z d S)z�Pattern compiler. The grammer is taken from PatternGrammar.txt. The compiler compiles a pattern to a pytree.*Pattern instance. z#Guido van Rossum <guido@python.org>� N� )�driver�literals�token�tokenize�parse�grammar)�pytree)�pygramzPatternGrammar.txtc @ s e Z d Z d S)�PatternSyntaxErrorN)�__name__� __module__� __qualname__� r r �4/opt/alt/python34/lib64/python3.4/lib2to3/patcomp.pyr s r c c sq t j t j t j h } t j t j | � j � } x7 | D]/ } | \ } } } } } | | k r: | Vq: q: Wd S)z6Tokenizes a string suppressing significant whitespace.N) r �NEWLINE�INDENT�DEDENTr �generate_tokens�io�StringIO�readline) �input�skip�tokensZ quintuple�type�value�start�endZ line_textr r r �tokenize_wrapper! s r c @ sX e Z d Z e d d � Z d d d d � Z d d � Z d d d � Z d d � Z d S) �PatternCompilerc C s^ t j | � | _ t j | j � | _ t j | _ t j | _ t j | j d t �| _ d S)z^Initializer. Takes an optional alternative filename for the pattern grammar. �convertN) r Z load_grammarr r ZSymbols�symsZpython_grammarZ pygrammarZpython_symbols�pysymsZDriver�pattern_convert)�selfZ grammar_filer r r �__init__- s zPatternCompiler.__init__Fc C s� t | � } y | j j | d | �} Wn: t j k rd } z t t | � � � WYd d } ~ Xn X| r~ | j | � | f S| j | � Sd S)z=Compiles a pattern string to a nested pytree.*Pattern object.�debugN)r r Z parse_tokensr Z ParseErrorr �str� compile_node)r% r r' Z with_treer �root�er r r �compile_pattern8 s %z PatternCompiler.compile_patternc sK | j � j j k r% | j d } n | j � j j k r� � f d d � | j d d d � D� } t | � d k r} | d St j d d � | D� d d d d �} | j � S| j � j j k r"� f d d � | j D� } t | � d k r� | d St j | g d d d d �} | j � S| j � j j k rl� j | j d d � � } t j | � } | j � Sd } | j } t | � d k r�| d j t j k r�| d j } | d d � } n d } t | � d k r| d j � j j k r| d } | d d � } n � j | | � } | d k r)| j } | d } | j t j k rfd } t j } nx | j t j k r�d } t j } nT | j t j k r�� j | d � } } t | � d k r�� j | d � } q�n | d k s�| d k r)| j � } t j | g g d | d | �} q)n | d k rA| | _ n | j � S)zXCompiles a node, recursively. This is one big switch on the node type. r c s g | ] } � j | � � q Sr )r) )�.0�ch)r% r r � <listcomp>P s z0PatternCompiler.compile_node.<locals>.<listcomp>N� r c S s g | ] } | g � q Sr r )r- �ar r r r/ S s �min�maxc s g | ] } � j | � � q Sr )r) )r- r. )r% r r r/ W s � � ���r6 r6 )r r" ZMatcher�childrenZ Alternatives�lenr �WildcardPattern�optimizeZ AlternativeZ NegatedUnit� compile_basicZNegatedPatternr �EQUALr ZRepeater�STARZHUGE�PLUS�LBRACE�get_int�name) r% �nodeZalts�pZunits�patternrA �nodes�repeatr7 Zchildr2 r3 r )r% r r) D s^ )( ( + ' z PatternCompiler.compile_nodeNc C s� | d } | j t j k rJ t t j | j � � } t j t | � | � S| j t j k rd| j } | j � r� | t k r� t d | � � n | d d � r� t d � � n t j t | � S| d k r� d } nF | j d � st | j | d � } | d k rt d | � � qn | d d � rK| j | d j d � g } n d } t j | | � Sna | j d k r�| j | d � S| j d k r�| j | d � } t j | g g d d d d �Sd S) Nr zInvalid token: %rr z Can't have details for token�any�_zInvalid symbol: %r�(�[r2 r3 )r r �STRINGr( r Z evalStringr r Z LeafPattern�_type_of_literal�NAME�isupper� TOKEN_MAPr � startswith�getattrr# r) r7 Z NodePatternr9 )r% rE rF rB r r Zcontent� subpatternr r r r; � s8 z PatternCompiler.compile_basicc C s t | j � S)N)�intr )r% rB r r r r@ � s zPatternCompiler.get_int) r r r �_PATTERN_GRAMMAR_FILEr& r, r) r; r@ r r r r r + s G#r rM rK �NUMBERZTOKENc C s9 | d j � r t j S| t j k r1 t j | Sd Sd S)Nr )�isalphar rM r Zopmap)r r r r rL � s rL c C sW | \ } } } } | s' | | j k r= t j | | d | �St j | | d | �Sd S)z9Converts raw node information to a Node or Leaf instance.�contextN)Z number2symbolr ZNodeZLeaf)r Z raw_node_infor r rW r7 r r r r$ � s r$ c C s t � j | � S)N)r r, )rD r r r r, � s r, ) �__doc__� __author__r �osZpgen2r r r r r r � r r �path�join�dirname�__file__rT � Exceptionr r �objectr rM rK rU rO rL r$ r, r r r r �<module> s$ . �
Save File
Cancel