← Back
Editing: chardistribution.pyo
� ��abc @ s* d d l m Z m Z m Z d d l m Z m Z m Z d d l m Z m Z m Z d d l m Z m Z m Z d d l m Z m Z m Z d e f d � � YZ d e f d � � YZ d e f d � � YZ d e f d � � YZ d e f d � � YZ d e f d � � YZ d e f d � � YZ d S( i ( t EUCTW_CHAR_TO_FREQ_ORDERt EUCTW_TABLE_SIZEt EUCTW_TYPICAL_DISTRIBUTION_RATIO( t EUCKR_CHAR_TO_FREQ_ORDERt EUCKR_TABLE_SIZEt EUCKR_TYPICAL_DISTRIBUTION_RATIO( t GB2312_CHAR_TO_FREQ_ORDERt GB2312_TABLE_SIZEt! GB2312_TYPICAL_DISTRIBUTION_RATIO( t BIG5_CHAR_TO_FREQ_ORDERt BIG5_TABLE_SIZEt BIG5_TYPICAL_DISTRIBUTION_RATIO( t JIS_CHAR_TO_FREQ_ORDERt JIS_TABLE_SIZEt JIS_TYPICAL_DISTRIBUTION_RATIOt CharDistributionAnalysisc B sV e Z d Z d Z d Z d Z d � Z d � Z d � Z d � Z d � Z d � Z RS( i g�G�z��?g{�G�z�?i c C sD d | _ d | _ d | _ d | _ d | _ d | _ | j � d S( N( t Nonet _char_to_freq_ordert _table_sizet typical_distribution_ratiot _donet _total_charst _freq_charst reset( t self( ( sH /usr/lib/python2.7/site-packages/pip/_vendor/chardet/chardistribution.pyt __init__. s c C s t | _ d | _ d | _ d S( s reset analyser, clear any statei N( t FalseR R R ( R ( ( sH /usr/lib/python2.7/site-packages/pip/_vendor/chardet/chardistribution.pyR = s c C s} | d k r | j | � } n d } | d k ry | j d 7_ | | j k ry d | j | k rv | j d 7_ qv qy n d S( s" feed a character with known lengthi i����i i i N( t get_orderR R R R ( R t chart char_lent order( ( sH /usr/lib/python2.7/site-packages/pip/_vendor/chardet/chardistribution.pyt feedF s c C su | j d k s! | j | j k r( | j S| j | j k rn | j | j | j | j } | | j k rn | Sn | j S( s( return confidence based on existing datai ( R R t MINIMUM_DATA_THRESHOLDt SURE_NOR t SURE_YES( R t r( ( sH /usr/lib/python2.7/site-packages/pip/_vendor/chardet/chardistribution.pyt get_confidenceT s ! c C s | j | j k S( N( R t ENOUGH_DATA_THRESHOLD( R ( ( sH /usr/lib/python2.7/site-packages/pip/_vendor/chardet/chardistribution.pyt got_enough_datad s c C s d S( Ni����( ( R t byte_str( ( sH /usr/lib/python2.7/site-packages/pip/_vendor/chardet/chardistribution.pyR i s ( t __name__t __module__R% R" R! R R R R R$ R& R ( ( ( sH /usr/lib/python2.7/site-packages/pip/_vendor/chardet/chardistribution.pyR ( s t EUCTWDistributionAnalysisc B s e Z d � Z d � Z RS( c C s2 t t | � j � t | _ t | _ t | _ d S( N( t superR* R R R R R R R ( R ( ( sH /usr/lib/python2.7/site-packages/pip/_vendor/chardet/chardistribution.pyR r s c C s6 | d } | d k r. d | d | d d Sd Sd S( Ni i� i^ i i� i����( ( R R' t first_char( ( sH /usr/lib/python2.7/site-packages/pip/_vendor/chardet/chardistribution.pyR x s ( R( R) R R ( ( ( sH /usr/lib/python2.7/site-packages/pip/_vendor/chardet/chardistribution.pyR* q s t EUCKRDistributionAnalysisc B s e Z d � Z d � Z RS( c C s2 t t | � j � t | _ t | _ t | _ d S( N( R+ R- R R R R R R R ( R ( ( sH /usr/lib/python2.7/site-packages/pip/_vendor/chardet/chardistribution.pyR � s c C s6 | d } | d k r. d | d | d d Sd Sd S( Ni i� i^ i i� i����( ( R R' R, ( ( sH /usr/lib/python2.7/site-packages/pip/_vendor/chardet/chardistribution.pyR � s ( R( R) R R ( ( ( sH /usr/lib/python2.7/site-packages/pip/_vendor/chardet/chardistribution.pyR- � s t GB2312DistributionAnalysisc B s e Z d � Z d � Z RS( c C s2 t t | � j � t | _ t | _ t | _ d S( N( R+ R. R R R R R R R ( R ( ( sH /usr/lib/python2.7/site-packages/pip/_vendor/chardet/chardistribution.pyR � s c C sI | d | d } } | d k rA | d k rA d | d | d Sd Sd S( Ni i i� i� i^ i����( ( R R' R, t second_char( ( sH /usr/lib/python2.7/site-packages/pip/_vendor/chardet/chardistribution.pyR � s ( R( R) R R ( ( ( sH /usr/lib/python2.7/site-packages/pip/_vendor/chardet/chardistribution.pyR. � s t Big5DistributionAnalysisc B s e Z d � Z d � Z RS( c C s2 t t | � j � t | _ t | _ t | _ d S( N( R+ R0 R R R R R R R ( R ( ( sH /usr/lib/python2.7/site-packages/pip/_vendor/chardet/chardistribution.pyR � s c C sd | d | d } } | d k r\ | d k rE d | d | d d Sd | d | d Sn d Sd S( Ni i i� i� i� i? i@ i����( ( R R' R, R/ ( ( sH /usr/lib/python2.7/site-packages/pip/_vendor/chardet/chardistribution.pyR � s ( R( R) R R ( ( ( sH /usr/lib/python2.7/site-packages/pip/_vendor/chardet/chardistribution.pyR0 � s t SJISDistributionAnalysisc B s e Z d � Z d � Z RS( c C s2 t t | � j � t | _ t | _ t | _ d S( N( R+ R1 R R R R R R R ( R ( ( sH /usr/lib/python2.7/site-packages/pip/_vendor/chardet/chardistribution.pyR � s c C s� | d | d } } | d k r> | d k r> d | d } n1 | d k rk | d k rk d | d d } n d S| | d } | d k r� d } n | S( Ni i i� i� i� i� i� i i����i@ i ( ( R R' R, R/ R ( ( sH /usr/lib/python2.7/site-packages/pip/_vendor/chardet/chardistribution.pyR � s ( R( R) R R ( ( ( sH /usr/lib/python2.7/site-packages/pip/_vendor/chardet/chardistribution.pyR1 � s t EUCJPDistributionAnalysisc B s e Z d � Z d � Z RS( c C s2 t t | � j � t | _ t | _ t | _ d S( N( R+ R2 R R R R R R R ( R ( ( sH /usr/lib/python2.7/site-packages/pip/_vendor/chardet/chardistribution.pyR � s c C s6 | d } | d k r. d | d | d d Sd Sd S( Ni i� i^ i� i i����( ( R R' R ( ( sH /usr/lib/python2.7/site-packages/pip/_vendor/chardet/chardistribution.pyR � s ( R( R) R R ( ( ( sH /usr/lib/python2.7/site-packages/pip/_vendor/chardet/chardistribution.pyR2 � s N( t euctwfreqR R R t euckrfreqR R R t gb2312freqR R R t big5freqR R R t jisfreqR R R t objectR R* R- R. R0 R1 R2 ( ( ( sH /usr/lib/python2.7/site-packages/pip/_vendor/chardet/chardistribution.pyt <module> s I
Save File
Cancel