← Back
Editing: utf8prober.cpython-37.pyc
B <_9Y� � @ sH d dl mZ d dlmZmZ d dlmZ d dlmZ G dd� de�Z dS )� )� CharSetProber)� ProbingState� MachineState)�CodingStateMachine)� UTF8_SM_MODELc sT e Zd ZdZ� fdd�Z� fdd�Zedd� �Zedd � �Zd d � Z d d � Z � Z S )� UTF8Proberg �?c s* t t| ��� tt�| _d | _| �� d S )N)�superr �__init__r r � coding_sm� _num_mb_chars�reset)�self)� __class__� �C/opt/alt/python37/lib/python3.7/site-packages/chardet/utf8prober.pyr & s zUTF8Prober.__init__c s" t t| ��� | j�� d| _d S )N� )r r r r r )r )r r r r , s zUTF8Prober.resetc C s dS )Nzutf-8r )r r r r � charset_name1 s zUTF8Prober.charset_namec C s dS )N� r )r r r r �language5 s zUTF8Prober.languagec C s� xj|D ]b}| j �|�}|tjkr,tj| _P q|tjkrBtj| _P q|tj kr| j � � dkr| j d7 _ qW | j tj kr�| �� | jkr�tj| _| j S )N� r )r Z next_stater �ERRORr ZNOT_ME�_stateZITS_MEZFOUND_ITZSTARTZget_current_charlenr �stateZ DETECTING�get_confidenceZSHORTCUT_THRESHOLD)r Zbyte_str�cZ coding_stater r r �feed9 s zUTF8Prober.feedc C s. d}| j dk r&|| j| j 9 }d| S |S d S )Ng�G�z��?� g �?)r � ONE_CHAR_PROB)r Zunliker r r r L s zUTF8Prober.get_confidence) �__name__� __module__� __qualname__r r r �propertyr r r r � __classcell__r r )r r r # s r N) Z charsetproberr Zenumsr r Zcodingstatemachiner Zmbcssmr r r r r r �<module> s
Save File
Cancel