← Back
Editing: utf8prober.cpython-38.pyc
U ��.e� � @ sH d dl mZ d dlmZmZ d dlmZ d dlmZ G dd� de�Z dS )� )� CharSetProber)� ProbingState� MachineState)�CodingStateMachine)� UTF8_SM_MODELc sT e Zd ZdZ� fdd�Z� fdd�Zedd� �Zedd � �Zd d � Z d d � Z � Z S )� UTF8Proberg �?c s* t t| ��� tt�| _d | _| �� d S )N)�superr �__init__r r � coding_sm� _num_mb_chars�reset��self�� __class__� �B/usr/lib/python3.8/site-packages/pip/_vendor/chardet/utf8prober.pyr & s zUTF8Prober.__init__c s" t t| ��� | j�� d| _d S )N� )r r r r r r r r r r , s zUTF8Prober.resetc C s dS )Nzutf-8r r r r r � charset_name1 s zUTF8Prober.charset_namec C s dS )N� r r r r r �language5 s zUTF8Prober.languagec C s� |D ]f}| j �|�}|tjkr,tj| _ qlq|tjkrDtj| _ qlq|tj kr| j � � dkr| j d7 _ q| j tj kr�| �� | jkr�tj| _| j S )N� r )r Z next_stater ZERRORr ZNOT_MEZ_stateZITS_MEZFOUND_ITZSTARTZget_current_charlenr �stateZ DETECTING�get_confidenceZSHORTCUT_THRESHOLD)r Zbyte_str�cZ coding_stater r r �feed9 s zUTF8Prober.feedc C s. d}| j dk r&|| j| j 9 }d| S |S d S )Ng�G�z��?� g �?)r � ONE_CHAR_PROB)r Zunliker r r r L s zUTF8Prober.get_confidence) �__name__� __module__� __qualname__r r r �propertyr r r r � __classcell__r r r r r # s r N) Z charsetproberr Zenumsr r Zcodingstatemachiner Zmbcssmr r r r r r �<module> s
Save File
Cancel