← Back
Editing: eucjpprober.cpython-38.pyc
U ��.e� � @ s` d dl mZmZ d dlmZ d dlmZ d dlmZ d dl m Z d dl m Z G dd� de�Z d S ) � )� ProbingState� MachineState)�MultiByteCharSetProber)�CodingStateMachine)�EUCJPDistributionAnalysis)�EUCJPContextAnalysis)�EUCJP_SM_MODELc sP e Zd Z� fdd�Z� fdd�Zedd� �Zedd� �Zd d � Zd d � Z � Z S ) � EUCJPProberc s4 t t| ��� tt�| _t� | _t� | _ | � � d S �N) �superr �__init__r r � coding_smr �distribution_analyzerr �context_analyzer�reset��self�� __class__� �C/usr/lib/python3.8/site-packages/pip/_vendor/chardet/eucjpprober.pyr % s zEUCJPProber.__init__c s t t| ��� | j�� d S r )r r r r r r r r r , s zEUCJPProber.resetc C s dS )NzEUC-JPr r r r r � charset_name0 s zEUCJPProber.charset_namec C s dS )NZJapaneser r r r r �language4 s zEUCJPProber.languagec C s6 t t|��D ]�}| j�|| �}|tjkrN| j�d| j| j |� t j | _ q�q |tj krft j| _ q�q |tjkr | j�� }|dkr�|d | jd< | j�| j|� | j�| j|� q | j�||d |d � |� | j�||d |d � |� q |d | jd< | jt jk�r0| j�� �r0| �� | jk�r0t j| _ | jS )Nz!%s %s prober hit error at byte %s� r ���)�range�lenr Z next_stater ZERRORZlogger�debugr r r ZNOT_MEZ_stateZITS_MEZFOUND_ITZSTARTZget_current_charlenZ _last_charr �feedr �stateZ DETECTINGZgot_enough_data�get_confidenceZSHORTCUT_THRESHOLD)r Zbyte_str�iZ coding_stateZchar_lenr r r r 8 s@ � �� �zEUCJPProber.feedc C s | j �� }| j�� }t||�S r )r r r �max)r Z context_confZ distrib_confr r r r Y s zEUCJPProber.get_confidence) �__name__� __module__� __qualname__r r �propertyr r r r � __classcell__r r r r r $ s !r N)Zenumsr r Zmbcharsetproberr Zcodingstatemachiner Zchardistributionr Zjpcntxr Zmbcssmr r r r r r �<module> s
Save File
Cancel