← Back
Editing: utf8prober.cpython-311.pyc
� �|oi� � �b � d dl mZ ddlmZ ddlmZ ddlmZmZ ddl m Z G d� de� � Z d S ) � )�Union� )� CharSetProber)�CodingStateMachine)� MachineState� ProbingState)� UTF8_SM_MODELc � � � e Zd ZdZd � fd� Zd � fd� Zedefd�� � Zedefd�� � Z de e e f de fd �Zdefd �Z� xZS ) � UTF8Proberg �?�returnNc � �� t � � � � � t t � � | _ d| _ | � � � d S �Nr )�super�__init__r r � coding_sm� _num_mb_chars�reset��self� __class__s ��I/opt/cloudlinux/venv/lib64/python3.11/site-packages/chardet/utf8prober.pyr zUTF8Prober.__init__' sA �� � ��������+�M�:�:��� ��� � � � � � � � � c � �� t � � � � � | j � � � d| _ d S r )r r r r r s �r r zUTF8Prober.reset- s6 �� � ��� � ���� �� � � � � � ����r c � � dS )Nzutf-8� �r s r � charset_namezUTF8Prober.charset_name2 s � ��wr c � � dS )N� r r s r �languagezUTF8Prober.language6 s � ��rr �byte_strc �� � |D ]�}| j � |� � }|t j k rt j | _ na|t j k rt j | _ n>|t j k r-| j � � � dk r| xj dz c_ ��| j t j k r.| � � � | j k rt j | _ | j S )N� r )r � next_stater �ERRORr �NOT_ME�_state�ITS_ME�FOUND_IT�START�get_current_charlenr �state� DETECTING�get_confidence�SHORTCUT_THRESHOLD)r r! �c� coding_states r �feedzUTF8Prober.feed: s� � �� ,� ,�A� �>�4�4�Q�7�7�L��|� 1�1�1� *� 1�� ����|� 2�2�2� *� 3�� ����|� 1�1�1��>�5�5�7�7�1�<�<��&�&�!�+�&�&�� �:� �/� /� /��"�"�$�$�t�'>�>�>� *� 3�� ��z�r c �N � d}| j dk r|| j | j z z }d|z S |S )Ng�G�z��?� g �?)r � ONE_CHAR_PROB)r �unlikes r r. zUTF8Prober.get_confidenceM s9 � ��� � �� !� !� �d�(�$�*<�<� <�F���<� �� r )r N)�__name__� __module__� __qualname__r5 r r �property�strr r r �bytes� bytearrayr r2 �floatr. � __classcell__)r s @r r r $ s� �� � � � � ��M�� � � � � � � � � � � � ��c� � � � �X�� ��#� � � � �X���U�5�)�#3� 4� � � � � � �&�� � � � � � � � r r N) �typingr � charsetproberr �codingstatemachiner �enumsr r �mbcssmr r r r r �<module>rE s� ��8 � � � � � � (� (� (� (� (� (� 2� 2� 2� 2� 2� 2� -� -� -� -� -� -� -� -� !� !� !� !� !� !�.� .� .� .� .� � .� .� .� .� .r
Save File
Cancel