← Back
Editing: hebrewprober.cpython-311.pyc
� �|oi�8 � �V � d dl mZmZ ddlmZ ddlmZ ddlmZ G d� de� � Z dS ) � )�Optional�Union� )� CharSetProber)� ProbingState)�SingleByteCharSetProberc � � � e Zd ZdZdZdZdZdZdZdZ dZ d Z d Z d Z d Zd ZdZdZd � fd� Zd d�Zdededdfd�Zdedefd�Zdedefd�Zdeee f de fd�Z e de fd �� � Z!e de fd �� � Z"e de fd �� � Z#� xZ$S ) � HebrewProber� �� �� �� �� �� �� �� �� � � � g{�G�z�?z ISO-8859-8z windows-1255�returnNc �� �� t � � � � � d| _ d| _ | j | _ | j | _ d | _ d | _ | � � � d S �Nr ) �super�__init__�_final_char_logical_score�_final_char_visual_score�SPACE�_prev� _before_prev�_logical_prober�_visual_prober�reset)�self� __class__s ��K/opt/cloudlinux/venv/lib64/python3.11/site-packages/chardet/hebrewprober.pyr zHebrewProber.__init__� s] �� � ��������)*��&�()��%��Z�� � �J���BF�� �AE��� � � � � � � � � c �R � d| _ d| _ | j | _ | j | _ d S r )r r r r r �r$ s r& r# zHebrewProber.reset� s- � �)*��&�()��%� �Z�� � �J����r' �logical_prober� visual_proberc �" � || _ || _ d S �N)r! r" )r$ r* r+ s r& �set_model_probersz HebrewProber.set_model_probers� s � � .�� � +����r' �cc �F � || j | j | j | j | j fv S r- )� FINAL_KAF� FINAL_MEM� FINAL_NUN�FINAL_PE� FINAL_TSADI�r$ r/ s r& �is_finalzHebrewProber.is_final� s. � �� �N� �N� �N� �M� � � � � r' c �: � || j | j | j | j fv S r- )� NORMAL_KAF� NORMAL_MEM� NORMAL_NUN� NORMAL_PEr6 s r& � is_non_finalzHebrewProber.is_non_final� s � � �T�_�d�o�t����W�W�Wr' �byte_strc �" � | j t j k r t j S | � |� � }|D ]�}|| j k rf| j | j k rU| � | j � � r| xj dz c_ np| � | j � � r| xj dz c_ nE| j | j k r5| � | j � � r|| j k r| xj dz c_ | j | _ || _ ��t j S )Nr ) �stater �NOT_ME�filter_high_byte_onlyr r r7 r r r= r � DETECTING)r$ r> �curs r& �feedzHebrewProber.feed� s# � �6 �:� �,� ,� ,� �&� &��-�-�h�7�7��� � �C��d�j� � ��$�� �2�2� �}�}�T�Z�0�0� ;� �6�6�!�;�6�6�6� �*�*�4�:�6�6� ;� �5�5��:�5�5�� �&�$�*�4�4� � � �t�z�2�2� 5� �� �*�*� �1�1�Q�6�1�1� $� �D� � �D�J�J� �%�%r' c �f � | j �J �| j �J �| j | j z }|| j k r| j S || j k r| j S | j � � � | j � � � z }|| j k r| j S || j k r| j S |dk r| j S | j S )Ng ) r! r" r r �MIN_FINAL_CHAR_DISTANCE�LOGICAL_HEBREW_NAME�VISUAL_HEBREW_NAME�get_confidence�MIN_MODEL_DISTANCE)r$ �finalsub�modelsubs r& � charset_namezHebrewProber.charset_name s� � ��#�/�/�/��"�.�.�.� �1�D�4Q�Q�� �t�3� 3� 3��+� +� ��4�4� 4� 4��*� *� � � /� /� 1� 1�D�4G�4V�4V�4X�4X� X� � �d�-� -� -��+� +� �t�.�.� .� .��*� *� �c�>�>��*� *� �'�'r' c � � dS )N�Hebrew� r) s r& �languagezHebrewProber.language. s � ��xr' c � � | j �J �| j �J �| j j t j k r&| j j t j k r t j S t j S r- )r! r" r@ r rA rC r) s r& r@ zHebrewProber.state2 s\ � ��#�/�/�/��"�.�.�.� � � &�,�*=� =� =� � � %� �)<� <� <� �&� &��%�%r' )r N)%�__name__� __module__� __qualname__r r1 r9 r2 r: r3 r; r4 r< r5 � NORMAL_TSADIrG rK rI rH r r# r r. �int�boolr7 r= r �bytes� bytearrayr rE �property�strrN rR r@ � __classcell__)r% s @r& r r � s� �� � � � � � �E��I��J��I��J��I��J��H��I��K��L� �� ��%��(��� � � � � �'� '� '� '�,�/�,� /�,� � ,� ,� ,� ,� �#� �$� � � � � X�c� X�d� X� X� X� X�<&�U�5�)�#3� 4� <&� � <&� <&� <&� <&�| � (�c� (� (� (� �X� (�< ��#� � � � �X�� � &�|� &� &� &� �X� &� &� &� &� &r' r N) �typingr r � charsetproberr �enumsr �sbcharsetproberr r rQ r' r& �<module>rc s� ��8 #� "� "� "� "� "� "� "� (� (� (� (� (� (� � � � � � � 4� 4� 4� 4� 4� 4�Hx&� x&� x&� x&� x&�=� x&� x&� x&� x&� x&r'
Save File
Cancel