/usr/lib/python2.7/site-packages/chardet
Edit: /usr/lib/python2.7/site-packages/chardet/chardistribution.pyc (7539B)
ó
é3ķXc @ s* d d l m Z m Z m Z d d l m Z m Z m Z d d l m Z m
Z
m Z d d l m
Z
m Z m Z d d l m Z m Z m Z d e f d YZ d e f d YZ d
e f d YZ d e f d
YZ d e f d YZ d e f d YZ d e f d YZ d S( i ( t EUCTW_CHAR_TO_FREQ_ORDERt EUCTW_TABLE_SIZEt EUCTW_TYPICAL_DISTRIBUTION_RATIO( t EUCKR_CHAR_TO_FREQ_ORDERt EUCKR_TABLE_SIZEt EUCKR_TYPICAL_DISTRIBUTION_RATIO( t GB2312_CHAR_TO_FREQ_ORDERt GB2312_TABLE_SIZEt! GB2312_TYPICAL_DISTRIBUTION_RATIO( t BIG5_CHAR_TO_FREQ_ORDERt BIG5_TABLE_SIZEt BIG5_TYPICAL_DISTRIBUTION_RATIO( t JIS_CHAR_TO_FREQ_ORDERt JIS_TABLE_SIZEt JIS_TYPICAL_DISTRIBUTION_RATIOt CharDistributionAnalysisc B sV e Z d Z d Z d Z d Z d Z d Z d Z d Z d Z
d Z RS(
i g®Gįz®ļ?g{®Gįz?i c C sD d | _ d | _ d | _ d | _ d | _ d | _ | j d S( N( t Nonet _char_to_freq_ordert _table_sizet typical_distribution_ratiot _donet _total_charst _freq_charst reset( t self( ( s< /usr/lib/python2.7/site-packages/chardet/chardistribution.pyt __init__. s c C s t | _ d | _ d | _ d S( s reset analyser, clear any statei N( t FalseR R R ( R ( ( s< /usr/lib/python2.7/site-packages/chardet/chardistribution.pyR = s c C s} | d k r | j | } n d } | d k ry | j d 7_ | | j k ry d | j | k rv | j d 7_ qv qy n d S( s" feed a character with known lengthi i’’’’i i i N( t get_orderR R R R ( R t chart char_lent order( ( s< /usr/lib/python2.7/site-packages/chardet/chardistribution.pyt feedF s c C su | j d k s! | j | j k r( | j S| j | j k rn | j | j | j | j } | | j k rn | Sn | j S( s( return confidence based on existing datai ( R R t MINIMUM_DATA_THRESHOLDt SURE_NOR t SURE_YES( R t r( ( s< /usr/lib/python2.7/site-packages/chardet/chardistribution.pyt get_confidenceT s ! c C s | j | j k S( N( R t ENOUGH_DATA_THRESHOLD( R ( ( s< /usr/lib/python2.7/site-packages/chardet/chardistribution.pyt got_enough_datad s c C s d S( Ni’’’’( ( R t byte_str( ( s< /usr/lib/python2.7/site-packages/chardet/chardistribution.pyR i s ( t __name__t
__module__R% R" R! R R R R R$ R& R ( ( ( s< /usr/lib/python2.7/site-packages/chardet/chardistribution.pyR ( s t EUCTWDistributionAnalysisc B s e Z d Z d Z RS( c C s2 t t | j t | _ t | _ t | _ d S( N( t superR* R R R R R R R ( R ( ( s< /usr/lib/python2.7/site-packages/chardet/chardistribution.pyR r s c C s6 | d } | d k r. d | d | d d Sd Sd S( Ni iÄ i^ i i” i’’’’( ( R R' t
first_char( ( s< /usr/lib/python2.7/site-packages/chardet/chardistribution.pyR x s
( R( R) R R ( ( ( s< /usr/lib/python2.7/site-packages/chardet/chardistribution.pyR* q s t EUCKRDistributionAnalysisc B s e Z d Z d Z RS( c C s2 t t | j t | _ t | _ t | _ d S( N( R+ R- R R R R R R R ( R ( ( s< /usr/lib/python2.7/site-packages/chardet/chardistribution.pyR
s c C s6 | d } | d k r. d | d | d d Sd Sd S( Ni i° i^ i i” i’’’’( ( R R' R, ( ( s< /usr/lib/python2.7/site-packages/chardet/chardistribution.pyR s
( R( R) R R ( ( ( s< /usr/lib/python2.7/site-packages/chardet/chardistribution.pyR- s t GB2312DistributionAnalysisc B s e Z d Z d Z RS( c C s2 t t | j t | _ t | _ t | _ d S( N( R+ R. R R R R R R R ( R ( ( s< /usr/lib/python2.7/site-packages/chardet/chardistribution.pyR s c C sI | d | d } } | d k rA | d k rA d | d | d Sd Sd S( Ni i i° i” i^ i’’’’( ( R R' R, t second_char( ( s< /usr/lib/python2.7/site-packages/chardet/chardistribution.pyR s ( R( R) R R ( ( ( s< /usr/lib/python2.7/site-packages/chardet/chardistribution.pyR. s t Big5DistributionAnalysisc B s e Z d Z d Z RS( c C s2 t t | j t | _ t | _ t | _ d S( N( R+ R0 R R R R
R R R ( R ( ( s< /usr/lib/python2.7/site-packages/chardet/chardistribution.pyR « s c C sd | d | d } } | d k r\ | d k rE d | d | d d Sd | d | d Sn d Sd S( Ni i i¤ i” i i? i@ i’’’’( ( R R' R, R/ ( ( s< /usr/lib/python2.7/site-packages/chardet/chardistribution.pyR ± s ( R( R) R R ( ( ( s< /usr/lib/python2.7/site-packages/chardet/chardistribution.pyR0 Ŗ s t SJISDistributionAnalysisc B s e Z d Z d Z RS( c C s2 t t | j t | _ t | _ t | _ d S( N( R+ R1 R R R R
R R R ( R ( ( s< /usr/lib/python2.7/site-packages/chardet/chardistribution.pyR Į s c C s | d | d } } | d k r> | d k r> d | d } n1 | d k rk | d k rk d | d d } n d S| | d
} | d k r d } n | S( Ni i i i i¼ ią iļ i i’’’’i@ i ( ( R R' R, R/ R ( ( s< /usr/lib/python2.7/site-packages/chardet/chardistribution.pyR Ē s ( R( R) R R ( ( ( s< /usr/lib/python2.7/site-packages/chardet/chardistribution.pyR1 Ą s t EUCJPDistributionAnalysisc B s e Z d Z d Z RS( c C s2 t t | j t | _ t | _ t | _ d S( N( R+ R2 R R R R
R R R ( R ( ( s< /usr/lib/python2.7/site-packages/chardet/chardistribution.pyR Ś s c C s6 | d } | d k r. d | d | d d Sd Sd S( Ni i i^ i” i i’’’’( ( R R' R ( ( s< /usr/lib/python2.7/site-packages/chardet/chardistribution.pyR ą s
( R( R) R R ( ( ( s< /usr/lib/python2.7/site-packages/chardet/chardistribution.pyR2 Ł s N( t euctwfreqR R R t euckrfreqR R R t
gb2312freqR R R t big5freqR R
R t jisfreqR R
R t objectR R* R- R. R0 R1 R2 ( ( ( s< /usr/lib/python2.7/site-packages/chardet/chardistribution.pyt
s I