/usr/local/lib/python3.6/site-packages/joblib/__pycache__
Edit: /usr/local/lib/python3.6/site-packages/joblib/__pycache__/hashing.cpython-36.pyc (6265B)
3
Eg() @ s d Z ddlZddlZddlZddlZddlZddlZddlZejZ G dd de
Z G dd de
Z G dd de Z
G d d
d
e
Zdd
dZdS )zb
Fast cryptographic hash of Python objects, with a special case for fast
hashing of numpy arrays.
Nc @ s e Zd ZdZdd ZdS )_ConsistentSetza Class used to ensure the hash of Sets is preserved
whatever the order of its items.
c C sB yt || _W n. ttjfk
r< t dd |D | _Y nX d S )Nc s s | ]}t |V qd S )N)hash).0e r 8/usr/local/lib/python3.6/site-packages/joblib/hashing.py
% s z*_ConsistentSet.__init__..)sorted _sequence TypeErrordecimalInvalidOperation)selfZ set_sequencer r r __init__ s z_ConsistentSet.__init__N)__name__
__module__ __qualname____doc__r r r r r r s r c @ s e Zd ZdZdd ZdS )_MyHashz7 Class used to hash objects that won't normally pickle c G s
|| _ d S )N)args)r r r r r r + s z_MyHash.__init__N)r r r r r r r r r r ( s r c @ s e Zd ZdZdddZdddZdd Zd
d Zd ej fd
dZ
e j j
Z e
e ee< e
e ee< e
e ee < e
e eej< dd Zdd Zee ee < d S )HasherzW A subclass of pickler, to do cryptographic hashing, rather than
pickling.
md5c C s0 t j | _d}tj| | j|d tj|| _d S )N )protocol)ioBytesIOstreamPicklerr hashlibnew_hash)r hash_namer r r r r 4 s
zHasher.__init__Tc C sv y| j | W n> tjk
rL } z | jd||f f7 _ W Y d d }~X nX | jj }| jj| |rr| jj S d S )Nz"PicklingError while hashing %r: %r) dumppickle
PicklingErrorr r getvaluer update hexdigest)r objZ
return_digestr dumpsr r r r = s
z Hasher.hashc C s t |tjti jfr|t|dr*|jj}n|j}|j}t|tt krTt
||j}n(|d krht
||}n|jj }t
|||}t j
| | d S )N__func__)
isinstancetypes
MethodTypetypepophasattrr* r __self__r# r __class__r save)r r( func_nameinstclsr r r r3 H s
z Hasher.savec C s" t |ttfrd S tj| | d S )N)r+ bytesstrr memoize)r r( r r r r9 [ s zHasher.memoizeNc C s t ||d}|d= ytj| |f| W nl tjk
r tj| |f| t|dd }|dkr|}|d krn|j}tj| }t ||st
||| Y nX d S )N)namepackr; r __main__) dictr save_globalr# r$ getattrr sysmodulesr0 setattr)r r( r: r; kwargsmoduleZmy_namemodr r r r> f s
zHasher.save_globalc C sP yt j| tt| W n2 tk
rJ t j| ttdd |D Y nX d S )Nc s s | ]\}}t ||fV qd S )N)r )r kvr r r r s z)Hasher._batch_setitems..)r _batch_setitemsiterr r )r itemsr r r rH s
zHasher._batch_setitemsc C s t j| t| d S )N)r r3 r )r Z set_itemsr r r save_set s zHasher.save_set)r )T)r r r r r r r3 r9 structr; r> r dispatchcopyr. lenobjectr# r" rH rK setr r r r r / s
r c @ s" e Zd ZdZd ddZdd ZdS )
NumpyHasherz7 Special case the hasher for when numpy is loaded.
r Fc C s@ || _ tj| |d ddl}|| _t|dr6|j| _nt| _dS )a
Parameters
----------
hash_name: string
The hash algorithm to be used
coerce_mmap: boolean
Make no difference between np.memmap and np.ndarray
objects.
)r! r N getbuffer) coerce_mmapr r numpynpr0 rS
_getbuffer
memoryview)r r! rT rV r r r r s
zNumpyHasher.__init__c C s t || jjr|jj r|jf kr,|j }n&|jjr:|}n|jj rJ|j
}n|j }| j j | j
|j| jj | jrt || jjr| jj}n|j}|d|j|j|jff}n6t || jjr| j j djd | j j tj| dS tj| | dS )z Subclass the save method, to hash ndarray subclass, rather
than pickling them. Off course, this is a total abuse of
the Pickler class.
ZHASHEDZ
_HASHED_DTYPEzutf-8N)r+ rV ZndarrayZdtypeZ hasobjectshapeflattenflags c_contiguous f_contiguousTr r& rW viewZuint8rT Zmemmapr2 stridesencoder# r) r r3 )r r( Zobj_c_contiguousklassr r r r3 s&
zNumpyHasher.saveN)r F)r r r r r r3 r r r r rR s
rR r Fc C sH d}||kr t dj||dtjkr4t||d}n
t|d}|j| S )al Quick calculation of a hash to identify uniquely Python objects
containing numpy arrays.
Parameters
-----------
hash_name: 'md5' or 'sha1'
Hashing algorithm used. sha1 is supposedly safer, but md5 is
faster.
coerce_mmap: boolean
Make no difference between np.memmap and np.ndarray
r sha1zAValid options for 'hash_name' are {}. Got hash_name={!r} instead.rU )r! rT )r! )r rc )
ValueErrorformatr@ rA rR r r )r( r! rT Zvalid_hash_namesZhasherr r r r s
r )r F)r r# r r@ r, rL r r _Picklerr rP r r r rR r r r r r s kZ