/usr/local/lib/python3.6/site-packages/joblib/__pycache__
Edit: /usr/local/lib/python3.6/site-packages/joblib/__pycache__/compressor.cpython-36.pyc (16616B)
3
Eg:M $ @ s d Z ddlZddlZddlmZ yddlmZ W n ek
rP ddlmZ Y nX y ddl Z W n ek
rv dZ Y nX yddl
Z
ddl m Z W n ek
r dZ
Y nX y ddl
Z
W n ek
r dZ
Y nX dZi adZdZd Zd
Zd Zd Zd
Zd'ddZG dd dZG dd deZG dd deZG dd deZG dd deZ dZ dZ d Z d Z d Z!G d d d ej"Z#G d!d" d"eZ$G d#d$ d$e#Z%G d%d& d&eZ&dS )(z/Classes and functions for managing compressors. N) LooseVersion)RLock) LZ4FrameFilezMLZ4 is not installed. Install it with pip: https://python-lz4.readthedocs.io/s ZF xs s BZs 7zXZs ] s "MFc C s t | tstdj| t |ts0tdj||jdk rt|jd srt|jd srt|jd srt|jd rtdj|j| tkr| rtd j| |t| < dS )
zRegister a new compressor.
Parameters
-----------
compressor_name: str.
The name of the compressor.
compressor: CompressorWrapper
An instance of a 'CompressorWrapper'.
z/Compressor name should be a string, '{}' given.zHCompressor should implement the CompressorWrapper interface, '{}' given.Nreadwriteseektellz^Compressor 'fileobj_factory' attribute should implement the file object interface, '{}' given.z#Compressor '{}' already registered.)
isinstancestr
ValueErrorformatCompressorWrapperfileobj_factoryhasattr _COMPRESSORS)Zcompressor_nameZ
compressorforce r ;/usr/local/lib/python3.6/site-packages/joblib/compressor.pyregister_compressor- s"
r c @ s, e Zd ZdZd ddZd ddZd d
ZdS )
r a A wrapper around a compressor file object.
Attributes
----------
obj: a file-like object
The object must implement the buffer interface and will be used
internally to compress/decompress the data.
prefix: bytestring
A bytestring corresponding to the magic number that identifies the
file format associated to the compressor.
extention: str
The file extension used to automatically select this compressor during
a dump to a file.
c C s || _ || _|| _d S )N)r prefix extension)selfobjr r r r r __init__a s zCompressorWrapper.__init__Nc C s( |dkr| j |dS | j |d|dS dS )z0Returns an instance of a compressor file object.Nwb)
compresslevel)r )r fileobjr r r r compressor_filef s z!CompressorWrapper.compressor_filec C s | j |dS )z2Returns an instance of a decompressor file object.rb)r )r r r r r decompressor_filen s z#CompressorWrapper.decompressor_file)r r )N)__name__
__module__ __qualname____doc__r r r" r r r r r Q s
r c @ s6 e Zd ZeZdZdd Zdd Zd ddZd d
Z dS ) BZ2CompressorWrapperz.bz2c C s t d k rt j| _nd | _d S )N)bz2BZ2Filer )r r r r r x s
z BZ2CompressorWrapper.__init__c C s t d krtdd S )Nz;bz2 module is not compiled on your python standard library.)r( r )r r r r _check_versions~ s z$BZ2CompressorWrapper._check_versionsNc C s0 | j |dkr | j|dS | j|d|dS dS )z0Returns an instance of a compressor file object.Nr )r )r* r )r r r r r r r s
z$BZ2CompressorWrapper.compressor_filec C s | j | j|d}|S )z2Returns an instance of a decompressor file object.r! )r* r )r r r r r r" s z&BZ2CompressorWrapper.decompressor_file)N)
r# r$ r% _BZ2_PREFIXr r r r* r r" r r r r r' s s
r' c @ s: e Zd ZeZdZdZdd Zdd Zd dd Z d
d Z
dS )
LZMACompressorWrapperz.lzma FORMAT_ALONEc C s* t d k r t j| _tt | j| _nd | _d S )N)lzmaLZMAFiler getattr_lzma_format_name _lzma_format)r r r r r s z LZMACompressorWrapper.__init__c C s t d krtdd S )Nz
= 2.7.
If filename is a str or bytes object, it gives the name
of the file to be opened. Otherwise, it should be a file object,
which will be used to read or write the compressed data.
mode can be 'rb' for reading (default) or 'wb' for (over)writing
If mode is 'wb', compresslevel can be a number between 1
and 9 specifying the level of compression: 1 produces the least
compression, and 9 produces the most compression. 3 is the default.
r! rA c C s t | _d | _d| _t| _d| _d| _|| _t |t
sRd| koJdkn r`t dj ||dkrt
| _tj| j| _d| _d| _n:|dkrt| _tj| jtj| jtjd| _nt d |f t |trtj||| _d
| _n&t |d st |d r|| _nt d
d S )NFr r; zS'compresslevel' must be an integer between 1 and 9. You provided 'compresslevel={}'r! r r zInvalid mode: %rTr r z1filename must be a str or bytes object, or a file) r _lock_fp_closefp _MODE_CLOSED_mode_pos_sizer r
intr r
_MODE_READzlib
decompressobjwbits
_decompressor_buffer_buffer_offset _MODE_WRITE compressobjDEFLATED
DEF_MEM_LEVEL _compressorr ioopenr TypeError)r filenamemoder r r r r s6 &
zBinaryZlibFile.__init__c C s | j | jtkrdS z<| jttfkr.d| _n"| jtkrP| jj| j j
d| _ W dz| j rf| jj W dd| _d| _ t| _d| _
d| _X X W dQ R X dS )zFlush and close the file.
May be called more than once without error. Once the file is
closed, any other operation on it will raise a ValueError.
NFr r )rE rI rH rM _MODE_READ_EOFrQ rT rF r rX flushrG closerR rS )r r r r r` ' s"
zBinaryZlibFile.closec C s
| j tkS )z True if this file is closed.)rI rH )r r r r closedA s zBinaryZlibFile.closedc C s | j | jj S )z3Return the file descriptor for the underlying file.)_check_not_closedrF fileno)r r r r rc F s zBinaryZlibFile.filenoc C s | j o| jj S )z)Return whether the file supports seeking.)readablerF seekable)r r r r re K s zBinaryZlibFile.seekablec C s | j | jttfkS )z/Return whether the file was opened for reading.)rb rI rM r^ )r r r r rd O s zBinaryZlibFile.readablec C s | j | jtkS )z/Return whether the file was opened for writing.)rb rI rT )r r r r writableT s zBinaryZlibFile.writablec C sB | j r>t| jdd }d}|d k r.|dj|7 }|d7 }t|d S )Nnamez I/O operation on closed filez {}.)ra r0 rF r
r )r fnamemsgr r r rb [ s z BinaryZlibFile._check_not_closedc C s$ | j ttfkr | j tjdd S )NzFile not open for reading)rI rM r^ rb rY UnsupportedOperation)r r r r _check_can_readd s z BinaryZlibFile._check_can_readc C s | j tkr | j tjdd S )NzFile not open for writing)rI rT rb rY rk )r r r r _check_can_writei s
z BinaryZlibFile._check_can_writec C s8 | j ttfkr | j tjd| jj s4tjdd S )Nz3Seeking is only supported on files open for readingz3The underlying file object does not support seeking)rI rM r^ rb rY rk rF re )r r r r _check_can_seekn s
z BinaryZlibFile._check_can_seekc C s | j tkrdS xl| jt| jkrzy | jjp4| jjt }|s>t
W n" t
k
rb t| _ | j | _ dS X | jj
|| _d| _qW dS )NFr T)rI r^ rS lenrR rQ unused_datarF r _BUFFER_SIZEEOFErrorrJ rK
decompress)r rawblockr r r _fill_bufferx s
zBinaryZlibFile._fill_bufferTc C sf | j | jd | _ d| _g }x6| j rR|r6|j| j | jt| j 7 _d| _ q W |rbdj|S d S )Nr r )rR rS ru appendrJ ro join)r return_datablocksr r r _read_all s
zBinaryZlibFile._read_allc C s | j | }|t| jkrL| j| j | }|| _ | jt|7 _|rH|S d S | j| j d | _d| _ g }xp|dkr| j r|t| jk r| jd | }|| _ n | j}d| _|r|j| | jt|7 _|t|8 }qjW |rdj|S d S )Nr r )rS ro rR rJ ru rv rw )r Zn_bytesrx enddatary r r r _read_block s*
zBinaryZlibFile._read_blockr; c C sD | j 4 | j |dkr dS |dk r,| j S | j|S W dQ R X dS )zRead up to size uncompressed bytes from the file.
If size is negative or omitted, read until EOF is reached.
Returns b'' if the file is already at EOF.
r r N)rE rl rz r} )r sizer r r r s zBinaryZlibFile.readc
C s | j tjj| |S Q R X dS )z_Read up to len(b) bytes into b.
Returns the number of bytes read (0 for EOF).
N)rE rY BufferedIOBasereadinto)r br r r r s zBinaryZlibFile.readintoc C s^ | j N | j t|tr"|j }| jj|}| jj| | j t
|7 _ t
|S Q R X dS )zWrite a byte string to the file.
Returns the number of uncompressed bytes written, which is
always len(data). Note that due to buffering, the file on disk
may not reflect the data written until close() is called.
N) rE rm r
memoryviewtobytesrX compressrF r rJ ro )r r|
compressedr r r r s
zBinaryZlibFile.writec C s8 | j jdd t| _d| _tj| j| _d| _ d| _
d S )Nr r ) rF r rM rI rJ rN rO rP rQ rR rS )r r r r _rewind s zBinaryZlibFile._rewindr c C s | j | j |dkrnL|dkr.| j| }n8|dkrX| jdk rL| jdd | j| }ntd|f || jk rz| j n
|| j8 }| j|dd | jS Q R X dS )a Change the file position.
The new position is specified by offset, relative to the
position indicated by whence. Values for whence are:
0: start of stream (default); offset must not be negative
1: current stream position
2: end of stream; offset must not be positive
Returns the new file position.
Note that seeking is emulated, so depending on the parameters,
this operation may be extremely slow.
r r; r@ F)rx z Invalid value for whence: %sN)rE rn rJ rK rz r r r} )r offsetwhencer r r r s
zBinaryZlibFile.seekc C s | j | j | jS Q R X dS )z!Return the current file position.N)rE rb rJ )r r r r r s zBinaryZlibFile.tellN)r! rA )T)TrD )rD )r ) r# r$ r% r& rN MAX_WBITSrP r r` propertyra rc re rd rf rb rl rm rn ru rz r} r r r r r r r r r r rB s,
&
*rB c @ s e Zd Zdd ZdS )ZlibCompressorWrapperc C s t j| ttdd d S )Nz.z)r r r )r r rB _ZLIB_PREFIX)r r r r r s z ZlibCompressorWrapper.__init__N)r# r$ r% r r r r r r s r c @ s e Zd ZdZdZdS )BinaryGzipFilea
A file object providing transparent gzip (de)compression.
If filename is a str or bytes object, it gives the name
of the file to be opened. Otherwise, it should be a file object,
which will be used to read or write the compressed data.
mode can be 'rb' for reading (default) or 'wb' for (over)writing
If mode is 'wb', compresslevel can be a number between 1
and 9 specifying the level of compression: 1 produces the least
compression, and 9 produces the most compression. 3 is the default.
N)r# r$ r% r& rP r r r r r % s r c @ s e Zd Zdd ZdS )GzipCompressorWrapperc C s t j| ttdd d S )Nz.gz)r r r )r r r _GZIP_PREFIX)r r r r r 8 s z GzipCompressorWrapper.__init__N)r# r$ r% r r r r r r 6 s r )F)'r& rY rN Zdistutils.versionr threadingr ImportErrordummy_threadingr( r9 Z lz4.framer r. r< r Z
_ZFILE_PREFIXr r r+ r7 r4 r? r r r' r, r5 r8 rH rM r^ rT rq r rB r r r r r r r s\
#" !% 9