Name	Size	Mode	Actions
benchmark.cpython-36.pyc	208	0644	editdlrm
cffi.cpython-36.pyc	1482	0644	editdlrm
compat.cpython-36.pyc	381	0644	editdlrm
compute.cpython-36.pyc	20263	0644	editdlrm
csv.cpython-36.pyc	382	0644	editdlrm
cuda.cpython-36.pyc	405	0644	editdlrm
dataset.cpython-36.pyc	27970	0644	editdlrm
feather.cpython-36.pyc	7739	0644	editdlrm
filesystem.cpython-36.pyc	14402	0644	editdlrm
flight.cpython-36.pyc	1353	0644	editdlrm
fs.cpython-36.pyc	10395	0644	editdlrm
hdfs.cpython-36.pyc	7055	0644	editdlrm
ipc.cpython-36.pyc	7394	0644	editdlrm
json.cpython-36.pyc	231	0644	editdlrm
jvm.cpython-36.pyc	8035	0644	editdlrm
orc.cpython-36.pyc	5140	0644	editdlrm
pandas_compat.cpython-36.pyc	27695	0644	editdlrm
parquet.cpython-36.pyc	66609	0644	editdlrm
plasma.cpython-36.pyc	4069	0644	editdlrm
serialization.cpython-36.pyc	13737	0644	editdlrm
types.cpython-36.pyc	12083	0644	editdlrm
util.cpython-36.pyc	4150	0644	editdlrm
_generated_version.cpython-36.pyc	223	0644	editdlrm
__init__.cpython-36.pyc	16476	0644	editdlrm

3 9%Egy%�@sndZd
dl
ZGdd�d�Zdd�Zdd�Zd d �Zdd�Zd d�Zdd�Z dd�Z dd�Zdd�Zdd�Z dS)a�
Functions to interact with Arrow memory allocated by Arrow Java. These functions convert the objects holding the metadata, the actual data is not copied at all. This will only work with a JVM running in the same process such as provided through jpype. Modules that talk to a remote JVM like py4j will not work as the memory addresses reported by them are not reachable in the python process. �Nc@s$eZ
dZd
ZdZdd�Zdd�ZdS)�_JvmBufferNannyz` An object that keeps a org.apache.arrow.memory.ArrowBuf's underlying memory alive. NcCs|
j�}|j
�
||_dS)
N)ZgetReferenceManagerZretain�ref_manager)�self�jvm_bufr�r�7/usr/local/lib64/python3.6/site-packages/pyarrow/jvm.py�__init__&s

z_JvmBufferNanny.__init__c

Cs|jdk r|jj
�
dS)
N)r�release)
rrrr�__del__.s

z_JvmBufferNanny.__del__)�__name__� __module__�__qualname__�__doc__rrr rrrrrs
rc
Cs(t|�
}
|j
�}|j�}tj|||
d
�S)a)
Construct an Arrow buffer from org.apache.arrow.memory.ArrowBuf Parameters ---------- jvm_buf: org.apache.arrow.memory.ArrowBuf Arrow Buffer representation on the JVM. Returns ------- pyarrow.Buffer Python Buffer that references the JVM memory. )
�base)rZ memoryAddress�capacity�paZforeign_buffer)rZnanny�address�sizerrr� jvm_buffer3s


rc
Cs�|j�}
|j
�rR|
d
kr tj�S|
dkr0tj�S|
dkr@tj�S|
dkr�tj�Sn@|
d
krbtj�S|
dkrrtj�S|
dkr�tj �S|
dkr�tj �SdS)z� Convert a JVM int type to its Python equivalent. Parameters ---------- jvm_type : org.apache.arrow.vector.types.pojo.ArrowType$Int Returns ------- typ : pyarrow.DataType ��� �@N)�getBitWidthZgetIsSignedrZint8Zint16Zint32Zint64Zuint8Zuint16Zuint32Zuint64)�jvm_typeZ bit_widthrrr�_from_jvm_int_typeHs$ 















rc
Cs@|j�j
�}
|
d
krtj�S|
dkr,tj�S|
dkr�s
zfield..)r,�getName�getType� isComplexZ getTypeIDrr�nullrr�string�binaryZgetByteWidthZbool_r*r/r0Z decimal128rZgetScale�NotImplementedError�formatZ isNullableZgetMetadata�isEmpty�entrySet�field)Z jvm_field�namer�typZtype_strZnullable�jvm_metadata�metadatarrrrD�sL 































rDc
CsJ|j�}
d
d�|
D�
}
|j
�}|j�r,d}ndd�|j�D�
}tj|
|�S)z� Construct a Schema from a org.apache.arrow.vector.types.pojo.Schema instance. Parameters ---------- jvm_schema: org.apache.arrow.vector.types.pojo.Schema Returns ------- pyarrow.Schema c
Ssg|]}
t|
�
�qSr)
rD)r7�
frrr� 
szschema..Nc
Ss"i|]}
t|
j
��
t|
j��
�qSr)r,r5r6)r7r8rrrr9
s
zschema..)Z getFieldsZgetCustomMetadatarBrCr�schema)Z jvm_schema�fieldsrGrHrrrrK
s 





rKc
Cs�|j�j
�j�r*|j�j�}
td
j|
�
�
�
t|j��
j}dd�t |j d�
�
D�
}t|�
dkrjtj g|d�S|j�}|j�}tjj||||�S)z� Construct an (Python) Array from its JVM equivalent. Parameters ---------- jvm_array : org.apache.arrow.vector.ValueVector Returns ------- array : Array zMCannot convert JVM Arrow array of type {}, complex types not yet implemented.c
Ssg|]}
t|
�
�qSr)
r)r7�bufrrrrJ-
s
zarray..Fr
)
�type)ZgetFieldr;r<ZgetMinorTyperr@rArDrN�listZ getBuffers�lenr�arrayZ getValueCountZgetNullCount�ArrayZfrom_buffers)Z jvm_arrayZminor_type_strZdtype�buffers�lengthZ null_countrrrrQ
s









rQc
CsJt|j
��
}
g}x"|
jD]}|jt|j|�
�
�

qWtjj||
j|
j d
�S)z� Construct a (Python) RecordBatch from a JVM VectorSchemaRoot Parameters ---------- jvm_vector_schema_root : org.apache.arrow.vector.VectorSchemaRoot Returns ------- record_batch: pyarrow.RecordBatch )
rH) rKZ getSchema�names�appendrQZ getVectorrZRecordBatchZfrom_arraysrH)Zjvm_vector_schema_rootZ pa_schemaZarraysrErrr�record_batch9
s




rW)rZpyarrowrrrrrr*r/r0rDrKrQrWrrrr�s"<