Current File : //lib64/python3.9/site-packages/numpy/lib/tests/__pycache__/test_io.cpython-39.opt-1.pyc
a
z[yc�� � @ s� d dl Z d dlZd dlZd dlZd dlZd dlZd dlZd dlZd dlZd dl Z d dl
m Z d dl m
Z
d dlmZmZ d dlmZ d dlZd dlmZmZ d dlmZ d dlZd dlmZ d dlm Z m Z d d l m Z d d
l m!Z! d d l"m#Z#m$Z$m%Z%m&Z&m'Z'm(Z(m)Z)m*Z*m+Z+m,Z,m-Z-m.Z.m/Z/m0Z0 d d l1m2Z2 G d
d� de�Z3e j4dkZ5zd dl6Z6dZ7W n e8�yr dZ7Y n0 zd dl9Z9dZ:W n e8�y� dZ:Y n0 d8dd�Z;G dd� d�Z<G dd� de<�Z=G dd� de<�Z>G dd� d�Z?G d d � d �Z@G d d � d e@�ZAG d d!� d!�ZBG d"d#� d#e@�ZCG d$d%� d%�ZDd&d'� ZEG d(d)� d)�ZFG d*d+� d+�ZGd,d-� ZHd.d/� ZId0d1� ZJd2d3� ZKe jLjMe, d4d5�d6d7� �ZNdS )9� N)�Path)�NamedTemporaryFile)�BytesIO�StringIO)�datetime)�Value� get_context)�c_bool)�ConverterError�ConversionWarning��asbytes)� assert_equal)� assert_warns�assert_�assert_raises_regex�
assert_raises�assert_allclose�assert_array_equal�temppath�tempdir�IS_PYPY� HAS_REFCOUNT�suppress_warnings�assert_no_gc_cycles�assert_no_warnings� break_cycles)�requires_memoryc @ s* e Zd ZdZd
dd�Zdd� Zdd� Zd S ) �TextIOz�Helper IO class.
Writes encode strings to bytes if needed, reads return bytes.
This makes it easier to emulate files opened in binary mode
without needing to explicitly convert strings to bytes in
setting up the test data.
� c C s t �| t|�� d S �N)r �__init__r
��self�s� r% �=/usr/lib64/python3.9/site-packages/numpy/lib/tests/test_io.pyr! * s zTextIO.__init__c C s t �| t|�� d S r )r �writer
r" r% r% r& r' - s z TextIO.writec C s t �| dd� |D �� d S )Nc S s g | ] }t |��qS r% r )�.0r$ r% r% r& �
<listcomp>1 � z%TextIO.writelines.<locals>.<listcomp>)r �
writelines)r# �linesr% r% r& r+ 0 s zTextIO.writelinesN)r )�__name__�
__module__� __qualname__�__doc__r! r' r+ r% r% r% r& r ! s
r l TFc C s. t | �tkr| �d�} tt�| |�dd� � S )zY
This function is available in the datetime module only from Python >=
2.5.
�latin1N� )�type�bytes�decoder �time�strptime)r$ �fmtr% r% r& r7 A s
r7 c @ sj e Zd Zdd� Zdd� Zdd� Zdd� Zd d
� Zej j
e j d kd d
�dd� �Z
dd� Zej jdd� �ZdS )�
RoundtripTestc O s0 |� di �}|� dddi�}|� dd�}|r>tdd�}|j}n
t� }|}z�|} ||g| �R i |�� |�� |�d� tjd kr�t|t�s�|� � t
j |fi |��}
| | _ |
| _
W t|t�s�|� � d
t� v r�t|
t
jjj�s�t�|j� n@t|t��s*|� � d
t� v �r*t|
t
jjj��s*t�|j� 0 d S ) a�
save_func : callable
Function used to save arrays to file.
file_on_disk : bool
If true, store the file on disk, instead of in a
string buffer.
save_kwds : dict
Parameters passed to `save_func`.
load_kwds : dict
Parameters passed to `numpy.load`.
args : tuple of arrays
Arrays stored to file.
� save_kwds� load_kwdsZ allow_pickleT� file_on_diskF)�deleter �win32� arr_reloadedN)�getr �namer �flush�seek�sys�platform�
isinstance�close�np�load�arrr? �locals�lib�npyioZNpzFile�os�remove) r# Z save_func�args�kwargsr: r; r< Z target_fileZ load_filerJ r? r% r% r& � roundtripM s8
� zRoundtripTest.roundtripc C s� | � |� | j |dd� | � t�|�� | j t�|�dd� |jd dkr~| � t�|�dd � � | j t�|�dd � dd� d S )NT)r< r � )rR rH �asfortranarray�shape�r# �ar% r% r& �check_roundtrips} s
z RoundtripTest.check_roundtripsc C s� t �g t�}| �|� t �ddgddggt�}| �|� t �ddgddggt�}| �|� t jddgddggt jd �}| �|� t jddgddggt jd �}| �|� d S )
NrS � r2 � y �? @y @ @y @ @y @ @��dtype)rH �array�floatrX �intZcsingleZcdoublerV r% r% r& �
test_array� s
zRoundtripTest.test_arrayc C s< t �g t�}| �|� t �ddgddggt�}| �|� d S )NrS rY r2 rZ )rH r] �objectrX rV r% r% r& �test_array_object� s
z RoundtripTest.test_array_objectc C s t �g d�t�}| �|� d S )N�rS rY r2 rZ )rH r] r_ rR rV r% r% r& �test_1D� s zRoundtripTest.test_1Dr> zFails on Win32��reasonc C sX t �ddgddgg�}| j|dddid� t �ddgddgg�}| j|dddid� d S ) NrS g @rZ g333333 @T� mmap_mode�r)r< r; )rH r] rR rT rV r% r% r& � test_mmap� s zRoundtripTest.test_mmapc C s$ t jddgddgd�}| �|� d S )N�rS rY �r2 rZ ��x�i4��yrn r[ )rH r] rX rV r% r% r& � test_record� s zRoundtripTest.test_recordc C sh dd� t d�D �}tjd|d�}tjdd��( t�dd t� | �|� W d � n1 sZ0 Y d S )
Nc S s g | ]}d | d t f�qS )�%d�d �r^ �r( �ir% r% r& r) � r* z1RoundtripTest.test_format_2_0.<locals>.<listcomp>�� i� r[ T��record�alwaysr )�rangerH �ones�warnings�catch_warnings�filterwarnings� UserWarningrX )r# �dtrW r% r% r& �test_format_2_0� s
z RoundtripTest.test_format_2_0N)r- r. r/ rR rX r` rb rd �pytest�mark�skipifrD rE ri rq �slowr� r% r% r% r& r9 L s 0
r9 c @ s e Zd Zdd� ZdS )� TestSaveLoadc O sb t j| tjg|�R i |�� t| jd | j� t| jd j| jj� t| jd jj | jjj � d S )Nr )
r9 rR rH �saver rJ r? r\ �flags�fnc)r# rP rQ r% r% r& rR � s zTestSaveLoad.roundtripN)r- r. r/ rR r% r% r% r& r� � s r� c @ s� e Zd Zdd� Zejjedd�ejje dd�ejj dd� ���Z
dd � Z d
d � Z d d
� Z
dd� Zdd� Zejjdd� �Zdd� ZdS )�
TestSavezLoadc O s� t j| tjg|�R i |�� ztt| j�D ]@\}}| jd| }t||� t|j|j� t|j j
|j j
� q(W | jj r�| jj � � t
�| jj j� n&| jj r�| jj � � t
�| jj j� 0 d S )Nzarr_%d)r9 rR rH �savez� enumeraterJ r? r r\ r� r� ZfidrG rN rO rA )r# rP rQ �nrJ Zreloadedr% r% r& rR � s
� zTestSavezLoad.roundtripz
Hangs on PyPyre zNeeds 64bit platformc C sp d}t j|t jd�}tddd��<}t j||d� ~t �|�}|d }|�� ~W d � n1 sb0 Y d S )Nl � r[ Znumpy_test_big_arrays_�.npz)�prefix�suffix�rW rW )rH �empty�uint8r r� rI rG )r# �LrW �tmpZnpfiler% r% r& �test_big_arrays� s
z TestSavezLoad.test_big_arraysc C s@ t �ddgddggt�}t �ddgddggt�}| �||� d S ) NrS rY r2 rZ � �? @� @ @� @ �� @ (@)rH r] r^ �complexrR )r# rW �br% r% r& �test_multiple_arrays� s z"TestSavezLoad.test_multiple_arraysc C sz t �ddgddggt�}t �ddgddggt�}t� }t j|||d � |�d
� t �|�}t||d � t||d � d S �
NrS rY r2 rZ r� r� r� r� )�file_a�file_br r� r� ) rH r] r^ r� r r� rC rI r �r# rW r� �c�lr% r% r& �test_named_arrays� s
z TestSavezLoad.test_named_arraysc C s� t �ddgddggt�}t �ddgddggt�}t� }t j|||d � |�d
� t �|�}tt t
|j ��d d g� t||j j � t||j j
� d S r� )rH r] r^ r� r r� rC rI r �sorted�dir�fr� r� r� r% r% r& � test_BagObj� s
zTestSavezLoad.test_BagObjc sX dd� �g � � �fdd�t d�D �}|D ] }|�� q(|D ] }|�� q:� rTt� ��d S )Nc S s~ t dd��`}tj�dd�}ztj||d� W n. tyZ } z| �|� W Y d }~n
d }~0 0 W d � n1 sp0 Y d S )Nr� �r� rw )rJ )r rH �randomZrandnr� �OSError�append)Z
error_listr� rJ �errr% r% r& �writer� s z9TestSavezLoad.test_savez_filename_clashes.<locals>.writerc s g | ]}t j�� fd ��qS )��targetrP )� threading�Thread)r( �j��errorsr� r% r& r) s �z=TestSavezLoad.test_savez_filename_clashes.<locals>.<listcomp>r2 )r{ �start�join�AssertionError)r# �threads�tr% r� r& �test_savez_filename_clashes� s �
z)TestSavezLoad.test_savez_filename_clashesc C s� t dd���}t|d�� }tj|dd� W d � n1 s:0 Y t|dd��V}|�d� t|j � t�|�d t|j � |�d� t|j � W d � n1 s�0 Y W d � n1 s�0 Y d S )
Nr� r� �wb� LOVELY LOAD��data�rbi' r r� )r �openrH r� rC r �closedrI )r# r� �fpr% r% r& �test_not_closing_opened_fid
s ,
z)TestSavezLoad.test_not_closing_opened_fidc
C s� t dd���}tj|dd� t� ��}|�t� tdd�D ]l}zXzt�|�d W n4 ty� } z d| }t |��W Y d }~n
d }~0 0 W t
r�t � � q6t
r�t � � 0 q6W d � n1 s�0 Y W d � n1 s�0 Y d S ) Nr� r� r� r� rS i r� z#Failed to load data from a file: %s)
r rH r� r �filter�ResourceWarningr{ rI � Exceptionr� r �gcZcollect)r# r� �suprv �e�msgr% r% r& �test_closing_fid s
�z TestSavezLoad.test_closing_fidc C sf d}t d|d��B}tj|dd� t�|�}|jj}|�� t|j� W d � n1 sX0 Y d S )NZ&numpy_test_closing_zipfile_after_load_r� )r� r� � place holder��lab) r rH r� rI �zipr� rG r r� )r# r� r� r� r� r% r% r& � test_closing_zipfile_after_load6 s
z-TestSavezLoad.test_closing_zipfile_after_loadN)r- r. r/ rR r� r� r� r �IS_64BITr� r� r� r� r� r� r� Z slow_pypyr� r� r% r% r% r& r� � s
r� c @ s� e Zd Zdd� Zdd� Zdd� Zdd� Zd d
� Zd d � Zd
d� Z dd� Z
dd� Z dd� Z dd� Z
dd� Zdd� Zdd � Zd d � Zd d � Zd!d"� Zej�d#d$d%g�ej�d&eeg�d'd(� ��Zejjej d)kd*d+�ejj e d,d-�d.d/� ���Z d0S )1� TestSaveTxtc C s� t �ddgddggt�}d}t� }t j|||d� |�d� t|�� t|d | d d
�t|d | d d �g� t �ddgddggt �}t� }t j||d d� |�d� t|�� d
dg� d S )NrS rY r2 rZ z%.18e�r8 r � �
rj rk rr � 1 2
� 3 4
)
rH r] r^ r �savetxtrC r � readlinesr
r_ )r# rW r8 r� r% r% r& r` E s
��
zTestSaveTxt.test_arrayc C sJ t �g d�t�}t� }t j||dd� |�d� |�� }t|g d�� d S )Nrc rr r� r )s 1
s 2
s 3
s 4
)rH r] r_ r r� rC r� r �r# rW r� r, r% r% r& rd U s
zTestSaveTxt.test_1Dc C s@ t � }tttj|t�d�� tttj|t�dgdggg�� d S )NrS rY )r r �
ValueErrorrH r� r] �r# r� r% r% r& �
test_0D_3D] s zTestSaveTxt.test_0D_3Dc C sL t jddgddgd�}t� }t j||dd� |�d� t|�� d d
g� d S ) Nrj rk rl ro r[ rr r� r r� r� �rH r] r r� rC r r� �r# rW r� r% r% r& �test_structuredb s
zTestSaveTxt.test_structuredc C sT t jddgg d�d�}t� }t j||ddg dd� |�d � t|�� d
d g� d S ) N�rS rY r2 �rZ � � ))�foorn )�barrn )�bazrn r[ r� r� rr r� r s 1 3
s 4 6
r� r� r% r% r& �test_structured_paddedi s
z"TestSaveTxt.test_structured_paddedc C st t jdg d�d�}|ddg }tdd��8}t|�}t �||� t �|�}t||� W d � n1 sf0 Y d S )NrS )rl ro )�z�f4r[ rm r� �.npyr� )rH r| r r r� rI r )r# rW �v�pathr� r% r% r& �test_multifield_views s
z TestSaveTxt.test_multifield_viewc C sN t �ddgddgg�}t� }t j||ddd� |�d� t|�� d d
g� d S ) N� �?� @� @� @�,rr )� delimiterr8 r s 1,2
s 3,4
r� r� r% r% r& �test_delimiter| s
zTestSaveTxt.test_delimiterc C s� t �ddg�}t� }t j||ddgd� |�d� t|�� ddg� t� }t j||d d� |�d� |�� }t|d
d g� t� }t j||d d d
� |�d� |�� }t|d
d g� t� }ttt j||dd� d S )Nrj rk z%02dz%3.1fr� r s 01 2.0
s 03 4.0
z %02d : %3.1fs 01 : 2.0
s 03 : 4.0
r� )r8 r� �c ) rH r] r r� rC r r� r r� r� r% r% r& � test_format� s"
zTestSaveTxt.test_formatc C s t � }tjddgtd�}d}tj||d|d� |�d� t|�� td| d �� t � }tj||d|d
� |�d� t|�� td | d �� t � }d
}tj||d||d� |�d� t|�� t|| d d �� t � }d
}tj||d||d� |�d� t|�� td| | d �� d S )Nrj rk r[ zTest header / footerz%1d)r8 �headerr z# z
1 2
3 4
)r8 �footerz
1 2
3 4
# r� z% )r8 r� �commentsz1 2
3 4
)r8 r� r� ) r rH r] r_ r� rC r �readr
)r# r� rW �test_header_footerZ
commentstrr% r% r& r� � s@
�
�
�
�
�
�z TestSaveTxt.test_header_footerc C sX t � �>}t�ddg�}t�||� t�|�}t||� W d � n1 sJ0 Y d S )Nrj rk )r rH r] r� �loadtxtr )r# rA rW r� r% r% r& �test_file_roundtrip� s
z TestSaveTxt.test_file_roundtripc C s� d}d}t j||ft jd�}t j}t j}|d| |d d �< t� }t j||dd� |�d� |�� }t |ddg� t� }t j||d| d� |�d� |�� }t |d d g� t� }t j||d
g| d� |�d� |�� }t |d d g� d S ) NrY r[ � �?z %+.3er� r s8 ( +3.142e+00+ +2.718e+00j) ( +3.142e+00+ +2.718e+00j)
z %+.3e %+.3es1 +3.142e+00 +2.718e+00 +3.142e+00 +2.718e+00
z (%.3e%+.3ej)s. (3.142e+00+2.718e+00j) (3.142e+00+2.718e+00j)
�
rH �zeros�
complex128�pir� r r� rC r� r �r# ZncolsZnrowsrW �re�imr� r, r% r% r& �test_complex_arrays� sH
��
��
��z TestSaveTxt.test_complex_arraysc C sv d}d}t j||ft jd�}t j}t j}|d| |d d �< t� }t j||dd� |�d� |�� }t |ddg� d S )NrY r[ r z%.3er� r s0 (3.142e+00-2.718e+00j) (3.142e+00-2.718e+00j)
r r r% r% r& � test_complex_negative_exponent� s
��z*TestSaveTxt.test_complex_negative_exponentc C sH G dd� dt �}|� }t�ddg�}t�||� t�|�}t||� d S )Nc @ s e Zd Zdd� ZdS )z4TestSaveTxt.test_custom_writer.<locals>.CustomWriterc S s | � |�d�� d S )N�
)�extend�split)r# �textr% r% r& r' s z:TestSaveTxt.test_custom_writer.<locals>.CustomWriter.writeN)r- r. r/ r' r% r% r% r& � CustomWriter s r rj rk )�listrH r] r� r� r )r# r �wrW r� r% r% r& �test_custom_writer� s
z TestSaveTxt.test_custom_writerc C sd d� d�}tj|gtjd�}t� �.}tjtj�|d�|dgdd� W d � n1 sV0 Y d S )N� ϖ�UTF-8r[ �test.csv�%s�r8 �encoding) r5 rH r] �unicode_r r� rN r� r� )r# �utf8rW �tmpdirr% r% r& � test_unicode
s
�zTestSaveTxt.test_unicodec C s� d� d�}tj|gtjd�}ddg}tr2|�d� trD|�ddg� t� �f}|D ]P}tj t
j � |d | �|d
gd d � tj
t
j � |d | �d tjd
�}t||� qPW d � n1 s�0 Y d S )Nr r r[ r �.gz�.bz2�.xz�.lzmar r z UTF-16-LEr �r r\ )r5 rH r] r �HAS_BZ2r� �HAS_LZMAr r r� rN r� r� r� r )r# r rW �suffixesr r� r� r% r% r& �test_unicode_roundtrip s
��z"TestSaveTxt.test_unicode_roundtripc C s\ d� d�}tj|gtjd�}t� }tj||dgdd� |�d� t|�� � d�|d � d S �Nr r r[ r r r r� ) r5 rH r] r r r� rC r r� �r# r rW r$ r% r% r& �test_unicode_bytestream# s
z#TestSaveTxt.test_unicode_bytestreamc C sV d� d�}tj|gtjd�}t� }tj||dgdd� |�d� t|�� |d � d S r& ) r5 rH r] r r r� rC r r� r' r% r% r& �test_unicode_stringstream+ s
z%TestSaveTxt.test_unicode_stringstreamr8 �%fs %f�iotypec C s^ t �dg�}|� }t j|||d� |�d� |tu rHt|�� dd � nt|�� dd � d S )Nr� r� r z%f
s %f
)rH r] r� rC r r r� )r# r8 r+ rW r$ r% r% r& �test_unicode_and_bytes_fmt3 s
z&TestSaveTxt.test_unicode_and_bytes_fmtr> zfiles>4GB may not workre g `��A)Z
free_bytesc C s^ dd� }t t�}td�}|j||fd�}|�� |�� |jrFtd��|jdkrZt �
d� d S )Nc S s� d| _ z^tjdd� td�D �td�}t� �(}tjtj� |d�|d� W d � n1 sX0 Y W n t
y~ d| _ � Y n0 d S ) NFc S s$ g | ] }t j�t j�d d�d��qS )�2 rs rZ )rH r� ZrandZrandintru r% r% r& r) I s ��zGTestSaveTxt.test_large_zip.<locals>.check_large_zip.<locals>.<listcomp>i 5 r[ ztest.npz)� test_dataT) �valuerH Zasarrayr{ ra r r� rN r� r� � MemoryError)�memoryerror_raisedr. r r% r% r& �check_large_zipD s
���( z3TestSaveTxt.test_large_zip.<locals>.check_large_zip�forkr� z,Child process raised a MemoryError exception���zCsubprocess got a SIGKILL, apparently free memory was not sufficient) r r r ZProcessr� r� r/ r0 Zexitcoder� Zxfail)r# r2 r1 �ctx�pr% r% r& �test_large_zip@ s
zTestSaveTxt.test_large_zipN) r- r. r/ r` rd r� r� r� r� r� r� r� r r r
r r r% r( r) r� r� � parametrizer r r, r� rD rE r� r r7 r% r% r% r& r� D s0
"& r� c @ sx e Zd Zdd� Zdd� Zejje dd�dd� �Z ejje
d d�d
d � �Z d d
� Z dd� Z
dd� Zdd� Zdd� ZdS )� LoadTxtBasec C s� t �d��d�}d}|D ]�}d| d }|D ]�}t|d���}||ddd ��} | �|� W d � n1 sj0 Y | j|dd
�}
t|
|� ||d dd
��} | �| �}
W d � n1 s�0 Y t|
|� W d � q,1 s�0 Y q,qd S ) Nr� �rY r2 �r� z
�
�0 1 2�3 4 5r� �wtz UTF-32-LE)�moder �r Zrt)rH �arange�reshaper r' �loadfuncr ) r# Zfopenr$ �wanted�linesep�sepr� r� rA r� �resr% r% r& �check_compressedf s (
(z LoadTxtBase.check_compressedc C s | � tjd� d S )N)r )rI �gzipr� �r# r% r% r& �test_compressed_gzipv s z LoadTxtBase.test_compressed_gzipz Needs bz2re c C s | � tjd� d S )N)r )rI �bz2r� rK r% r% r& �test_compressed_bz2y s z LoadTxtBase.test_compressed_bz2z
Needs lzmac C s | � tjd� d S )N)r r )rI �lzmar� rK r% r% r& �test_compressed_lzma} s z LoadTxtBase.test_compressed_lzmac C s� t � �f}t|d�� }|�d�d�� W d � n1 s80 Y | j|dd�}t|g d�� W d � n1 sr0 Y d S )Nr� z0.
1.
2.�UTF-16rA )� r� r� )r r� r' �encoderD r )r# r� r� rm r% r% r& �
test_encoding� s
.zLoadTxtBase.test_encodingc C s� d� d�}t� �f}t|d�� }|�|�d�� W d � n1 sB0 Y | j|dtjd�}t||� W d � n1 s|0 Y d S )Ns öüör r� rQ r! ) r5 r r� r' rS rD rH r r )r# Znonasciir� r� rm r% r% r& �test_stringload� s
.zLoadTxtBase.test_stringloadc C s8 d}| j t|�tjdd�}t|t�|�d��� �� d S �Ns ��h i jrQ )r\ r )rD r rH r r r] r5 r
�r# �utf16r� r% r% r& �test_binary_decode� s z LoadTxtBase.test_binary_decodec C sT t � }|�d� |�d� | j|tjddd� id�}t�d�d�g�}t||� d S )Nr r c S s
| � d�S )Nr �r5 �rm r% r% r& �<lambda>� r* z4LoadTxtBase.test_converters_decode.<locals>.<lambda>)r\ �
convertersr ) r r' rC rD rH r r] r5 r �r# r� rm rW r% r% r& �test_converters_decode� s
�z"LoadTxtBase.test_converters_decodec C s� d� d�}t� ��}tj|ddd��}|�|� W d � n1 sB0 Y | j|tjddd� idd�}t�|d g�}t ||� W d � n1 s�0 Y d S )
Nr r r? rA r c S s | d S )Nr� r% r[ r% r% r& r\ � r* z6LoadTxtBase.test_converters_nodecode.<locals>.<lambda>�r\ r] r r� )
r5 r �ior� r' rD rH r r] r )r# r r� r� rm rW r% r% r& �test_converters_nodecode� s
(
�z$LoadTxtBase.test_converters_nodecodeN)r- r. r/ rI rL r� r� r� r" rN r# rP rT rU rY r_ rb r% r% r% r& r9 e s
r9 c @ s e Zd Zeej�Zdd� Zdd� Zdd� Z dd� Z
d d
� Z d d � Z d
d� Z
dd� Zdd� Zdd� Zejjeovejjdkdd�dd� �Zdd� Zd d � Zd d � Zd d!� Z d"d#� Z d$d%� Z d&d'� Z d(d)� Z d*d+� Z!d,d-� Z"d.d/� Z#d0d1� Z$d2d3� Z%ejje�oejjdkdd�d4d5� �Z&ejje�o*ejjdkdd�d6d7� �Z'd8d9� Z(d:d;� Z)d<d=� Z*d>d?� Z+d@dA� Z,dBdC� Z-dDdE� Z.dFdG� Z/dHdI� Z0ejje1�2� dJkdKd�dLdM� �Z3dNdO� Z4dPdQ� Z5dRdS� Z6dTdU� Z7ej�8dVdWgdXg dY�fdXg dZ�fdXe9d[�fd\g d]�fd\g d^�fd\e9d_�fg�d`da� �Z:dbS )c� TestLoadTxtc C s t jjj| _dt jj_d S �NrS )rH rL rM �_loadtxt_chunksize�
orig_chunkrK r% r% r& � setup_method� s zTestLoadTxt.setup_methodc C s | j tjj_d S r )rf rH rL rM re rK r% r% r& �teardown_method� s zTestLoadTxt.teardown_methodc C s� t � }|�d� |�d� tj|dtjfdtjfgd�}tjddgdd gd�}t||� t � }|�d
� |�d� d d d
�}tjddg|d�}tj||d�}t||� d S )N�1 2
3 4r rm rp r[ rj rk rl ro zM 64 75.0
F 25 60.0��gender�age�weight��S1rn r� ��names�formats��M� P@� �R@��F� 9@� N@)r r' rC rH r� �int32r] r )r# r� rm rW �dZ mydescriptorr� rp r% r% r& rq � s&
���zTestLoadTxt.test_recordc C s� t � }|�d� |�d� tj|td�}t�ddgddggt�}t||� |�d� tj|td�}t�ddgddggt�}t||� d S )Nri r r[ rS rY r2 rZ ) r r' rC rH r� r_ r] r r^ r^ r% r% r& r` � s
zTestLoadTxt.test_arrayc C s� t � }|�d� |�d� tj|td�}t�g d�t�}t||� t � }|�d� |�d� tj|tdd�}t�g d�t�}t||� d S )N�1
2
3
4
r r[ rc �1,2,3,4
r� �r\ r� �r r' rC rH r� r_ r] r r^ r% r% r& rd � s
zTestLoadTxt.test_1Dc C sR t � }|�d� |�d� tj|tdddd� id�}t�g d�t�}t||� d S ) N� 1,2,3,,5
r r� r2 c S s t | pd�S �N�����r_ �r$ r% r% r& r\ � r* z*TestLoadTxt.test_missing.<locals>.<lambda>�r\ r� r] �rS rY r2 r� r� r� r^ r% r% r& � test_missing� s
�zTestLoadTxt.test_missingc C s\ t � }|�d� |�d� tj|tdddd� idd�}t�d d
gd d ggt�}t||� d S )
N�1,2,3,,5
6,7,8,9,10
r r� r2 c S s t | pd�S r� r� r� r% r% r& r\ � r* z:TestLoadTxt.test_converters_with_usecols.<locals>.<lambda>�rS r2 �r\ r� r] �usecolsrY r� � � r� r^ r% r% r& � test_converters_with_usecols� s
�z(TestLoadTxt.test_converters_with_usecolsc C sJ t � }|�d� |�d� tj|tddd�}t�g d�t�}t||� d S )N�# comment
1,2,3,5
r r� �#�r\ r� r� �rS rY r2 r� r� r^ r% r% r& �test_comments_unicode� s
�z!TestLoadTxt.test_comments_unicodec C sJ t � }|�d� |�d� tj|tddd�}t�g d�t�}t||� d S )Nr� r r� � #r� r� r� r^ r% r% r& �test_comments_byte s
�z TestLoadTxt.test_comments_bytec C sV t � }|�d� |�d� tj|tdg d�d�}t�g d�g d�gt�}t||� d S )Nz,# comment
1,2,3
@ comment2
4,5,6 // comment3r r� )r� �@z//r� r� r� r� r^ r% r% r& �test_comments_multiple s
�z"TestLoadTxt.test_comments_multiple)r� r2 � z PyPy bug in error formattingre c C sz t � }|�d� |�d� tj|tddd�}t�g d�t�}t||� t � }|�d� |�d� tt tj|tddd� d S )Nz/* comment
1,2,3,5
r r� z/*r� r� z*/ comment
1,2,3,5
)
r r' rC rH r� r_ r] r r r� r^ r% r% r& �test_comments_multi_chars s
�
�z%TestLoadTxt.test_comments_multi_charsc C s� t � }|�d� |�d� tj|tddd�}t�g d�t�}t||� t � }|�d� |�d� tj|tddd�}t�g d�t�}t||� d S )N�comment
1,2,3,5
r r� rS )r\ r� �skiprowsr� r� r� r^ r% r% r& �
test_skiprows' s
�
�zTestLoadTxt.test_skiprowsc
C s� t �ddgddggt�}t� }t �||� |�d� t j|tdd�}t||d d �df � t �g d�g d �gt�}t� }t �||� |�d� t j|td
d�}t||d d �dd �f � |�d� t j|tt �ddg�d�}t||d d �dd �f � tt j t j
t j t j t j
t jt jt jf D ]>}|d�}|�d� t j|t|d�}t||d d �df � �q G d d � d �}|� }|�d� t j|t|d�}t||d d �df � |�d� t j|t|fd�}t||d d �df � d
}t|�}ddg} ddg}
t j|dtt| |
��d�} t| d ddg� t| d ddg� |�d� d} ttdt| �j t j|| d� ttdt| �j t j|d| dgd� d S )NrS rY r2 rZ r �rS �r\ r� r� �r2 rZ r� rj c @ s e Zd Zdd� ZdS )z*TestLoadTxt.test_usecols.<locals>.CrazyIntc S s dS rd r% rK r% r% r& � __index__W s z4TestLoadTxt.test_usecols.<locals>.CrazyInt.__index__N)r- r. r/ r� r% r% r% r& �CrazyIntV s r� z<JOE 70.1 25.3
BOB 60.5 27.9
�stid�temp�S4�f8�r rY �r� r\ � JOE� BOB������L9@�fffff�;@� �?z^usecols must be.*%s�r� )rH r] r^ r r� rC r� r r_ Zint8Zint16r{ �int64r� Zuint16Zuint32�uint64r r r� r r � TypeErrorr3 r- )
r# rW r� rm Zint_typeZto_readr� Z crazy_intr� rq �dtypesrJ Z bogus_idxr% r% r& � test_usecols8 sd
�
� �zTestLoadTxt.test_usecolsc C s� t �t��$ tjdgdgdd� W d � n1 s40 Y t �ttf��$ tjdgdgdd� W d � n1 sv0 Y t jtdd��& tjdgd d
gdd � W d � n1 s�0 Y d S ) Nz1
l r� )r� r� l zQIf a structured dtype .*. But 1 usecols were given and the number of fields is 3.��matchz1,1
zi,(2)ir )r\ r� r� )r� �raises�
OverflowErrorrH r� r� r� rK r% r% r& �test_bad_usecols} s 22�z TestLoadTxt.test_bad_usecolsc C sj t � }|�d� |�d� t�dtfddtfdtfgfg�}tj||dd�}t�d d
g|�}t ||� d S ) N�1,2,3.0
4,5,6.0
r rm rp r� r$ r� r �rS )rY r� �rZ )r� � @)
r r' rC rH r\ r_ r^ r� r] r �r# r� r� rm rW r% r% r& �test_fancy_dtype� s
"z TestLoadTxt.test_fancy_dtypec C sh t d�}t�ddtfdtfdtdfg�}tj||d�}tjdd d
g d �g d �gfg|d�}t||� d S �
Nzaaaa 1.0 8.0 1 2 3 4 5 6�rA r� rm rp �blockr: r[ �aaaar� � @r� r� �r rH r\ r^ r_ r� r] r r� r% r% r& �test_shaped_dtype� s � �z TestLoadTxt.test_shaped_dtypec C sx t d�}t�ddtfdtfdtdfg�}tj||d�}tjdd d
g d �g d �gg d
�g d�ggfg|d�}t||� d S )Nz*aaaa 1.0 8.0 1 2 3 4 5 6 7 8 9 10 11 12r� rm rp r� )rY rY r2 r[ r� r� r� r� r� )r� r� r� )�
� � r� r� r% r% r& �test_3d_shaped_dtype� s �
��z TestLoadTxt.test_3d_shaped_dtypec C sF ddg}t tjfD ].}tjddg|d�}tj||d�}t||� qd S )NZstr1Zstr2r[ )�strrH Zbytes_r] r� r )r# r� r� rW rm r% r% r& �test_str_dtype� s
zTestLoadTxt.test_str_dtypec C sz t jtdd��X t� }t�|�}t|jd� tj|tjd�}t|jd� t |j
tjk� W d � n1 sl0 Y d S )N�input contained no datar� �r r[ ) r� �warnsr� r rH r� r rU r� r r\ )r# r� rm r% r% r& �test_empty_file� s
zTestLoadTxt.test_empty_filec C sx t � }|�ddg� |�d� tj|dddd� id�}t|dd g� |�d� tj|dd
d d� id�}t|d d
g� d S )Nz1 21
z3 42
r r� c S s
t | d�S �N� r� r� r% r% r& r\ � r* z3TestLoadTxt.test_unused_converter.<locals>.<lambda>�r� r] � �* rS c S s
t | d�S r� r� r� r% r% r& r\ � r* �! �B )r r+ rC rH r� r )r# r� r� r% r% r& �test_unused_converter� s
�
�z!TestLoadTxt.test_unused_converterc C sr d}dt fdtfg}dd� }d|i}tjt|�d||d�}tjdtd dd�fd
td dd �fg|d
�}t||� d S )N�0 1; 2001-01-01
2; 2002-01-31 �idx�codec S s t | �� d�S �Nz%Y-%m-%d�r7 �stripr� r% r% r& r\ � r* z4TestLoadTxt.test_dtype_with_object.<locals>.<lambda>rS �;�r� r\ r] �� rY �� � r[ )r_ ra rH r� r r] r r �r# r� Zndtype�funcr] �test�controlr% r% r& �test_dtype_with_object� s � �z"TestLoadTxt.test_dtype_with_objectc C s@ d}t � }|�d| � |�d� tj|tjd�}t||� d S )N)l +&�| l -(�| �%s %sr r[ )r r' rC rH r� r� r �r# �tgtr� rH r% r% r& �test_uint64_type� s
z TestLoadTxt.test_uint64_typec C s@ d}t � }|�d| � |�d� tj|tjd�}t||� d S )N)l�������� l ���� r� r r[ )r r' rC rH r� r� r r� r% r% r& �test_int64_type� s
zTestLoadTxt.test_int64_typec C s� t �ddd��t j�}t �|| f��t�}d�ttj|��}t � }|�
|� tt jfD ]4}|� d� t j ||tj
dd�}t||d| d � qXd S )
Ni����r� r� r� r r1 r` r )�err_msg)rH ZlogspaceZastypeZfloat32Zhstackr^ r� �map�hexr r' rC r� �fromhexr )r# r� �inpr� r� rH r% r% r& �test_from_float_hex� s
�z TestLoadTxt.test_from_float_hexc C sD t d�}tjtdd�� t�|� W d � n1 s60 Y dS )z�
Ensure that fromhex is only used for values with the correct prefix and
is not called by default. Regression test related to gh-19598.
za b cz2.*convert string 'a' to float64 at row 0, column 1r� N�r r� r� r� rH r� r� r% r% r& �6test_default_float_converter_no_default_hex_conversion� s
�zBTestLoadTxt.test_default_float_converter_no_default_hex_conversionc C sD t d�}tjtdd�� t�|� W d � n1 s60 Y dS )z�
Ensure that the exception message raised during failed floating point
conversion is correct. Regression test related to gh-19598.
zqrs tuvz)could not convert string 'qrs' to float64r� Nr� r� r% r% r& �&test_default_float_converter_exception� s
�z2TestLoadTxt.test_default_float_converter_exceptionc C sN t dd�t dd�f}t� }|�d| � |�d� tj|t d�}t||� d S )NrS ���r� r r[ )r� r r' rC rH r� r r� r% r% r& �test_from_complex s
z TestLoadTxt.test_from_complexc C s� t jdt jd�}t j}t j}|d| |d d �< t� }t j||dd� |�d� |�� }|�d� |� dd�}t
||k� |� |� |�d� t j |t
d�}t||� d S ) N�rY rY r[ r z%.16er� r s e+00-s e00+-)rH r r r r� r r� rC r� �replacer r' r� r� r )r# rW r r r� �txtZtxt_badrH r% r% r& �test_complex_misformatted s
z%TestLoadTxt.test_complex_misformattedc C s~ t � �N}t|d��}|�d� W d � n1 s20 Y t�|�}W d � n1 sZ0 Y t|ddgddgg� d S )Nr z
1 21
3 42
rS r� r2 r� )r r� r' rH r� r )r# rA r� r� r% r% r& �test_universal_newline# s
((z"TestLoadTxt.test_universal_newlinec C sT t � }|�d� |�d� ddd�}tj||dd�}t�g d��}t|d |� d S )
Nz 1 2 3 start
4 5 6
7 8 9.5 r )rm rp r� �comment)�<i4r� �<f4�|S8rp � r )s start s r* r� )r r' rC rH r� r] r r� r% r% r& �test_empty_field_after_tab* s
�z&TestLoadTxt.test_empty_field_after_tabc C s� t d�}ddd�}tj||dd�\}}}t|jjdk� t|jjdk� t|jjd k� t|t�d
d g�� t|t�d d
g�� t|t�ddg�� d S )N�M 21 72
F 35 58�rW r� r� )�|S1r� r� rp T�r\ �unpackr r� r� � M� Fr� �# � R@� M@)r rH r� r r\ r� r r] �r# r� r� rW r� r� r% r% r& �test_unpack_structured4 s
z"TestLoadTxt.test_unpack_structuredc C s
t � }|�d� |�d� tttj|dd� |�d� tttj|dd� |�d� tj|tddd�}t�g d �g d
�g�}t ||� t � }|�d � |�d� tj|tdd d�}t
|j d
k� |�d� tj|tddd�}t
|j dk� |�d� tj|tddd�}t
|j dk� t � }|�d� |�d� tj|tdd d�}t
|j dk� |�d� tj|tddd�}t
|j dk� |�d� tj|tddd�}t
|j dk� t j
tdd��F t � }t
tj|d d�j dk� t
tj|dd�j dk� W d � n1 �s�0 Y d S )Nz 1,2,3
4,5,6r r2 ��ndminr� r� rS )r\ r� r r� r� z0,1,2rY r� )r2 z0
1
2)r2 rS r� r� �r rS r� )r r' rC r r� rH r� r_ r] r r rU r� r� r� )r# r� rm rW r| r� r� r% r% r& �test_ndmin_keyword? sH
z TestLoadTxt.test_ndmin_keywordc C s( dd� }t �|� �}t|t �d�� d S )Nc s s t d�D ]} d| V qd S �Nr� rr )r{ �rv r% r% r& �countj s z0TestLoadTxt.test_generator_source.<locals>.countr� )rH r� r rB �r# r rH r% r% r& �test_generator_sourcei s z!TestLoadTxt.test_generator_sourcec C s. t � }|�d� |�d� ttdtj|� d S )Nz1 2 3
4 5 6
2 3r �3)r r' rC r r� rH r� r� r% r% r& �
test_bad_lineq s
zTestLoadTxt.test_bad_linec C sH t � }|�d� |�d� t�dtfddtfg�}tj|d|d d� d S )Nz100,foo,200
300,None,400r rm )rW ZS10rp r� )r� r\ r� )r r' rC rH r\ r_ r� )r# r� r� r% r% r& �test_none_as_stringy s
z TestLoadTxt.test_none_as_stringzANSI_X3.4-1968zWrong preferred encodingc C s d}|� d��dd��� }t� ��}t|d��}|�|� W d � n1 sL0 Y t|d��"}tj|dtjd�}W d � n1 s�0 Y t ||� t|d�� }tj|ddd�}W d � n1 s�0 Y g d �}t |tj
|dd
�� W d � n1 �s0 Y d S ) Ns/ 5,6,7,Õscarscar
15,2,3,hello
20,2,3,Õscar
r r< r r� r� r! �S)s 5,6,7,Õscarscars 15,2,3,hellos
20,2,3,Õscarr[ ) r5 r� �
splitlinesr r� r' rH r� r r r] )r# Zbutf8Zsutf8r� r� rm r% r% r& �test_binary_load� s ( 0
.z TestLoadTxt.test_binary_loadc C sJ t � }|�d� |�d� tj|tddd�}t�g d�t�}t||� d S )N�1,2,3,5
4,5,7,8
2,1,4,5r r� rS �r\ r� �max_rowsr� r� r^ r% r% r& �
test_max_rows� s
�zTestLoadTxt.test_max_rowsc C s� t � }|�d� |�d� tj|tdddd�}t�g d�t�}t||� t � }|�d� |�d� tj|tdddd�}t�g d�g d �gt�}t||� d S )
Nz comments
1,2,3,5
4,5,7,8
2,1,4,5r r� rS �r\ r� r� r r� � comment
1,2,3,5
4,5,7,8
2,1,4,5rY �rZ r� r� r� r� r^ r% r% r& �test_max_rows_with_skiprows� s
�
�z'TestLoadTxt.test_max_rows_with_skiprowsc C s| t � }|�d� |�d� tj|tddd�}t�g d�g d�gt�}t||� tj|tdd�}t�g d �t�}t||� d S )
Nr r r� rY r r� r$ r �rY rS rZ r� r� r^ r% r% r& �$test_max_rows_with_read_continuation� s
�
z0TestLoadTxt.test_max_rows_with_read_continuationc C sZ t � }|�d� |�d� tj|tdddd�}t�g d�g d�g d �gt�}t||� d S )
Nr# r r� rS r� r" r� r$ r& r� r^ r% r% r& �test_max_rows_larger� s
� z TestLoadTxt.test_max_rows_larger�skipr� rS )zignored
�1,2
r� �3,4
)Zignored�1,2r �3,4zignored
1,2
3,4r )z-1,0
r* r� r+ )z-1,0r, r r- z
-1,0
1,2
3,4c C s t jtdd| � �d��L tj|t|dd| d�}t|ddgdd gdd
gg|d � � W d � n1 sj0 Y t|t�r�|� d� t
� � �^ t
� d t� t �
t��( tj|t|dd| d� W d � n1 s�0 Y W d � n1 s�0 Y d S ) NzInput line 3.*max_rows=r2 r� r� )r\ r� r� r r� r rS rY rZ �error)r� r� r� rH r� r_ r rF r rC r} r~ � simplefilterr� )r# r) r� rH r% r% r& �test_max_rows_empty_lines� s
� �B
�z%TestLoadTxt.test_max_rows_empty_linesN);r- r. r/ � staticmethodrH r� rD rg rh rq r` rd r� r� r� r� r� r� r� r� r rD �implementation�versionr� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r r r r r r �locale�getpreferredencodingr r! r% r' r( r8 r r0 r% r% r% r& rc � s|
�
E
�
�
*�
� rc c @ sN e Zd Zdd� Zdd� Zdd� Zej�de e
g�dd � �Z d
d � Z d d
� Z
dS )�
Testfromregexc C sV t � }|�d� |�d� dtjfdg}t�|d|�}tjg d�|d�}t||� d S )Nz 1.312 foo
1.534 bar
4.444 quxr �num��valZS3z([0-9.]+)\s+(...)))�ˡE���?r� �g%��C��?r� �g-����@�quxr[ �r r' rC rH �float64� fromregexr] r r� r% r% r& rq � s
�zTestfromregex.test_recordc C sV t � }|�d� |�d� dtjfdg}t�|d|�}tjg d�|d�}t||� d S )N�1312 foo
1534 bar
4444 quxr r7 r8 z
(\d+)\s+(...)))� r� )� r� )�\ r= r[ )r r' rC rH r{ r@ r] r r� r% r% r& �
test_record_2� s
�zTestfromregex.test_record_2c C sT t � }|�d� |�d� dtjfg}t�|d|�}tjg d�|d�}t||� d S )NrA r r7 z (\d+)\s+...))rB )rC )rD r[ r> r� r% r% r& �
test_record_3� s
zTestfromregex.test_record_3� path_typec
C s� d}t � ��}||�}t|d��"}|�d| d � W d � n1 sF0 Y dtjfdg}tj|d|dd �}tjd
d |�d� fd d
g|d�}t||� t �
dt j �} tj|| |dd �}t||� W d � n1 s�0 Y d S )Nr r� s 1.312 foos
1.534 bar
4.444 quxr7 )r9 ZU4z(?u)([0-9.]+)\s+(\w+)r rA r: r� r; r< r[ z([0-9.]+)\s+(\w+)) r r� r' rH r? r@ r] r5 r r �compile�UNICODE)
r# rG r Zstr_pathr� r� r� rm rW �regexpr% r% r& �test_record_unicode� s 0��
z!Testfromregex.test_record_unicodec C sL t �d�}td�}dtjfg}tjg d�|d�}t�|||�}t||� d S )N� (\d)� 123r7 r� r[ )r rH r rH r? r] r@ r )r# rJ r� r� rW rm r% r% r& �test_compiled_bytes s
z!Testfromregex.test_compiled_bytesc C sV t �d�}td�}tjtdd��" tj||tjd� W d � n1 sH0 Y d S )NrL rM zstructured datatyper� r[ ) r rH r r� r� r� rH r@ r? )r# rJ r� r% r% r& � test_bad_dtype_not_structured s
z+Testfromregex.test_bad_dtype_not_structuredN)r- r. r/ rq rE rF r� r� r8 r� r rK rN rO r% r% r% r& r6 � s
r6 c @ s� e Zd Zeej�Zdd� Zdd� Zdd� Z dd� Z
d d
� Z d d � Z d
d� Z
dd� Zdd� Zdd� Zdd� Zdd� Zdd� Zdd � Zd d � Zd d � Zd!d"� Zd#d$� Zd%d&� Zd'd(� Zd)d*� Zd+d,� Z d-d.� Z d/d0� Z d1d2� Z d3d4� Z d5d6� Z!d7d8� Z"d9d:� Z#d;d<� Z$d=d>� Z%d?d@� Z&dAdB� Z'dCdD� Z(dEdF� Z)dGdH� Z*dIdJ� Z+dKdL� Z,dMdN� Z-dOdP� Z.dQdR� Z/dSdT� Z0dUdV� Z1dWdX� Z2dYdZ� Z3d[d\� Z4d]d^� Z5d_d`� Z6dadb� Z7dcdd� Z8dedf� Z9dgdh� Z:didj� Z;dkdl� Z<dmdn� Z=dodp� Z>dqdr� Z?dsdt� Z@dudv� ZAdwdx� ZBdydz� ZCd{d|� ZDd}d~� ZEdd�� ZFd�d�� ZGd�d�� ZHd�d�� ZId�d�� ZJd�d�� ZKd�d�� ZLd�d�� ZMd�d�� ZNd�d�� ZOd�d�� ZPd�d�� ZQd�d�� ZRd�d�� ZSd�d�� ZTd�d�� ZUd�d�� ZVd�d�� ZWd�d�� ZXeYjZ�[d�g d���e\d��d�d���Z]d�S )�� TestFromTxtc C s� t d�}tj|dtjfdtjfgd�}tjddgddgd�}t||� t d �}d
d d �}tjd
dg|d�}tj||d�}t||� d S )Nri rm rp r[ rj rk rl ro zM 64.0 75.0
F 25.0 60.0rj rn rp rs rw )r rH �
genfromtxtr{ r] r )r# r� r� r� �
descriptorr% r% r& rq % s
�
�zTestFromTxt.test_recordc C sz t d�}tjddgddggtd�}tj|td�}t||� |�d� tjddgddggtd�}tj|td�}t||� d S )Nri rS rY r2 rZ r[ r ) r rH r] r_ rQ r rC r^ r� )r# r� r� r� r% r% r& r` 4 s
zTestFromTxt.test_arrayc C sV t �g d�t�}td�}t j|td�}t||� td�}t j|tdd�}t||� d S )Nrc r} r[ r~ r� r )rH r] r_ r rQ r �r# r� r� r� r% r% r& rd @ s
zTestFromTxt.test_1Dc C s\ t �g d�t�}td�}t j|tddd�}t||� td�}t j|tddd�}t||� d S )Nr� r� r� r� r� z1,2,3,5# comment
)rH r] r_ r rQ r rS r% r% r& �
test_commentsL s
zTestFromTxt.test_commentsc C sp t �g d�t�}ttdd�}td�}t j|fddi|��}t||� td�}t j|fddi|��}t||� d S ) Nr� r� r r� � skip_headerrS r� r� )rH r] r_ �dictr rQ r r� )r# r� rQ r� r� r% r% r& r� X s
zTestFromTxt.test_skiprowsc C s� dd� t dd�D �}|�d� |�dd� t d�D �� d|d < td
d d d
d�}tjtd�|��fi |��}tjdd� t d�D �dd� dD �d�}t ||� d S )Nc S s g | ] }d | �qS )z# %ir% ru r% r% r& r) f r* z0TestFromTxt.test_skip_footer.<locals>.<listcomp>rS r� zA, B, Cc S s g | ]}d |||f �qS )z
%i,%3.1f,%03sr% ru r% r% r& r) h r* �3 z99,99r� r� Tr� r� )r� rq rU � skip_footerr� c S s" g | ]}d | d | d | f�qS )r* r% ru r% r% r& r) l r* �) c S s g | ] }|t f�qS r% rt �r( �_r% r% r& r) m r* �ABCr[ )
r{ r� r rV rH rQ r r� r] r )r# r� rQ r� �ctrlr% r% r& �test_skip_footere s
�z TestFromTxt.test_skip_footerc
C s> t � �� }|�t� d}tttjt|�dd� tjt|�ddd�}t|t� ddgddgddgd d gg�� tjt|�d
d�}t|t� ddgddgddgd d gg�� d }tjt|�ddd�}t|t� ddgddgd d gd d gg�� tjt|�d
dd�}t|t� ddgddgd d gg�� W d � n1 �s00 Y d S )
Nz 1 1
2 2
3 3
4 4
5
6
7
rS )rX F)rX �
invalid_raiser� r� r� r� r2 z 1 1
2
3 3
4 4
5
6 6
7 7
r� )
r r� r r r� rH rQ r r r] )r# r� ZbasestrrW r% r% r& � test_skip_footer_with_invalidp s*
�
�((
�(
�z)TestFromTxt.test_skip_footer_with_invalidc C s� t d�}tjdd��D}t�ddtj� tj|d dd�}t|d jtju � W d � n1 s^0 Y t� dd g�t� d
d g�t� d d
g�d�}t
|d |d � t
|d |d � t
|d |d � d S )Nz)gender age weight
M 64.0 75.0
F 25.0 60.0Trx rz r �r\ rq r r r ru ry rv rz rj rk rl rm ) r r} r~ r rH �VisibleDeprecationWarningrQ r �categoryr] r �r# r� r r� r� r% r% r& � test_header� s 2 �zTestFromTxt.test_headerc C s� t d�}tjdd��B}t�ddtj� tj|d d�}t|d jtju � W d � n1 s\0 Y t� dd g�t� d
d g�t� d d
g�t� ddg�t� ddg�g}t
|j j g d�� t
|�D ]\}}t
|d| |� q�d S )Nz*A 64 75.0 3+4j True
BCD 25 60.0 5+6j FalseTrx rz r r[ r � As BCD�@ � rv rz y @ @y @ @F)�f0�f1�f2Zf3r� zf%i)r r} r~ r rH rb rQ r rc r] r r\ rq r� )r# r� r r� r� rv r] r% r% r& �test_auto_dtype� s 2 �zTestFromTxt.test_auto_dtypec C s: t d�}tj|d d�}t�g d�g d�g�}t||� d S )Nz1 2 3 4
5 6 7 8
r[ rc )r� r� r� r� �r rH rQ r] r �r# r� r� r� r% r% r& �test_auto_dtype_uniform� s z#TestFromTxt.test_auto_dtype_uniformc C sZ t d�}t�dtfddtfdtfgfg�}tj||dd�}tjdd g|d
�}t||� d S ) Nr� rm rp r� r$ r� r r� r� r[ )r rH r\ r_ r^ rQ r] r �r# r� Z
fancydtyper� r� r% r% r& r� � s
"z TestFromTxt.test_fancy_dtypec C sN ddd�}t d�}d}tj|||d�}||d< tjdd g|d
�}t||� d S ) N)�grW r rn rp s M 64.0 75.0
F 25.0 60.0rj ra rq rs rw r[ rm )r# rR r� rq r� r� r% r% r& �test_names_overwrite� s ���z TestFromTxt.test_names_overwritec C s< t jtdd�� t�d� W d � n1 s.0 Y d S )Nzfname must be a string,r� �{ )r� r� r� rH rQ rK r% r% r& �test_bad_fname� s zTestFromTxt.test_bad_fnamec C s t d�}tjdd��D}t�ddtj� tj|dd d�}t|d jtju � W d � n1 s^0 Y tj g d�d d
t
fd t fgd �}t ||� t d
�}tjdd��D}t�ddtj� tj|dd d�}t|d jtju � W d � n1 s�0 Y t ||� d S )NzN
#gender age weight
M 21 72.100000
F 35 58.330000
M 33 21.99
Trx rz r )rq r\ r ))rt r� gfffffR@)rx r
g
ףp=*M@)rt r� g=
ףp�5@)rk r rl rm r[ sO
# gender age weight
M 21 72.100000
F 35 58.330000
M 33 21.99
�
r r} r~ r rH rb rQ r rc r] r_ r^ r )r# r� r r� r] r% r% r& �test_commented_header� s 2
�
2z!TestFromTxt.test_commented_headerc C sJ t d�}tj|ttfd dd�}tjddgdtfdtfgd�}t||� d S ) Nzcol1 col2
1 2
3 4T)r\ r� rq rj rk Zcol1Zcol2r[ �r rH rQ r_ r] r rn r% r% r& � test_names_and_comments_none� s z(TestFromTxt.test_names_and_comments_nonec
C s� t � ��}tj�|d�}t|d�� }|�d�d�� W d � n1 sF0 Y t� �H t� t
�� t j |dd� W d � n1 s�0 Y W d � n1 s�0 Y W d � n1 s�0 Y d S )Nr r� � ϖr �asciirA )
r rN r� r� r� r' rS r r� r� �UnicodeDecodeErrorrH rQ )r# r Zfpathr� r% r% r& � test_file_is_closed_on_error� s . z(TestFromTxt.test_file_is_closed_on_errorc C s� t d�}tjdd��F}t�ddtj� tj|ddd d�}t|d jtju � W d � n1 s`0 Y tj d d
d t
fd t fgd
�}t ||� d S )N�A B C D
aaaa 121 45 9.1Trx rz r ��A�C�D)r� rq r\ r )r� �- �333333"@�r �|S4r� r� r[ ru rd r% r% r& �test_autonames_and_usecols� s �2�z&TestFromTxt.test_autonames_and_usecolsc C sJ t d�}tj|tdddd� idd�}t�dd gd
d ggt�}t||� d S ) Nr� r� r2 c S s t | pd�S r� r� r� r% r% r& r\ r* z:TestFromTxt.test_converters_with_usecols.<locals>.<lambda>r� r� rY r� r� r� rw rn r% r% r& r� s
�z(TestFromTxt.test_converters_with_usecolsc C s� t d�}tjdd��P}t�ddtj� tj|ddd ddd � id
�}t|d jtju � W d � n1 sj0 Y tj d d
dt
fdt fgd�}t ||� d S )Nr} Trx rz r r~ r� c S s dt | � S )NrY r� r� r% r% r& r\ r* zDTestFromTxt.test_converters_with_usecols_and_names.<locals>.<lambda>)r� rq r\ r] r )r� �Z r� r� r� r[ ru rd r% r% r& �&test_converters_with_usecols_and_names s
�2�z2TestFromTxt.test_converters_with_usecols_and_namesc C sb ddd� i}t d�}tj|dd ddg|d�}tjtdd d
�d fdtjfdtfgd �}t||� d S )
N�datec S s
t | d�S �Nz%Y-%m-%d %H:%M:%SZ)r7 r� r% r% r& r\ r* z9TestFromTxt.test_converters_cornercases.<locals>.<lambda>� 2009-02-03 12:00:00Z, 72214.0r� r� �r� r\ rq r] �� rY r2 � `��@r[ )r rH rQ r] r Zobject_r^ r �r# Z converterr� r� r� r% r% r& �test_converters_cornercases s �
��z'TestFromTxt.test_converters_cornercasesc C s\ ddd� i}t d�}tj|dd ddg|d�}tjtdd d
�d fd dtfgd
�}t||� d S )Nr� c S s t �t| d��S r� )rH Z
datetime64r7 r� r% r% r& r\ & r* z:TestFromTxt.test_converters_cornercases2.<locals>.<lambda>r� r� r� r� r� rY r2 r� )r� zdatetime64[us]r[ )r rH rQ r] r r^ r r� r% r% r& � test_converters_cornercases2# s �
�
�z(TestFromTxt.test_converters_cornercases2c C sb t d�}tj|dddd� id�}t|ddg� |�d� tj|dd d
d� id�}t|d d g� d S )
Nz 1 21
3 42
r� r c S s
t | d�S r� r� r� r% r% r& r\ 2 r* z3TestFromTxt.test_unused_converter.<locals>.<lambda>r� r� r� rS c S s
t | d�S r� r� r� r% r% r& r\ 7 r* r� r� )r rH rQ r rC �r# r� r� r% r% r& r� . s
�
�z!TestFromTxt.test_unused_converterc C sF dd� }dd� }t d�}t||d�dd d�}tttj|fi |�� d S )Nc S s4 t d| �� v r| �� d p0d| �� vr.| �� p0d�S )N� rr� rR �r^ �lowerr
r� r[ r% r% r& r\ ; s �z4TestFromTxt.test_invalid_converter.<locals>.<lambda>c S s4 t d| �� v r| �� d p0d| �� vr.| �� p0d�S )N� %r rR r� r[ r% r% r& r\ = s �zgD01N01,10/1/2003 ,1 %,R 75,400,600
L24U05,12/5/2003, 2 %,1,300, 150.5
D02N03,10/10/2004,R 1,,7,145.55r: r� )r] r� r\ )r rV r r
rH rQ )r# Z
strip_randZ strip_perr$ rQ r% r% r& �test_invalid_converter: s
�z"TestFromTxt.test_invalid_converterc C sH t d�}dd� }tj|dd|id�}t�ddgd d
gg�}t||� d S ) Nz q1,2
q3,4c S s t | dd � �S rd rt r� r% r% r& r\ J r* z;TestFromTxt.test_tricky_converter_bug1666.<locals>.<lambda>r� r )r� r] r� r� r� r� rm )r# r$ Zcnvr� r� r% r% r& � test_tricky_converter_bug1666G s
z)TestFromTxt.test_tricky_converter_bug1666c C s| d}t jt|�dtdtid�}t jdgddtfdtfgd �}t||� t jt|�dtdtid�}t �g d
��}t||� d S ) Nz 2009; 23; 46r� r r� )Z2009� 7@�. )ri r� rj rk r[ )g d�@r� r� )rH rQ r r^ r4 r] r )r# �dstrr� r� r% r% r& �test_dtype_with_convertersO s
��
�z&TestFromTxt.test_dtype_with_convertersc s� d}ddddd�� g d�}t t t � fdd �d
�}tjt|�|d d |d �}tjjg d
�|d�}t||� g d�}tjt|�|d dd |d�}tjjg d�|d�}t||� d S )Nz!1,5,-1,1:1
2,8,-1,1:n
3,3,-2,m:n
r rS rY r2 )z1:1z1:nzm:1zm:n)��e1rn ��e2rn )Ze3Zi2�r� Zi1c s � | � � S r rZ )rh �Zdmapr% r& r\ _ r* zDTestFromTxt.test_dtype_with_converters_and_usecols.<locals>.<lambda>)r rS rY r2 r� )r\ r� rq r] ))rS r� r� r )rY r� r� rS )r2 r2 ���r2 r[ )r� r� r� )r rS r2 )r\ r� r� rq r] ))rS r� r )rY r� rS )r2 r2 r2 )r_ rH �
recfromcsvr Zrecr] r )r# r� Zdtyp�convr� r� r% r� r& �&test_dtype_with_converters_and_usecols[ s �
�z2TestFromTxt.test_dtype_with_converters_and_usecolsc C s d}dt fdtfg}dd� }d|i}tjt|�d||d�}tjdtd dd�fd
td dd �fg|d
�}t||� ddt fdtfgfg}tt d��& tjt|�d||d�}W d � n1 s�0 Y dt fdtfdg fg}tt d��& tjt|�d||d�}W d � n1 �s0 Y d S )Nr� r� r� c S s t | �� d�S r� r� r� r% r% r& r\ o r* z4TestFromTxt.test_dtype_with_object.<locals>.<lambda>rS r� r� r� rY r� r� r[ Znestz Nested fields.* not supported.*)
r_ ra rH rQ r r] r r r �NotImplementedErrorr� r% r% r& r� j s4 � �
� �$� �z"TestFromTxt.test_dtype_with_objectc C s( t jtd�td�}t jtd�td�}d S )N�1r[ �string)rH rQ r ra )r# �parsedr% r% r& �#test_dtype_with_object_no_converter� s z/TestFromTxt.test_dtype_with_object_no_converterc C sH t d�}tj|dd tddtid�}tjdgddtfgd �}t||� d S )
Nz skip,skip,2001-01-01,1.0,skipr� r: rY )r� rq r\ r� r] )�
2001-01-01r� )r �|S10r r[ )r rH rQ r^ r4 r] r rn r% r% r& �'test_userconverters_with_explicit_dtype� s �
�z3TestFromTxt.test_userconverters_with_explicit_dtypec
C s� d}t � �l}t|d��"}|�d| d � W d � n1 s>0 Y tj|dd tddtjjidd �}W d � n1 s|0 Y tjd
|� d� d fgd d
tfgd�}t
||� d S )Nr r� s skip,skip,2001-01-01s ,1.0,skipr� r: rY r )r� rq r\ r� r] r r� r� )r z|U11r r[ ) r r� r' rH rQ r^ �compatZunicoder] r5 r )r# r r� r� r� r� r% r% r& �,test_utf8_userconverters_with_explicit_dtype� s 0 �$
�z8TestFromTxt.test_utf8_userconverters_with_explicit_dtypec C s6 t d�}t�|�}t�g d�g d�g�}t||� d S )Nz 1 2 3 4 5
6 7 8 9 10)r� r� r� r� � @)r� � @r� � "@g $@rm rn r% r% r& �test_spacedelimiter� s
�z TestFromTxt.test_spacedelimiterc C s@ d}t jt|�dd�}t �g d�g d�g d�g�}t||� d S )Nz 1 2 3
4 5 67
890123 4r2 )r� r� )rZ r� �C )iz rs rZ �rH rQ r r] r rn r% r% r& �test_integer_delimiter� s z"TestFromTxt.test_integer_delimiterc C s@ t d�}tj|tdddd� id�}t�g d�t�}t||� d S )Nr� r� r2 c S s t | pd�S r� r� r� r% r% r& r\ � r* z*TestFromTxt.test_missing.<locals>.<lambda>r� r� rw rn r% r% r& r� � s
�zTestFromTxt.test_missingc C sh d}t jt|�ddd�}t �dt jdt jfdt jdfg�}t jg d �td
�}t|j|� t|j|� d S ) Nz1 2 3
2
1 3r T)r� �usemaskr� rY rS r2 )�r r r �rS r rS �r rS r r[ ) rH rQ r r] �nan�boolr r� �mask)r# r� r� Zctrl_dZctrl_mr% r% r& �test_missing_with_tabs� s �" z"TestFromTxt.test_missing_with_tabsc C s� t �ddgddggt�}t� }t �||� |�d� t j|tdd�}t||d d �df � t �g d�g d �gt�}t� }t �||� |�d� t j|td
d�}t||d d �dd �f � |�d� t j|tt �ddg�d�}t||d d �dd �f � d S ) NrS rY r2 rZ r r� r� r� r� rj )rH r] r^ r r� rC rQ r rS r% r% r& r� � s
zTestFromTxt.test_usecolsc C sB d}t jt|�ddd�}t jddgdd� d D �d
�}t||� d S ) N� 1 2 3
4 5 6�a, b, cza, c)rq r� r� �rZ r� c S s g | ] }|t f�qS r% rt rZ r% r% r& r) � r* z3TestFromTxt.test_usecols_as_css.<locals>.<listcomp>�acr[ r� �r# r� r� r] r% r% r& �test_usecols_as_css� s
� z TestFromTxt.test_usecols_as_cssc C sZ t d�}ddg}ddg}tj|dtt||��d�}t|d dd g� t|d d
d g� d S ) NzJOE 70.1 25.3
BOB 60.5 27.9r� r� r� r� r� r� r� r� r� r� )r rH rQ r r� r )r# r� rq r� r� r% r% r& �"test_usecols_with_structured_dtype� s �z.TestFromTxt.test_usecols_with_structured_dtypec C s* t jtd�dd�}t|t �ddg�� d S )Ns 1 2 3
4 5 6r r� r� r� )rH rQ r r r] )r# r� r% r% r& �test_usecols_with_integer� s z%TestFromTxt.test_usecols_with_integerc C sx t jddgdtfdtfgd�}d}tdd�}t jt|�fd d
i|��}t||� t jt|�fd d i|��}t||� d S ) Nr� r� rW r� r[ r� r� )rq r� �r r� )rW r� )rH r] r^ rV rQ r r )r# r] r� rQ r� r% r% r& � test_usecols_with_named_columns� s
��z+TestFromTxt.test_usecols_with_named_columnsc C st t � �Z}|jdd� t� }t�|�}t|t�g �� tj|dd�}t|t�g �� W d � n1 sf0 Y d S )Nz genfromtxt: Empty input file:)�messagerS )rU )r r� r rH rQ r r] )r# r� r� r� r% r% r& r� � s
zTestFromTxt.test_empty_filec C s\ t d�}t�dtfddtfdtfgfg�}tj||ddd�}tjd d
g|d �}t||� d S ) Nr� rm rp r� r$ r� T)r\ r� r� r� r� r[ ) r rH r\ r_ r^ rQ �mar] r rp r% r% r& �test_fancy_dtype_alt s
"z TestFromTxt.test_fancy_dtype_altc C sh t d�}t�ddtfdtfdtdfg�}tj||d�}tjdd d
g d �g d �gfg|d�}t||� d S r� )r rH r\ r^ r_ rQ r] r r� r% r% r& r� s � �z TestFromTxt.test_shaped_dtypec C s� t d�}tdddd�}tj|fd dd�|��}tjddgd d
gd tfd tfgd
�}t||� t|j|j� |� d� tj|fddi|��}tjddgd d
gd t
fd t
fgd
�}t||� t|j|j� d S )N�
A,B
0,1
2,N/Ar� �N/AT�r� �missing_valuesrq �r\ r� r �rY r� �FF�FTr �B�r� r\ r r� ) r rV rH rQ r� r] r_ r r� rC r^ �r# r� rQ r� r� r% r% r& �test_withmissing s"
�
�
z TestFromTxt.test_withmissingc C s� d}t d ddd�}dtfdtfdtfg}tjt|�fdd i|��}tjg d
�g d �|d �}t ||� ||d
< tjt|�fdddd�dd�|��}tjg d
�g d�|d �}t ||� tjt|�fdddd�dd�|��}tjg d
�g d�|d �}t ||� d S )Nz4A, B, C
0, 0., 0j
1, N/A, 1j
-9, 2.2, N/A
3, -99, 3jr� T)r\ r� rq r r� r� r� r� ))r rR y )rS r� r )r4 g������@� � 8��)r2 ���y @)r� r� )r r rS r� r� r\ r4 r� r� �r rS rY )r� r� )r� r� r� r� )r r� r� )
rV r_ r^ r� rH rQ r r� r] r )r# r� Z
basekwargsZmdtyper� r� r% r% r& �test_user_missing_values' sB �
�
��
�
��
�z$TestFromTxt.test_user_missing_valuesc C s8 t jddgdtfdtfgd�}d}tdtdd d
d d �d
d
dd �d�}t jt|�fi |��}t jddgdd� dD �d�}t||� t jt|�fddi|��}t jddgdd� dD �d�}t||� d}t jt|�dtdd
d�}t �g d �g d �g�}t||� t jt|�dtdd d�}t �g d �g d �g�}t||� d S )!N)r r2 )rZ r� rW r� r[ zN/A, 2, 3
4, ,???r� za,b,cr� r� z???)r r� rY r r� )r� r\ rq r� �filling_values)r rY r2 )rZ r r� c S s g | ] }|t f�qS r% r� rZ r% r% r& r) R r* z8TestFromTxt.test_user_filling_values.<locals>.<listcomp>�abcr� r� c S s g | ] }|t f�qS r% r� rZ r% r% r& r) V r* r� z1,2,*,4
5,*,7,8
�*)r� r\ r� r� )rS rY r rZ )r� r r� r� r� )rS rY r� rZ )r� r� r� r� )rH r] r_ rV rQ r r )r# r] r� rQ r� Zdata2r% r% r& �test_user_filling_valuesG s6
�
�
�
�z$TestFromTxt.test_user_filling_valuesc C s^ t d�}tj|d ddddd�}tjddgdd gd
tfd tfgd �}t||� t|j|j� d S )
NzA,B
0,1.5
2,-999.00r� z-999.0T)r\ r� r� rq r� )r r� )rY g �r� r� r r� r� ) r rH rQ r� r] r_ r^ r r� rn r% r% r& �test_withmissing_floatc s
�
�
z"TestFromTxt.test_withmissing_floatc C sN t d�}tj|d ddd�}tjg d�g d�gg d�g d�gd�}t||� d S ) Nz 1 2 3
4 5 6
�2,5T�r\ r� r� r� r� r� )r� )r rH rQ r� r] r rn r% r% r& � test_with_masked_column_uniformm s �&z+TestFromTxt.test_with_masked_column_uniformc C sR t d�}tj|d ddd�}tjddgddgdtfd tfd
tfgd �}t||� d S ) NzTrue 2 3
False 5 6
r� Tr� r� )r r� r� r� ri rj rk r� )r rH rQ r� r] r� r_ r rn r% r% r& � test_with_masked_column_variousu s �
�z+TestFromTxt.test_with_masked_column_variousc s� dgd }t d�D ]}d|d| < q|�dd� td�|���td d d
d �� � �fd d
�}tt|�}tt|�d� t|t j
ddd� dD �d�� �� d� t t
t j�d d
d� d S )N�
1, 1, 1, 1, 1r- r� � 2, 2, 2, 2 2r� r �
a, b, c, d, er� r� T�r� r\ rq c s t j�fddi� ��S )Nr_ F�rH rQ r% �rQ �mdatar% r& r� � s z)TestFromTxt.test_invalid_raise.<locals>.fr� c S s g | ] }|t f�qS r% r� rZ r% r% r& r) � r* z2TestFromTxt.test_invalid_raise.<locals>.<listcomp>�abcder[ �r� rq )r{ �insertr r� rV r r r �lenrH r| rC r r� rQ )r# r� rv r� �mtestr% r� r& �test_invalid_raise s
�z TestFromTxt.test_invalid_raisec s� dgd }t d�D ]}d|d| < q|�dd� td�|���td d d
d d �� � �fd
d�}tt|�}tt|�d� t|t j
ddd� dD �d�� �� d� t j �fddi� ��}tt|�d� t j
ddd� dD �d�}d|dd� t d�D �< t||� d S )Nr� r- r� r� r� r r� r� r� TF)r� r\ rq r_ c s t j�fddi� ��S )Nr� )r rZ r� r% r� r% r& r� � s z6TestFromTxt.test_invalid_raise_with_usecols.<locals>.fr� c S s g | ] }|t f�qS r% r� rZ r% r% r& r) � r* z?TestFromTxt.test_invalid_raise_with_usecols.<locals>.<listcomp>Zaer[ r� r c S s g | ] }|t f�qS r% r� rZ r% r% r& r) � r* �abr� c S s g | ] }d | �qS )r� r% rZ r% r% r& r) � r* )
r{ r� r r� rV r r r r� rH r| rC rQ )r# r� rv r� r� r� r% r� r& � test_invalid_raise_with_usecols� s$
�
z+TestFromTxt.test_invalid_raise_with_usecolsc C sV dgd }t d�|��}ddd� i}td|dd � d
D �d �}tttj|fi |�� d S ) Nz1, 1, 1, 1, -1.1r- r� rZ c S s d| � � S )Nz(%s)rZ r[ r% r% r& r\ � r* z5TestFromTxt.test_inconsistent_dtype.<locals>.<lambda>r� c S s g | ] }|t f�qS r% r� rZ r% r% r& r) � r* z7TestFromTxt.test_inconsistent_dtype.<locals>.<listcomp>r� )r� r] r\ )r r� rV r r� rH rQ )r# r� r� r] rQ r% r% r& �test_inconsistent_dtype� s
�z#TestFromTxt.test_inconsistent_dtypec C sL d}t jt|�dd dd�}t jddgdtfdtfd tfgd
�}t||� d S ) N�0, 1, 2.3
4, 5, 6.7r� �f%02i�r� r\ Z
defaultfmt�r rS �ffffff@)rZ r� �������@Zf00Zf01Zf02r[ )rH rQ r r] r_ r^ r �r# r� r� r] r% r% r& �test_default_field_format� s
�
�z%TestFromTxt.test_default_field_formatc C sB d}t jt|�dtdd�}t jg d�g d�gtd�}t||� d S )Nr� r� r� r� �rR r� r� �r� r� r� r[ �rH rQ r r^ r] r r� r% r% r& �test_single_dtype_wo_names� s
�z&TestFromTxt.test_single_dtype_wo_namesc C sD d}t jt|�dtdd�}t jddgdd� d D �d
�}t||� d S ) Nr� r� r� r� r� r� c S s g | ] }|t f�qS r% rt rZ r% r% r& r) � r* zBTestFromTxt.test_single_dtype_w_explicit_names.<locals>.<listcomp>r� r[ r r� r% r% r& �"test_single_dtype_w_explicit_names� s
�
�z.TestFromTxt.test_single_dtype_w_explicit_namesc C sD d}t jt|�dtdd�}t jddgdd� d D �d
�}t||� d S ) Nza, b, c
0, 1, 2.3
4, 5, 6.7r� Tr� r� r� c S s g | ] }|t f�qS r% rt rZ r% r% r& r) � r* zBTestFromTxt.test_single_dtype_w_implicit_names.<locals>.<listcomp>r� r[ r r� r% r% r& �"test_single_dtype_w_implicit_names� s
�
�z.TestFromTxt.test_single_dtype_w_implicit_namesc C sR d}t jt|�dtttfdd�}t jddgdtfdtfd tfgd
�}t||� d S ) Nr� r� zf_%02ir� )r r� r� )rZ r� r� Zf_00Zf_01Zf_02r[ �rH rQ r r_ r^ r] r r� r% r% r& �test_easy_structured_dtype� s
�
�z&TestFromTxt.test_easy_structured_dtypec C s, d}t dd d�}tjdd��J}t�ddtj� tjt|�fi |��}t|d j tju � W d � n1 sl0 Y tj
d gd
d t fd gd
�}t ||� tjdd��N}t�ddtj� tjt|�fddi|��}t|d j tju � W d � n1 s�0 Y tj
dgdd t fdgd
�}t ||� d S )Nz01/01/2003 , 1.3, abcder� )r� r\ Trx rz r r )z 01/01/2003 ��������?z abcde)ri z|S12rj )rk r r[ Z autostrip)z
01/01/2003r r� )ri r� )rk z|S5)
rV r} r~ r rH rb rQ r r rc r] r^ r )r# r� rQ r r� r] r% r% r& �test_autostrip� s$ 2 �
2 �zTestFromTxt.test_autostripc C s� d}t jt|�ddd d�}dtfdtfdtfg}t jd|d �}t||� t jt|�ddd d
d
d �}d tfd
tfdtfg}t jd|d �}t||� t jt|�ddd d
d�}d tfdtfdtfg}t jd|d �}t||� d S )NzA.A, B (B), C:C
1, 2, 3.14r� T�r� rq r\ �AA�B_B�CC)rS rY g ��Q� @r[ r �r� rq r\ Z
replace_space� deletechars�A.A�B (B)�C:C�r� rq r\ r
�B_(B)r �r# r� r� Z
ctrl_dtyper] r% r% r& �test_replace_space� s*
�
�
�z TestFromTxt.test_replace_spacec C s� d}t jt|�ddtd�}dtfdtfdtfg}t jd|d �}t||� t jt|�ddtd
d
d �}d tfd
tfdtfg}t jd|d �}t||� t jt|�ddtd
d�}d tfdtfdtfg}t jd|d �}t||� d S )NzA.A, B (B), C:C
1, 2, 3r� Tr r r
r r� r[ r r r r r r r )rH rQ r r_ r] r r r% r% r& � test_replace_space_known_dtype
s*
�
�
�z*TestFromTxt.test_replace_space_known_dtypec C s� d}t ddd�}tjddgdd� d D �d
�}tjt|�fd d i|��}t||� tjddgd d� d D �d
�}tjt|�fi |��}d S )
NzA,,C
0,1,2
3,4,5r� Tr� r� r� c S s g | ] }|t f�qS r% r� rZ r% r% r& r) ( r* z5TestFromTxt.test_incomplete_names.<locals>.<listcomp>)r ri r� r[ r\ c S s g | ] }|t f�qS r% rt rZ r% r% r& r) - r* )rV rH r] rQ r r �r# r� rQ r] r� r% r% r& �test_incomplete_names" s
�
�z!TestFromTxt.test_incomplete_namesc C sP d}t jt|�tttfdd�}t jddgdtfdtfdtfgd�}t||� d S ) Nz 1 2 3
4 5 6rW ra r� r� ri rj r[ r r� r% r% r& �test_names_auto_completion0 s
�
�z&TestFromTxt.test_names_auto_completionc C s� d}d}t jt|�tttfdddd�}t|jj|� t jt|�tttfdddd�}t|jj|� t jt|�tdddd�}t|jj|� d S )Nz'A,B,C,D,E
0,1,2,3,4
0,1,2,3,4
0,1,2,3,4)r r� �Er� )r rY rZ T)r\ r� r� rq )rH rQ r r_ r r\ rq )r# r� Z
ctrl_namesr� r% r% r& � test_names_with_usecols_bug16369 s"
�
�
�z+TestFromTxt.test_names_with_usecols_bug1636c C s� d}t ddd d�}tjddgdtfdtfd tfgd
�}tjt|�fi |��}t||� t d dd d�}tjddgdtfdtfd tfgd
�}tjt|�fi |��}t||� d S ) Nz- A B C
0 1 2.3
45 67 9.)r� r� rZ Tr r� )r� r� r� r r� r� r[ r� )rV rH r] r_ r^ rQ r r r r% r% r& �test_fixed_width_namesL s
�
�z"TestFromTxt.test_fixed_width_namesc C sV d}t dd dd�}tjg d�g d�g d�gtd�}tjt|�fi |��}t||� d S ) Ns 1, 2, 3
1, , 5
0, 6,
r� r� )r� r\ r� r� )rS r� r� )r r� r� r[ )rV rH r] r_ rQ r r r r% r% r& �test_filling_values[ s
z TestFromTxt.test_filling_valuesc C s� t jdd��J}t �ddtj� tjtd�d d dd�}t|d jtju � W d � n1 s\0 Y t |d d
� t jdd��J}t �ddtj� tjtd �d d dd�}t|d jtju � W d � n1 s�0 Y t |d d � d S )
NTrx rz r z test1,testNonetherestofthedatar� �r\ r� r� r rS s testNonetherestofthedataz test1, testNonetherestofthedatas testNonetherestofthedata)
r} r~ r rH rb rQ r r rc r )r# r r� r% r% r& �test_comments_is_nonec s
�2
�2z!TestFromTxt.test_comments_is_nonec C s� d}d}d| d }|| | }t jdd��J}t �ddtj� tjt|�d d d d
�}t|d jtju � W d � n1 s|0 Y t |d d
� t |d d| � t |d d� tjt|�d d d dd�}t |d d� t |d d|�
d� � t |d d� t jdd��N}t �ddtj� tjtd| �d d d d
�}t|d jtju � W d � n1 �sb0 Y t |d d � t |d d| � d S )Ns ���� norm1,norm2,norm3
� test1,testNonethe� ,test3
Trx rz r r� r r )rS r � test1)rS rS � testNonetherj � test3r1 �r\ r� r� r �test1� testNonethe�test3�
0,testNonetheri rj ) r} r~ r rH rb rQ r r rc r r5 )r# r1 �norm�encr$ r r� r% r% r& � test_latin1r s8
�2
��4zTestFromTxt.test_latin1c C s6 d}| j t|�d dd�}t|t�|�d��� �� d S rV )rD r r rH r] r5 r
rW r% r% r& � test_binary_decode_autodtype� s z(TestFromTxt.test_binary_decode_autodtypec C s� d}d}d| d }|| | }t jdd��J}t �ddtj� tjt|�d d d d
�}t|d jtju � W d � n1 s|0 Y t� g d �d
d| dgg d �g�}t
||� d S )Nr r r r! Trx rz r r� r r )s norm1s norm2s norm3r" r# r$ ) r} r~ r rH rb rQ r r rc r] r )r# r r* r+ r$ r r� �ctlr% r% r& �test_utf8_byte_encoding� s
�2 �z#TestFromTxt.test_utf8_byte_encodingc C s6 d}t � ��}t|d��&}|�d| d d � W d � n1 sD0 Y tj|d d ddd�}tjd d
|�d� d gd d
|�d� d ggtjd �}t||� t|d�� }|�d
| � W d � n1 s�0 Y tj|d d ddd�}t |d d� t |d d
|�d� � W d � n1 �s(0 Y d S )Nr r� r r! rY r� r r% r& r' r( r[ r) ri r rj )
r r� r' rH rQ r] r5 r r r )r# r r� r� r� r. r% r% r& �test_utf8_file� s*
4
���
,
�zTestFromTxt.test_utf8_filec C s^ d}d}zt �� }|�|� W n ttfy> t�d� Y n0 t� �� }t� |d��>}|�
d� |�
d| d � |�
d| d � W d � n1 s�0 Y t j d
d ��F}t �
d d
tj� tj|d d dd�}t|d jtju � W d � n1 s�0 Y tjg d�d|dgdd| dggtjd�}t||� W d � n1 �sP0 Y d S )Nry u öüözTSkipping test_utf8_file_nodtype_unicode, unable to encode utf8 in preferred encodingr? znorm1,norm2,norm3
znorm1,z,norm3
ztest1,testNonethez,test3
Trx rz r r� r r )�norm1Znorm2�norm3r1 r2 r& r' r( r[ )r4 r5 rS � UnicodeError� ImportErrorr� r) r ra r� r' r} r~ r rH rb rQ r rc r] r r ) r# r r1 r r� r� r r� r. r% r% r& � test_utf8_file_nodtype_unicode� s8
0�
�2 ��z*TestFromTxt.test_utf8_file_nodtype_unicodec C s� t d�}tdddd�}tj|fi |��}tjddgdtfd tfgd
�}tt|tj�� t ||� t d �}tj|fd dd �|��}t
jdd
gddgdtfd tfgd�}t ||� t |j |j � t |j ddg� d S )N� A,B
0,1
2,3r� r� Tr� r r: r r� r[ r� r� r� r� r� r� r rY )
r rV rH �
recfromtxtr] r_ r rF �recarrayr r� r� r r� r% r% r& �test_recfromtxt� s"
�
�
zTestFromTxt.test_recfromtxtc C s� t d�}tdddd�}tj|fdd i|��}tjddgdtfd tfgd
�}tt|tj�� t ||� t d �}tj|fd dd �|��}t
jdd
gddgdtfd tfgd�}t ||� t |j |j � t |j ddg� t d�}tj|dd�}tjddgdtfdtfgd
�}tt|tj�� t ||� t d�}dtfdt
fg}tj|d|d�}tjddg|d
�}tt|tj�� t ||� t d�}tj|ddd� id�}tjdd gd td ffgd
�}t |j|j� t ||� d S ) Nr6 r� T�r� rq Zcase_sensitiver\ r r: r r� r[ r� r� r� r� r� r� r rY )r� rW r� )r� r\ zcolor
"red"
"blue"c S s
| � d�S )N� ")r� r[ r% r% r& r\ r* z-TestFromTxt.test_recfromcsv.<locals>.<lambda>)r] )Zred)ZblueZcolorrZ )r rV rH r� r] r_ r rF r8 r r� r� r r^ r4 r\ )r# r� rQ r� r� r\ r% r% r& �test_recfromcsv� sJ
�
�
�
�
zTestFromTxt.test_recfromcsvc C s� d}t |�}tj|dd�}t�|�}t|ddgddgddgg� t|d d
gd d gg� tttjt |�d
d� d}tjt |�dd�}t�ddgddgg�}t||� tttjt |�ddd� tttjt |�dd� t� ��}|�t � tjt |�ddd�}t�ddgddgddgddgg�}t||� tjt |�ddd�}t�ddgddgddgddgg�}t||� W d � n1 �sx0 Y d}t |�}tj|dddd�}tjg d�ddgd �}t||� tj|d |j
d �}tjd d gddgd �}t||� d S ) Nz1 2
3 4
5 6
7 8
9 10
r2 )r rS rY rZ r� r� r� r� r� r� r z 1 1
2 2
0
3 3
4 4
5
6
7
r� r� )rX r F)r r_ r� r� z"a b
#c d
1 1
2 2
#0
3 3
4 4
5 5
T)rU r rq ))r� r� )r� r� )r� r� )r� �<f8)r| r= r[ )r r\ )r� r� )r� r� ) r rH rQ r r r� r] r r� r r\ )r# r� r� Za1Za2r� r� r� r% r% r& r! sF
�
"
"*
�
�zTestFromTxt.test_max_rowsc
C s� t �d��d�}d}|D ]~}d| d }t� �N}t|d��}|�|� W d � n1 sZ0 Y t �|�}W d � n1 s�0 Y t||� qd S )Nr� r: r; r= r> r )rH rB rC r r� r' rQ r )r# r� rF rG r� rA r� rH r% r% r& �test_gft_using_filenameM s ((z#TestFromTxt.test_gft_using_filenamec
C s� t �d��d�}d}|D ]�}d| d }t� }tj|dd�� }|�t|�� W d � n1 s`0 Y tdd ��T}t |d��}|�|� W d � n1 s�0 Y t
t � |�|� W d � q1 s�0 Y qd S )
Nr� r: r; r= r> r �Zfileobjr@ z.gz2r� ) rH rB rC r rJ �GzipFiler' r
r r� r rQ ) r# rE rF rG r� r$ rq rA r� r% r% r& �test_gft_from_gzip[ s , (z TestFromTxt.test_gft_from_gzipc C s( dd� }t �|� �}t|t �d�� d S )Nc s s t d�D ]} td| �V qd S r )r{ r
r r% r% r& r m s z3TestFromTxt.test_gft_using_generator.<locals>.countr� )rH rQ r rB r r% r% r& �test_gft_using_generatork s z$TestFromTxt.test_gft_using_generatorc C s� t d�}tj|d d�}t|jjg d�� t|jd tk� t|jd tjk� t|jd tj k� t
|d d� t|d d� t|d d � d S )
Nz%73786976294838206464 17179869184 1024r[ )ri rj rk ri rj rk g Dl i ) r rH rQ r r\ rq r r^ r� Zint_r r� r% r% r& �test_auto_dtype_largeintt s z$TestFromTxt.test_auto_dtype_largeintc C s^ t d�}tj|ddd�\}}}t|t�g d��� t|t�g d��� t|t�g d��� d S )Nz 1,2,3
4,5,6
7,8,9
0.0,1.0,2.0r� T)r� r )r� r� r� rR )r� r� r� r� )r� r� r� r� )r rH r� r r] )r# r� rW r� r� r% r% r& �test_unpack_float_data� s
z"TestFromTxt.test_unpack_float_datac C s� t d�}ddd�}tj||dd�\}}}t|jt�d�� t|jt�d�� t|jt�d �� t|t�d
d g�� t|t�d d
g�� t|t�ddg�� d S )Nr r rn rp Tr ro rn r� r r r� r
r r )r rH rQ r r\ r r] r
r% r% r& r � s
z"TestFromTxt.test_unpack_structuredc C sr t d�}t�ddg�t�ddg�t�ddg�f}tj|d dd d
�}t||�D ] \}}t||� t|j|j� qLd S ) NzM 21 72.
F 35 58.rt rx r� r
r r Tzutf-8)r\ r r )r rH r] rQ r� r r r\ )r# r� �expectedr� rJ �resultr% r% r& �test_unpack_auto_dtype� s (
z"TestFromTxt.test_unpack_auto_dtypec C sR t d�}ddd�}tjddgtjd�}tj||dd �}t||� t|j|j� d S )
Nz21
35r� �rn rp r� r
r[ Tr )r rH r] r{ rQ r r r\ �r# r� r� rE r� r% r% r& �test_unpack_single_name� s
z#TestFromTxt.test_unpack_single_namec C sZ t d�}ddd�}tjdtjd�}tj||dd�}t||� td |j� t|j|j� d S )
Nr� r� rH rp r� r[ Tr r% ) r rH r] r{ rQ r r rU r\ rI r% r% r& �test_squeeze_scalar� s
z TestFromTxt.test_squeeze_scalar�ndimr� )rL c C s6 d}t jt|�|d�}t jt|�|d�}t||� d S )NZ42r )rH r� r rQ r )r# rL r� rW r� r% r% r& r � s z TestFromTxt.test_ndmin_keywordN)^r- r. r/ r1 rH rQ rD rq r` rd rT r� r^ r` re rl ro r� rr rt rv rx r| r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r r r r r r r r r r r r r r, r- r/ r0 r5 r9 r< r! r> rA rB rC rD r rG rJ rK r� r� r8 r_ r r% r% r% r& rP " s�
#)6
rP c @ sT e Zd Zdd� Zdd� Zdd� Zdd� Zd d
� Zd d � Zd
d� Z dd� Z
dd� Z dS )�
TestPathUsagec C sl t dd��N}t|�}t�ddgddgg�}t�||� t�|�}t||� W d � n1 s^0 Y d S )N�.txtr� g�������?rY r2 rZ )r r rH r] r� r� r )r# r� rW rm r% r% r& � test_loadtxt� s
zTestPathUsage.test_loadtxtc C sn t dd��P}t|�}t�ddgddggt�}t�||� t�|�}t||� W d � n1 s`0 Y d S )Nr� r� rS rY r2 rZ )r r rH r] r_ r� rI r �r# r� rW r� r% r% r& �test_save_load� s
z TestPathUsage.test_save_loadc C s� t dd��f}t|�}t�ddgddggt�}t�||� tj|dd�}t||� ~trbt � t � W d � n1 sv0 Y d S ) Nr� r� rS rY r2 rZ rh �rg )
r r rH r] r_ r� rI r r r rP r% r% r& �test_save_load_memmap� s
z#TestPathUsage.test_save_load_memmapc C s� t dd���}t|�}t�ddgddggt�}t�||� tj|dd�}d |d
d
< d |d
d
< ~trpt� t� t�|�}t ||� W d � n1 s�0 Y d S ) Nr� r� rS rY r2 rZ zr+rR r� r )
r r rH r] r_ r� rI r r r )r# r� rW r� r� r% r% r& � test_save_load_memmap_readwrite� s
z-TestPathUsage.test_save_load_memmap_readwritec C s| t dd��^}t|�}tj|dd� t�|�� }t|d d� W d � n1 sP0 Y W d � n1 sn0 Y d S �Nr� r� r� r� r� )r r rH r� rI r �r# r� r� r% r% r& �test_savez_load� s
z TestPathUsage.test_savez_loadc C sd t dd��F}t|�}tj|dd� t�|�}t|d d� |�� W d � n1 sV0 Y d S rU )r r rH Zsavez_compressedrI r rG rV r% r% r& �test_savez_compressed_load
s
z(TestPathUsage.test_savez_compressed_loadc C sd t dd��F}t|�}t�ddg�}t�||� t�|�}t||� W d � n1 sV0 Y d S )NrN r� rj rk )r r rH r] r� rQ r rP r% r% r& �test_genfromtxt
s
z TestPathUsage.test_genfromtxtc C s� t dd���}t|�}|�d��}|�d� W d � n1 s>0 Y tdddd�}tj|fi |��}tjd d
gd tfd tfgd
�}t t
|tj �� t ||� W d � n1 s�0 Y d S )NrN r� r r6 r� r� Tr� r r: r r� r[ )
r r r� r' rV rH r7 r] r_ r rF r8 r �r# r� r� rQ r� r� r% r% r& r9
s (
�z TestPathUsage.test_recfromtxtc C s� t dd���}t|�}|�d��}|�d� W d � n1 s>0 Y tdddd�}tj|fdd i|��}tjd d
gd tfd tfgd
�}t t
|tj �� t ||� W d � n1 s�0 Y d S )NrN r� r r6 r� Tr: r\ r r: r r� r[ )
r r r� r' rV rH r� r] r_ r rF r8 r rZ r% r% r& r< $
s (
�z TestPathUsage.test_recfromcsvN) r- r. r/ rO rQ rS rT rW rX rY r9 r< r% r% r% r& rM � s
rM c C s` t j�d�} t� }tj|dd�}t �|| � |�� |�d� tj|dd�}tt � |�| � d S )N�r� r� r r? r rh )
rH r� r rJ r@ r� rG rC r rI �rW r$ r� r% r% r& �test_gzip_load2
s
r] c @ s$ e Zd Zdd� Zdd� Zdd� ZdS )�
JustWriterc C s
|| _ d S r ��base�r# r` r% r% r& r! C
s zJustWriter.__init__c C s | j �|�S r )r` r' r" r% r% r& r' F
s zJustWriter.writec C s
| j �� S r )r` rB rK r% r% r& rB I
s zJustWriter.flushN)r- r. r/ r! r' rB r% r% r% r& r^ B
s r^ c @ s& e Zd Zdd� Zdd� Zd dd�ZdS )
�
JustReaderc C s
|| _ d S r r_ ra r% r% r& r! M
s zJustReader.__init__c C s | j �|�S r )r` r� )r# r� r% r% r& r� P
s zJustReader.readr c C s | j �||�S r )r` rC )r# Zoff�whencer% r% r& rC S
s zJustReader.seekN)r )r- r. r/ r! r� rC r% r% r% r& rb L
s rb c C sT t j�d�} t� }t|�}t �|| � |�� |�d� t|�}tt � |�| � d S )Nr[ r )
rH r� r r^ r� rB rC rb r rI r\ r% r% r& �test_ducktypingW
s
rd c C s� t � } tj| dd�}|�d� |�� | �d� tdd��R}t|d�� }|�| �� � W d � n1 sj0 Y t �
|�}W d � n1 s�0 Y | �� t |g d�� d S ) Nr r? � 1 2 3
r r r� r� r� ) r rJ r@ r' rG rC r r� r� rH r� r )r$ rq rA r� rH r% r% r& �test_gzip_loadtxtf
s
,(rf c C sV t � } tj| dd�}|�d� |�� | �d� tj| dd�}tt�|�g d�� d S )Nr r? re r rh r� ) r rJ r@ r' rG rC r rH r� )r$ r� r% r% r& � test_gzip_loadtxt_from_string{
s
rg c C s� t � } t�d�}t�d�}tj| ||d� | �d� t�| �}td|v � td|v � td|�� v � td|�� v � |�� D ] \}}t|dv � t |j
d� q~tt |�� �dk� |D ]}t|dv � q�td|�� v � d S )N)r2 r2 )rm rp r rm rp rY ) r rH r r� rC rI r �keys�itemsr rU r� )r$ rm rp r� r� rW r% r% r& �test_npzfile_dict�
s"
rj zPython lacks refcountsre c C s� t � } t�| g d�� | �d� t� � t�| � W d � n1 sF0 Y | �d� ddg}t� �8 tjtd�|d�}t|tj dg|d�� W d � n1 s�0 Y d S )Nr� r )rW �u1rY )r� rk rY z0 1 2 3r[ )r r: )
r rH r� rC r rI r� r r r] )r� r� rm r% r% r& �test_load_refcount�
s
(
rl )N)OrD r� rJ rN r� r6 r} ra r r� �pathlibr Ztempfiler r r r r4 Zmultiprocessingr r Zctypesr ZnumpyrH Znumpy.mar� Znumpy.lib._iotoolsr
r Z numpy.compatr
Znumpy.ma.testutilsr Z
numpy.testingr r r r r r r r r r r r r r Z numpy.testing._private.utilsr r �maxsizer� rM r" r4 rO r# r7 r9 r� r� r� r9 rc r6 rP rM r] r^ rb rd rf rg rj r� r� rl r% r% r% r& �<module> s� @
k #H 4E 4e
Mini Shell