Current File : //lib64/python3.9/site-packages/numpy/lib/__pycache__/recfunctions.cpython-39.opt-1.pyc
a
z[yc� � @ s� d Z ddlZddlZddlmZ ddlmZmZ ddlmZ ddl m
Z
ddl m Z ddl
mZ ddlmZ ejjjZg d �Zd
d � Ze e�d d
� �Zdd� Zdd� Zdd� Zdd� Zdqdd�Zdrdd�Zdsdd �Z d d � Z d d � Z dtd"d#�Z dud$d%�Z dvd&d'�Z!dwd(d)�Z"e e"�dxd+d,��Z#dyd-d.�Z$e e$�dzd/d0��Z%d{d1d2�Z&d3d4� Z'e e'�d5d6� �Z(d7d8� Z)e e)�d9d:� �Z*d|d;d<�Z+e e+�d}d=d>��Z,d~d?d@�Z-e e-�ddAdB��Z.d�dCdD�Z/e e/�d�dEdF��Z0d�dGdH�Z1d�dIdJ�Z2e e2�d�dLdM��Z3d�dNdO�Z4e e4�d�dPdQ��Z5dRdS� Z6e e6�dTdU� �Z7d�dVdW�Z8e e8�d�dXdY��Z9dZd[� Z:e e:�d\d]� �Z;d�d^d_�Z<e e<�d�d`da��Z=d�dbdc�Z>e e>�d�ddde��Z?d�dfdg�Z@e e@�d�dkdl��ZAd�dmdn�ZBe eB�d�dodp��ZCdS )�z�
Collection of utilities to manipulate structured arrays.
Most of these functions were initially implemented by John Hunter for
matplotlib. They have been rewritten and extended for convenience.
� N)�ndarray�recarray)� MaskedArray)�
MaskedRecords)�array_function_dispatch)�_is_string_like)�suppress_warnings)�
append_fields�apply_along_fields�assign_fields_by_name� drop_fields�find_duplicates�
flatten_descr�get_fieldstructure� get_names�get_names_flat�join_by� merge_arrays�rec_append_fields�rec_drop_fields�rec_join�recursive_fill_fields�
rename_fields�
repack_fields�require_fields� stack_arrays�structured_to_unstructured�unstructured_to_structuredc C s | |fS �N� )�input�outputr r �</usr/lib64/python3.9/site-packages/numpy/lib/recfunctions.py�!_recursive_fill_fields_dispatcher s r# c C sj |j }|jD ]X}z | | }W n ty2 Y q Y n0 |j jdurPt||| � q ||| dt|��< q |S )aj
Fills fields from output with fields from input,
with support for nested structures.
Parameters
----------
input : ndarray
Input array.
output : ndarray
Output array.
Notes
-----
* `output` should be at least the same size as `input`
Examples
--------
>>> from numpy.lib import recfunctions as rfn
>>> a = np.array([(1, 10.), (2, 20.)], dtype=[('A', np.int64), ('B', np.float64)])
>>> b = np.zeros((3,), dtype=a.dtype)
>>> rfn.recursive_fill_fields(a, b)
array([(1, 10.), (2, 20.), (0, 0.)], dtype=[('A', '<i8'), ('B', '<f8')])
N)�dtype�names�
ValueErrorr �len)r r! �newdtype�field�currentr r r" r $ s
r c s: � j du rd� fgS � fdd�� j D �}dd� |D �S dS )aR
Produce a list of name/dtype pairs corresponding to the dtype fields
Similar to dtype.descr, but the second item of each tuple is a dtype, not a
string. As a result, this handles subarray dtypes
Can be passed to the dtype constructor to reconstruct the dtype, noting that
this (deliberately) discards field offsets.
Examples
--------
>>> dt = np.dtype([(('a', 'A'), np.int64), ('b', np.double, 3)])
>>> dt.descr
[(('a', 'A'), '<i8'), ('b', '<f8', (3,))]
>>> _get_fieldspec(dt)
[(('a', 'A'), dtype('int64')), ('b', dtype(('<f8', (3,))))]
N� c 3 s | ]}|� j | fV qd S r )�fields)�.0�name�r$ r r" � <genexpr>b � z!_get_fieldspec.<locals>.<genexpr>c S s4 g | ],\}}t |�d kr |n
|d |f|d f�qS )� r �r' )r- r. �fr r r" �
<listcomp>d s �z"_get_fieldspec.<locals>.<listcomp>�r% )r$ r, r r/ r" �_get_fieldspecK s
�r7 c C sP g }| j }|D ]8}| | }|j dur<|�|tt|��f� q|�|� qt|�S )aG
Returns the field names of the input datatype as a tuple. Input datatype
must have fields otherwise error is raised.
Parameters
----------
adtype : dtype
Input datatype
Examples
--------
>>> from numpy.lib import recfunctions as rfn
>>> rfn.get_names(np.empty((1,), dtype=[('A', int)]).dtype)
('A',)
>>> rfn.get_names(np.empty((1,), dtype=[('A',int), ('B', float)]).dtype)
('A', 'B')
>>> adtype = np.dtype([('a', int), ('b', [('ba', int), ('bb', int)])])
>>> rfn.get_names(adtype)
('a', ('b', ('ba', 'bb')))
N)r% �append�tupler ��adtypeZ listnamesr% r. r* r r r" r j s
r c C sF g }| j }|D ].}|�|� | | }|j dur|�t|�� qt|�S )a�
Returns the field names of the input datatype as a tuple. Input datatype
must have fields otherwise error is raised.
Nested structure are flattened beforehand.
Parameters
----------
adtype : dtype
Input datatype
Examples
--------
>>> from numpy.lib import recfunctions as rfn
>>> rfn.get_names_flat(np.empty((1,), dtype=[('A', int)]).dtype) is None
False
>>> rfn.get_names_flat(np.empty((1,), dtype=[('A',int), ('B', str)]).dtype)
('A', 'B')
>>> adtype = np.dtype([('a', int), ('b', [('ba', int), ('bb', int)])])
>>> rfn.get_names_flat(adtype)
('a', 'b', 'ba', 'bb')
N)r% r8 �extendr r9 r: r r r" r � s
r c C sh | j }|du rd| ffS g }|D ]:}| j| \}}|j durL|�t|�� q |�||f� q t|�S dS )aD
Flatten a structured data-type description.
Examples
--------
>>> from numpy.lib import recfunctions as rfn
>>> ndtype = np.dtype([('a', '<i4'), ('b', [('ba', '<f8'), ('bb', '<i4')])])
>>> rfn.flatten_descr(ndtype)
(('a', dtype('int32')), ('ba', dtype('float64')), ('bb', dtype('int32')))
Nr+ )r% r, r< r r8 r9 )�ndtyper% �descrr) �typ�_r r r" r � s
r Fc C st g }|r$| D ]}|� t|j�� q nF| D ]@}|j}|jd urZt|j�dkrZ|� t|�� q(|�d|f� q(t�|�S )N� r+ )r< r r$ r% r' r7 r8 �np)� seqarrays�flattenr( �ar* r r r" �
_zip_dtype� s rF c C s t | |d�jS )z�
Combine the dtype description of a series of arrays.
Parameters
----------
seqarrays : sequence of arrays
Sequence of arrays
flatten : {boolean}, optional
Whether to collapse nested descriptions.
�rD )rF r> )rC rD r r r" �
_zip_descr� s rH c C s� |du r i }| j }|D ]�}| | }|j durX|r<|g||< ng ||< |�t|||�� qdd� |�|g �plg D �}|r�|�|� n
|r�|g}|p�g ||< q|S )ab
Returns a dictionary with fields indexing lists of their parent fields.
This function is used to simplify access to fields nested in other fields.
Parameters
----------
adtype : np.dtype
Input datatype
lastname : optional
Last processed field name (used internally during recursion).
parents : dictionary
Dictionary of parent fields (used interbally during recursion).
Examples
--------
>>> from numpy.lib import recfunctions as rfn
>>> ndtype = np.dtype([('A', int),
... ('B', [('BA', int),
... ('BB', [('BBA', int), ('BBB', int)])])])
>>> rfn.get_fieldstructure(ndtype)
... # XXX: possible regression, order of BBA and BBB is swapped
{'A': [], 'B': [], 'BA': ['B'], 'BB': ['B'], 'BBA': ['B', 'BB'], 'BBB': ['B', 'BB']}
Nc S s g | ]}|�qS r r )r- r@ r r r" r5 r1 z&get_fieldstructure.<locals>.<listcomp>)r% �updater �getr8 )r; Zlastname�parentsr% r. r* Z
lastparentr r r" r � s"
r c c s4 | D ]*}t |tj�r(tt|��E dH q|V qdS )zu
Returns an iterator of concatenated fields from a sequence of arrays,
collapsing any nested structure.
N)�
isinstancerB �void�_izip_fields_flatr9 ��iterable�elementr r r" rN s rN c c sd | D ]Z}t |d�r,t|t�s,t|�E dH qt|tj�rXtt|��dkrXt|�E dH q|V qdS )zP
Returns an iterator of concatenated fields from a sequence of arrays.
�__iter__NrA )�hasattrrL �str� _izip_fieldsrB rM r' r9 rO r r r" rU s
� rU Tc c s6 |r
t }nt}tj| d|i�D ]}t||��V q dS )a*
Returns an iterator of concatenated items from a sequence of arrays.
Parameters
----------
seqarrays : sequence of arrays
Sequence of arrays.
fill_value : {None, integer}
Value used to pad shorter iterables.
flatten : {True, False},
Whether to
� fillvalueN)rN rU � itertools� zip_longestr9 )rC �
fill_valuerD Zzipfunc�tupr r r" �
_izip_records. s
r[ c C s> t | t�sd}|r"|r:| �t�} nt�| �} |r:| �t�} | S )z�
Private function: return a recarray, a ndarray, a MaskedArray
or a MaskedRecords depending on the input parameters
F)rL r �viewr �ma�filledr )r! �usemask�
asrecarrayr r r" � _fix_outputF s
ra c C sX | j j}| j| j| j }}}|p$i �� D ](\}}||v r*|||< ||| || < q*| S )zp
Update the fill_value and masked data of `output`
from the default given in a dictionary defaults.
)r$ r% �data�maskrY �items)r! �defaultsr% rb rc rY �k�vr r r" �
_fix_defaultsW s rh c C s | S r r )rC rY rD r_ r` r r r" �_merge_arrays_dispatchere s ri ���c C s� t | �dkrt�| d �} t| ttjf�r�| j}|jdu rJt�d|fg�}|r`t| fdd�|kr�| � � } |r||rvt
}q�t }n|r�t }nt}| j
||d�S | f} ndd � | D �} td
d � | D ��}t|�}t| |d�} g }
g } |�rt| |�D ]�\} }
||
}| � � �� }t�| �� � }|�r�t|| j�}t|ttjf��r�t |j�dk�r\|�� d }d}n"tj|| jdd �}tjd
|jd�}nd}d}|
�t�||g| �� | �t�||g| �� q�tt|
|d��}tjtj || |d�t t| |d��d�}|�r�|�
t
�}n�t| |�D ]�\} }
||
}| � � �� }|�r~t|| j�}t|ttjf��r�t |j�dk�rj|�� d }ntj|| jdd �}nd}|
�t�||g| �� �q tj tt|
|d��| |d�}|�r�|�
t �}|S )aR
Merge arrays field by field.
Parameters
----------
seqarrays : sequence of ndarrays
Sequence of arrays
fill_value : {float}, optional
Filling value used to pad missing data on the shorter arrays.
flatten : {False, True}, optional
Whether to collapse nested fields.
usemask : {False, True}, optional
Whether to return a masked array or not.
asrecarray : {False, True}, optional
Whether to return a recarray (MaskedRecords) or not.
Examples
--------
>>> from numpy.lib import recfunctions as rfn
>>> rfn.merge_arrays((np.array([1, 2]), np.array([10., 20., 30.])))
array([( 1, 10.), ( 2, 20.), (-1, 30.)],
dtype=[('f0', '<i8'), ('f1', '<f8')])
>>> rfn.merge_arrays((np.array([1, 2], dtype=np.int64),
... np.array([10., 20., 30.])), usemask=False)
array([(1, 10.0), (2, 20.0), (-1, 30.0)],
dtype=[('f0', '<i8'), ('f1', '<f8')])
>>> rfn.merge_arrays((np.array([1, 2]).view([('a', np.int64)]),
... np.array([10., 20., 30.])),
... usemask=False, asrecarray=True)
rec.array([( 1, 10.), ( 2, 20.), (-1, 30.)],
dtype=[('a', '<i8'), ('f1', '<f8')])
Notes
-----
* Without a mask, the missing value will be filled with something,
depending on what its corresponding type:
* ``-1`` for integers
* ``-1.0`` for floating point numbers
* ``'-'`` for characters
* ``'-1'`` for strings
* ``True`` for boolean values
* XXX: I just obtained these values empirically
rA r Nr+ TrG )r$ �typec S s g | ]}t �|��qS r )rB �
asanyarray)r- Z_mr r r" r5 � r1 z merge_arrays.<locals>.<listcomp>c s s | ] }|j V qd S r )�size�r- rE r r r" r0 � r1 z merge_arrays.<locals>.<genexpr>)r$ Zndmin)rA r/ )r$ �count)rc ) r' rB rl rL r rM r$ r% rF �ravelr r r r\ r9 �max�zipZ __array__r] Z getmaskarray�_check_fill_value�item�arrayZonesr8 rW �chainr[ Zfromiter�list)rC rY rD r_ r` ZseqdtypeZseqtypeZsizesZ maxlengthr( ZseqdataZseqmaskrE �nZ nbmissingrb rc ZfvalZfmskr! r r r" r j s~ 1
� �
r c C s | fS r r )�base�
drop_namesr_ r` r r r" �_drop_fields_dispatcher� s r{ c sX t |�r|g}nt|�}� fdd�� � | j|�}tj| j|d�}t| |�}t|||d�S )a
Return a new array with fields in `drop_names` dropped.
Nested fields are supported.
.. versionchanged:: 1.18.0
`drop_fields` returns an array with 0 fields if all fields are dropped,
rather than returning ``None`` as it did previously.
Parameters
----------
base : array
Input array
drop_names : string or sequence
String or sequence of strings corresponding to the names of the
fields to drop.
usemask : {False, True}, optional
Whether to return a masked array or not.
asrecarray : string or sequence, optional
Whether to return a recarray or a mrecarray (`asrecarray=True`) or
a plain ndarray or masked array with flexible dtype. The default
is False.
Examples
--------
>>> from numpy.lib import recfunctions as rfn
>>> a = np.array([(1, (2, 3.0)), (4, (5, 6.0))],
... dtype=[('a', np.int64), ('b', [('ba', np.double), ('bb', np.int64)])])
>>> rfn.drop_fields(a, 'a')
array([((2., 3),), ((5., 6),)],
dtype=[('b', [('ba', '<f8'), ('bb', '<i8')])])
>>> rfn.drop_fields(a, 'ba')
array([(1, (3,)), (4, (6,))], dtype=[('a', '<i8'), ('b', [('bb', '<i8')])])
>>> rfn.drop_fields(a, ['ba', 'bb'])
array([(1,), (4,)], dtype=[('a', '<i8')])
c s` | j }g }|D ]L}| | }||v r$q|j d urL� ||�}|rZ|�||f� q|�||f� q|S r )r% r8 )r= rz r% r( r. r* r> �� _drop_descrr r" r} ! s
z drop_fields.<locals>._drop_descrr/ �r_ r` )r �setr$ rB �empty�shaper ra )ry rz r_ r` r( r! r r| r" r � s &
r c s: � fdd�|D �}t j� j|d�}t� |�}t|||d�S )a�
Return a new array keeping only the fields in `keep_names`,
and preserving the order of those fields.
Parameters
----------
base : array
Input array
keep_names : string or sequence
String or sequence of strings corresponding to the names of the
fields to keep. Order of the names will be preserved.
usemask : {False, True}, optional
Whether to return a masked array or not.
asrecarray : string or sequence, optional
Whether to return a recarray or a mrecarray (`asrecarray=True`) or
a plain ndarray or masked array with flexible dtype. The default
is False.
c s g | ]}|� j | f�qS r r/ �r- rx �ry r r" r5 J r1 z _keep_fields.<locals>.<listcomp>r/ r~ )rB r� r� r ra )ry Z
keep_namesr_ r` r( r! r r� r" � _keep_fields7 s
r� c C s | fS r r �ry rz r r r" �_rec_drop_fields_dispatcherP s r� c C s t | |ddd�S )zK
Returns a new numpy.recarray with fields in `drop_names` dropped.
FTr~ )r r� r r r" r T s r c C s | fS r r )ry �
namemapperr r r" �_rename_fields_dispatcher\ s r� c s" � fdd�� � | j |�}| �|�S )a�
Rename the fields from a flexible-datatype ndarray or recarray.
Nested fields are supported.
Parameters
----------
base : ndarray
Input array whose fields must be modified.
namemapper : dictionary
Dictionary mapping old field names to their new version.
Examples
--------
>>> from numpy.lib import recfunctions as rfn
>>> a = np.array([(1, (2, [3.0, 30.])), (4, (5, [6.0, 60.]))],
... dtype=[('a', int),('b', [('ba', float), ('bb', (float, 2))])])
>>> rfn.rename_fields(a, {'a':'A', 'bb':'BB'})
array([(1, (2., [ 3., 30.])), (4, (5., [ 6., 60.]))],
dtype=[('A', '<i8'), ('b', [('ba', '<f8'), ('BB', '<f8', (2,))])])
c sV g }| j D ]F}|�||�}| | }|j d urB|�|� ||�f� q
|�||f� q
|S r )r% rJ r8 )r= r� r( r. Znewnamer* ��_recursive_rename_fieldsr r" r� x s
�z/rename_fields.<locals>._recursive_rename_fields)r$ r\ )ry r� r( r r� r" r ` s r c c s | V |E d H d S r r )ry r% rb �dtypesrY r_ r` r r r" �_append_fields_dispatcher� s r� c C sP t |ttf�r,t|�t|�krBd}t|��nt |t�rB|g}|g}|du rndd� |D �}dd� t||�D �}n`t |ttf�s�|g}t|�t|�kr�t|�dkr�|t|� }n d}t|��dd� t|||�D �}t| ||d �} t|�dkr�t|d
||d �}n|�� }t j
t t| �t|��t | j
�t |j
� d �}t| |�}t||�}t|||d
�S )a
Add new fields to an existing array.
The names of the fields are given with the `names` arguments,
the corresponding values with the `data` arguments.
If a single field is appended, `names`, `data` and `dtypes` do not have
to be lists but just values.
Parameters
----------
base : array
Input array to extend.
names : string, sequence
String or sequence of strings corresponding to the names
of the new fields.
data : array or sequence of arrays
Array or sequence of arrays storing the fields to add to the base.
dtypes : sequence of datatypes, optional
Datatype or sequence of datatypes.
If None, the datatypes are estimated from the `data`.
fill_value : {float}, optional
Filling value used to pad missing data on the shorter arrays.
usemask : {False, True}, optional
Whether to return a masked array or not.
asrecarray : {False, True}, optional
Whether to return a recarray (MaskedRecords) or not.
z7The number of arrays does not match the number of namesNc S s g | ]}t j|d dd��qS )FT)�copy�subok)rB ru rn r r r" r5 � r1 z!append_fields.<locals>.<listcomp>c S s" g | ]\}}|� ||jfg��qS r )r\ r$ )r- r. rE r r r" r5 � r1 rA z5The dtypes argument must be None, a dtype, or a list.c S s0 g | ](\}}}t j|d d|d��||fg��qS )FT)r� r� r$ )rB ru r\ )r- rE rx �dr r r" r5 � s �)r_ rY T)rD r_ rY r/ r~ )rL r9 rw r' r& rT rr r �popr] �
masked_allrq r7 r$ r ra ) ry r% rb r� rY r_ r` �msgr! r r r" r � sB
� ��
r c c s | V |E d H d S r r �ry r% rb r� r r r" � _rec_append_fields_dispatcher� s r� c C s t | |||ddd�S )aM
Add new fields to an existing array.
The names of the fields are given with the `names` arguments,
the corresponding values with the `data` arguments.
If a single field is appended, `names`, `data` and `dtypes` do not have
to be lists but just values.
Parameters
----------
base : array
Input array to extend.
names : string, sequence
String or sequence of strings corresponding to the names
of the new fields.
data : array or sequence of arrays
Array or sequence of arrays storing the fields to add to the base.
dtypes : sequence of datatypes, optional
Datatype or sequence of datatypes.
If None, the datatypes are estimated from the `data`.
See Also
--------
append_fields
Returns
-------
appended_array : np.recarray
TF)rb r� r` r_ )r r� r r r" r � s
�r c C s | fS r r )rE �align�recurser r r" �_repack_fields_dispatcher� s r� c C s� t | tj�s*t| j||d�}| j|dd�S | jdu r8| S g }| jD ]T}| j| }|rht|d |dd�}n|d }t|�dkr�|d |f}|�||f� qBtj||d �}t�| j |f�S )
a
Re-pack the fields of a structured array or dtype in memory.
The memory layout of structured datatypes allows fields at arbitrary
byte offsets. This means the fields can be separated by padding bytes,
their offsets can be non-monotonically increasing, and they can overlap.
This method removes any overlaps and reorders the fields in memory so they
have increasing byte offsets, and adds or removes padding bytes depending
on the `align` option, which behaves like the `align` option to
`numpy.dtype`.
If `align=False`, this method produces a "packed" memory layout in which
each field starts at the byte the previous field ended, and any padding
bytes are removed.
If `align=True`, this methods produces an "aligned" memory layout in which
each field's offset is a multiple of its alignment, and the total itemsize
is a multiple of the largest alignment, by adding padding bytes as needed.
Parameters
----------
a : ndarray or dtype
array or dtype for which to repack the fields.
align : boolean
If true, use an "aligned" memory layout, otherwise use a "packed" layout.
recurse : boolean
If True, also repack nested structures.
Returns
-------
repacked : ndarray or dtype
Copy of `a` with fields repacked, or `a` itself if no repacking was
needed.
Examples
--------
>>> from numpy.lib import recfunctions as rfn
>>> def print_offsets(d):
... print("offsets:", [d.fields[name][1] for name in d.names])
... print("itemsize:", d.itemsize)
...
>>> dt = np.dtype('u1, <i8, <f8', align=True)
>>> dt
dtype({'names': ['f0', 'f1', 'f2'], 'formats': ['u1', '<i8', '<f8'], 'offsets': [0, 8, 16], 'itemsize': 24}, align=True)
>>> print_offsets(dt)
offsets: [0, 8, 16]
itemsize: 24
>>> packed_dt = rfn.repack_fields(dt)
>>> packed_dt
dtype([('f0', 'u1'), ('f1', '<i8'), ('f2', '<f8')])
>>> print_offsets(packed_dt)
offsets: [0, 1, 9]
itemsize: 17
)r� r� F)r� Nr T� r2 �r� )
rL rB r$ r �astyper% r, r' r8 rk )rE r� r� �dtZ fieldinfor. rZ �fmtr r r" r s <
r c
s� dd� }g }| j D ]�}| j| }|d |d }}||�\}}|j du rj|�t�||ff�||| f� qt||| �} |j�t|�D ]2� � dkr�|�| � q�|�� �fdd�| D �� q�q|S )z�
Returns a flat list of (dtype, count, offset) tuples of all the
scalar fields in the dtype "dt", including nested fields, in left
to right order.
c S s2 d}| j dkr*| j D ] }||9 }q| j} q| |fS )NrA r )r� ry )r� ro rm r r r" �
count_elem] s
z+_get_fields_and_offsets.<locals>.count_elemr rA Nc s$ g | ] \}}}|||� � f�qS r r )r- r� �c�o��irm r r" r5 v r1 z+_get_fields_and_offsets.<locals>.<listcomp>) r% r, r8 rB r$ �_get_fields_and_offsets�itemsize�ranger< )
r� �offsetr� r, r. r) Zf_dtZf_offsetrx Z subfieldsr r� r" r� T s
" r� c C s | fS r r )�arrr$ r� �castingr r r" �&_structured_to_unstructured_dispatcherz s r� �unsafec
s( | j jdu rtd��t| j �}t|�}|dkr@|du r@td��n|dkrPtd��t|� \}}}dd� t|�D �} |du r�tj dd� |D �� � n|� t� | ||| j j
d ��}
t � �&} | � t
d
� | �|
�} W d � n1 s�0 Y t� | � fd d�|D �d ��} | j| ||d
�} | �� t|�ff�S )a�
Converts an n-D structured array into an (n+1)-D unstructured array.
The new array will have a new last dimension equal in size to the
number of field-elements of the input array. If not supplied, the output
datatype is determined from the numpy type promotion rules applied to all
the field datatypes.
Nested fields, as well as each element of any subarray fields, all count
as a single field-elements.
Parameters
----------
arr : ndarray
Structured array or dtype to convert. Cannot contain object datatype.
dtype : dtype, optional
The dtype of the output unstructured array.
copy : bool, optional
See copy argument to `numpy.ndarray.astype`. If true, always return a
copy. If false, and `dtype` requirements are satisfied, a view is
returned.
casting : {'no', 'equiv', 'safe', 'same_kind', 'unsafe'}, optional
See casting argument of `numpy.ndarray.astype`. Controls what kind of
data casting may occur.
Returns
-------
unstructured : ndarray
Unstructured array with one more dimension.
Examples
--------
>>> from numpy.lib import recfunctions as rfn
>>> a = np.zeros(4, dtype=[('a', 'i4'), ('b', 'f4,u2'), ('c', 'f4', 2)])
>>> a
array([(0, (0., 0), [0., 0.]), (0, (0., 0), [0., 0.]),
(0, (0., 0), [0., 0.]), (0, (0., 0), [0., 0.])],
dtype=[('a', '<i4'), ('b', [('f0', '<f4'), ('f1', '<u2')]), ('c', '<f4', (2,))])
>>> rfn.structured_to_unstructured(a)
array([[0., 0., 0., 0., 0.],
[0., 0., 0., 0., 0.],
[0., 0., 0., 0., 0.],
[0., 0., 0., 0., 0.]])
>>> b = np.array([(1, 2, 5), (4, 5, 7), (7, 8 ,11), (10, 11, 12)],
... dtype=[('x', 'i4'), ('y', 'f4'), ('z', 'f8')])
>>> np.mean(rfn.structured_to_unstructured(b[['x', 'z']]), axis=-1)
array([ 3. , 5.5, 9. , 11. ])
N� arr must be a structured arrayr z(arr has no fields. Unable to guess dtypez#arr with no fields is not supportedc S s g | ]}d � |��qS �zf{}��formatr� r r r" r5 � r1 z.structured_to_unstructured.<locals>.<listcomp>c S s g | ]
}|j �qS r r� �r- r� r r r" r5 � r1 �r% �formats�offsetsr� zNumpy has detectedc s g | ]}� |j f�qS r )r� r� �� out_dtyper r" r5 � r1 �r% r� �r� r� )r$ r% r& r� r' �NotImplementedErrorrr r� rB Z result_typer� r �filter�
FutureWarningr\ r� �sum)
r� r$ r� r� r, �n_fields�dts�countsr� r% �flattened_fields�sup�
packed_fieldsr r� r" r ~ s4 5
� (�r c C s | fS r r )r� r$ r% r� r� r� r r r" �&_unstructured_to_structured_dispatcher� s r� c sh � j dkrtd��� j d }|dkr,td��|du r�|du rNdd� t|�D �}tj� fd d�|D �|d
�}t|�}t|� \} }
} nn|dur�td ��t|�}t|�dkr�g g g } }
} nt|� \} }
} |t |
�kr�td ��|}|r�|j
s�td
��dd� tt|��D �}t�|� fdd�| D �d��} t� � �� | �� t�|| | |j
d��}
� j|
||d�� � � |�d S )a
Converts an n-D unstructured array into an (n-1)-D structured array.
The last dimension of the input array is converted into a structure, with
number of field-elements equal to the size of the last dimension of the
input array. By default all output fields have the input array's dtype, but
an output structured dtype with an equal number of fields-elements can be
supplied instead.
Nested fields, as well as each element of any subarray fields, all count
towards the number of field-elements.
Parameters
----------
arr : ndarray
Unstructured array or dtype to convert.
dtype : dtype, optional
The structured dtype of the output array
names : list of strings, optional
If dtype is not supplied, this specifies the field names for the output
dtype, in order. The field dtypes will be the same as the input array.
align : boolean, optional
Whether to create an aligned memory layout.
copy : bool, optional
See copy argument to `numpy.ndarray.astype`. If true, always return a
copy. If false, and `dtype` requirements are satisfied, a view is
returned.
casting : {'no', 'equiv', 'safe', 'same_kind', 'unsafe'}, optional
See casting argument of `numpy.ndarray.astype`. Controls what kind of
data casting may occur.
Returns
-------
structured : ndarray
Structured array with fewer dimensions.
Examples
--------
>>> from numpy.lib import recfunctions as rfn
>>> dt = np.dtype([('a', 'i4'), ('b', 'f4,u2'), ('c', 'f4', 2)])
>>> a = np.arange(20).reshape((4,5))
>>> a
array([[ 0, 1, 2, 3, 4],
[ 5, 6, 7, 8, 9],
[10, 11, 12, 13, 14],
[15, 16, 17, 18, 19]])
>>> rfn.unstructured_to_structured(a, dt)
array([( 0, ( 1., 2), [ 3., 4.]), ( 5, ( 6., 7), [ 8., 9.]),
(10, (11., 12), [13., 14.]), (15, (16., 17), [18., 19.])],
dtype=[('a', '<i4'), ('b', [('f0', '<f4'), ('f1', '<u2')]), ('c', '<f4', (2,))])
r z$arr must have at least one dimensionrj r z&last axis with size 0 is not supportedNc S s g | ]}d � |��qS r� r� r� r r r" r5 r1 z.unstructured_to_structured.<locals>.<listcomp>c s g | ]}|� j f�qS r r/ r� �r� r r" r5 ! r1 r� z!don't supply both dtype and nameszVThe length of the last dimension of arr must be equal to the number of fields in dtypez'align was True but dtype is not alignedc S s g | ]}d � |��qS r� r� r� r r r" r5 5 r1 c s g | ]}� j |jf�qS r )r$ r� r� r� r r" r5 ; r1 r� r� r� ).r )r� r& r� r� rB r$ r� rr r' r� ZisalignedstructZascontiguousarrayr\ r� r� )r� r$ r% r� r� r� Zn_elemr� r, r� r� r� r� r� r r� r" r � sD 8
��r c C s |fS r r )�funcr� r r r" � _apply_along_fields_dispatcherH s r� c C s( |j jdu rtd��t|�}| |dd�S )a@
Apply function 'func' as a reduction across fields of a structured array.
This is similar to `apply_along_axis`, but treats the fields of a
structured array as an extra axis. The fields are all first cast to a
common type following the type-promotion rules from `numpy.result_type`
applied to the field's dtypes.
Parameters
----------
func : function
Function to apply on the "field" dimension. This function must
support an `axis` argument, like np.mean, np.sum, etc.
arr : ndarray
Structured array for which to apply func.
Returns
-------
out : ndarray
Result of the recution operation
Examples
--------
>>> from numpy.lib import recfunctions as rfn
>>> b = np.array([(1, 2, 5), (4, 5, 7), (7, 8 ,11), (10, 11, 12)],
... dtype=[('x', 'i4'), ('y', 'f4'), ('z', 'f8')])
>>> rfn.apply_along_fields(np.mean, b)
array([ 2.66666667, 5.33333333, 8.66666667, 11. ])
>>> rfn.apply_along_fields(np.mean, b[['x', 'z']])
array([ 3. , 5.5, 9. , 11. ])
Nr� rj )Zaxis)r$ r% r& r )r� r� Zuarrr r r" r
K s # r
c C s | |fS r r )�dst�src�zero_unassignedr r r" �!_assign_fields_by_name_dispatcherv s r� c C sX | j jdu r|| d< dS | j jD ]2}||j jvr>|rRd| |< q t| | || |� q dS )a�
Assigns values from one structured array to another by field name.
Normally in numpy >= 1.14, assignment of one structured array to another
copies fields "by position", meaning that the first field from the src is
copied to the first field of the dst, and so on, regardless of field name.
This function instead copies "by field name", such that fields in the dst
are assigned from the identically named field in the src. This applies
recursively for nested structures. This is how structure assignment worked
in numpy >= 1.6 to <= 1.13.
Parameters
----------
dst : ndarray
src : ndarray
The source and destination arrays during assignment.
zero_unassigned : bool, optional
If True, fields in the dst for which there was no matching
field in the src are filled with the value 0 (zero). This
was the behavior of numpy <= 1.13. If False, those fields
are not modified.
N.r )r$ r% r )r� r� r� r. r r r" r y s
�r c C s | fS r r )ru �required_dtyper r r" �_require_fields_dispatcher� s r� c C s t j| j|d�}t|| � |S )a�
Casts a structured array to a new dtype using assignment by field-name.
This function assigns from the old to the new array by name, so the
value of a field in the output array is the value of the field with the
same name in the source array. This has the effect of creating a new
ndarray containing only the fields "required" by the required_dtype.
If a field name in the required_dtype does not exist in the
input array, that field is created and set to 0 in the output array.
Parameters
----------
a : ndarray
array to cast
required_dtype : dtype
datatype for output array
Returns
-------
out : ndarray
array with the new dtype, with field values copied from the fields in
the input array with the same name
Examples
--------
>>> from numpy.lib import recfunctions as rfn
>>> a = np.ones(4, dtype=[('a', 'i4'), ('b', 'f8'), ('c', 'u1')])
>>> rfn.require_fields(a, [('b', 'f4'), ('c', 'u1')])
array([(1., 1), (1., 1), (1., 1), (1., 1)],
dtype=[('b', '<f4'), ('c', 'u1')])
>>> rfn.require_fields(a, [('b', 'f4'), ('newf', 'u1')])
array([(1., 0), (1., 0), (1., 0), (1., 0)],
dtype=[('b', '<f4'), ('newf', 'u1')])
r/ )rB r� r� r )ru r� �outr r r" r � s '
r c C s | S r r )�arraysre r_ r` � autoconvertr r r" �_stack_arrays_dispatcher� s r� c C s� t | t�r| S t| �dkr"| d S dd� | D �}dd� |D �}dd� |D �}dd� |D �}|d } t| �}
dd� |
D �} |dd � D ]~} t| �D ]p\}
}|
| vr�|
�|
|f� | �|
� q�| �|
�}|
| \}}|r�|
t||�f|
|< q�||kr�td
||f ��q�q�t|
�dk�r t� |�}n�t�
t � |�f|
�}t �
t jd|f �}g }t|||d d � |dd � �D ]n\}}}}|jj} | d u �r�||d t|� ||�< n4|D ].}|| || ||�< ||v�r�|�|� �q��qhtt||�||d
�S )a�
Superposes arrays fields by fields
Parameters
----------
arrays : array or sequence
Sequence of input arrays.
defaults : dictionary, optional
Dictionary mapping field names to the corresponding default values.
usemask : {True, False}, optional
Whether to return a MaskedArray (or MaskedRecords is
`asrecarray==True`) or a ndarray.
asrecarray : {False, True}, optional
Whether to return a recarray (or MaskedRecords if `usemask==True`)
or just a flexible-type ndarray.
autoconvert : {False, True}, optional
Whether automatically cast the type of the field to the maximum.
Examples
--------
>>> from numpy.lib import recfunctions as rfn
>>> x = np.array([1, 2,])
>>> rfn.stack_arrays(x) is x
True
>>> z = np.array([('A', 1), ('B', 2)], dtype=[('A', '|S3'), ('B', float)])
>>> zz = np.array([('a', 10., 100.), ('b', 20., 200.), ('c', 30., 300.)],
... dtype=[('A', '|S3'), ('B', np.double), ('C', np.double)])
>>> test = rfn.stack_arrays((z,zz))
>>> test
masked_array(data=[(b'A', 1.0, --), (b'B', 2.0, --), (b'a', 10.0, 100.0),
(b'b', 20.0, 200.0), (b'c', 30.0, 300.0)],
mask=[(False, False, True), (False, False, True),
(False, False, False), (False, False, False),
(False, False, False)],
fill_value=(b'N/A', 1.e+20, 1.e+20),
dtype=[('A', 'S3'), ('B', '<f8'), ('C', '<f8')])
rA r c S s g | ]}t �|��� �qS r )rB rl rp rn r r r" r5 r1 z stack_arrays.<locals>.<listcomp>c S s g | ] }t |��qS r r3 rn r r r" r5 r1 c S s g | ]
}|j �qS r r/ rn r r r" r5 r1 c S s g | ]
}|j �qS r r6 )r- r� r r r" r5 r1 c S s g | ] \}}|�qS r r )r- rx r� r r r" r5 r1 Nz Incompatible type '%s' <> '%s'rj zf%ir~ )rL r r' r7 r8 �indexrq � TypeErrorr] � concatenater� rB r� ZcumsumZr_rr r$ r% ra rh )r� re r_ r` r� rC Znrecordsr= ZfldnamesZdtype_lZnewdescrr% Zdtype_n�fname�fdtype�nameidxr@ �cdtyper! r� �seenrE rx r� �jr. r r r" r � sP )
�
*
�r c C s | fS r r )rE �key�
ignoremask� return_indexr r r" �_find_duplicates_dispatcher+ s r� c
C s� t �| ��� } t| j�}| }|r>|| D ] }|| }q(|| }|�� }|| }|�� } | dd� | dd� k}
|r�|j} d|
| dd� < t �dg|
f�}
|
dd� |
dd� |
dd�< | | |
} |r�| ||
fS | S dS )a�
Find the duplicates in a structured array along a given key
Parameters
----------
a : array-like
Input array
key : {string, None}, optional
Name of the fields along which to check the duplicates.
If None, the search is performed by records
ignoremask : {True, False}, optional
Whether masked data should be discarded or considered as duplicates.
return_index : {False, True}, optional
Whether to return the indices of the duplicated values.
Examples
--------
>>> from numpy.lib import recfunctions as rfn
>>> ndtype = [('a', int)]
>>> a = np.ma.array([1, 1, 1, 2, 2, 3, 3],
... mask=[0, 0, 1, 0, 0, 0, 1]).view(ndtype)
>>> rfn.find_duplicates(a, ignoremask=True, return_index=True)
(masked_array(data=[(1,), (1,), (2,), (2,)],
mask=[(False,), (False,), (False,), (False,)],
fill_value=(999999,),
dtype=[('a', '<i8')]), array([0, 1, 3, 4]))
Nrj rA F) rB rl rp r r$ �argsortr^ Z
recordmaskr� )
rE r� r� r� r, ry r4 ZsortidxZ
sortedbaseZ
sorteddata�flagZ
sortedmask�
duplicatesr r r" r
0 s(
r
c C s ||fS r r ) r� �r1�r2�jointype� r1postfix� r2postfixre r_ r` r r r" �_join_by_dispatcherj s r� �inner�1�2c - s� |dvrt d| ��t� t�r$� f� tt� ��t� �kr^t� fdd�t� �D ��} t d| ��� D ]4}
|
|jjvr~t d|
��|
|jjvrbt d|
��qb|� � }|� � }t|�} |jj|jj } }
t| �t|
�@ t� � }|r�|s�|s�d}|d 7 }t |��� fd
d �| D �}t
||�}t
||�}t � ||f�}|j
� d �}|| }t � d
g|dd� |dd� kf�}|dd� |dd� |dd�< || }||| k }||| k | }t|�t|� }}|dk�r�d\}} n�|dk�r0|| } t� || | | k f�}t� || | | k | f�}t|�| t|�| }} n<|dk�rl|| } t� || | | k f�}t|�| d }} || || } } t|j�} t|j�D ]"\}!}"|!� v�r�| �|!|"f� �q�t|j�D ]�\}!}"tdd� | D ��}#z|#�|!�}$W n" t �y
| �|!|"f� Y nP0 | |$ \}%}&|!� v �r6|!t|"|&�f| |$< n$|!| |&f|!| |"fg| |$|$d �< �q�t�| �} t||�}'t j|'| | f| d�}(|(jj}#| D ]x})| |) }*|)|#v�s�|)|
v �r�|�s�|)� v�r�|)|7 })|(|) }+|*d|� |+d|�< |dv �r�|*|d� |+|'|'| �< �q�|
D ]|})| |) }*|)|#v�sD|)| v �rL|�sL|)� v�rL|)|7 })|(|) }+|*d|� |+d|�< |dk�r| �r|*|d� |+| d�< �q|(j� d � t||d�},tt|(|�fi |,��S )a<
Join arrays `r1` and `r2` on key `key`.
The key should be either a string or a sequence of string corresponding
to the fields used to join the array. An exception is raised if the
`key` field cannot be found in the two input arrays. Neither `r1` nor
`r2` should have any duplicates along `key`: the presence of duplicates
will make the output quite unreliable. Note that duplicates are not
looked for by the algorithm.
Parameters
----------
key : {string, sequence}
A string or a sequence of strings corresponding to the fields used
for comparison.
r1, r2 : arrays
Structured arrays.
jointype : {'inner', 'outer', 'leftouter'}, optional
If 'inner', returns the elements common to both r1 and r2.
If 'outer', returns the common elements as well as the elements of
r1 not in r2 and the elements of not in r2.
If 'leftouter', returns the common elements and the elements of r1
not in r2.
r1postfix : string, optional
String appended to the names of the fields of r1 that are present
in r2 but absent of the key.
r2postfix : string, optional
String appended to the names of the fields of r2 that are present
in r1 but absent of the key.
defaults : {dictionary}, optional
Dictionary mapping field names to the corresponding default values.
usemask : {True, False}, optional
Whether to return a MaskedArray (or MaskedRecords is
`asrecarray==True`) or a ndarray.
asrecarray : {False, True}, optional
Whether to return a recarray (or MaskedRecords if `usemask==True`)
or just a flexible-type ndarray.
Notes
-----
* The output is sorted along the key.
* A temporary array is formed by dropping the fields not in the key for
the two arrays and concatenating the result. This array is then
sorted, and the common entries selected. The output is constructed by
filling the fields with the selected entries. Matching is not
preserved if there are some duplicates...
)r� �outer� leftouterzWThe 'jointype' argument should be in 'inner', 'outer' or 'leftouter' (got '%s' instead)c 3 s* | ]"\}}|� |d d� v r|V qdS )rA Nr )r- rx �x�r� r r" r0 � r1 zjoin_by.<locals>.<genexpr>zduplicate join key %rz r1 does not have key field %rz r2 does not have key field %rz8r1 and r2 contain common names, r1postfix and r2postfix zcan't both be emptyc s g | ]}|� v r|�qS r r r� r� r r" r5 � r1 zjoin_by.<locals>.<listcomp>)�orderFrA Nrj r� )r r r� r� r c s s | ]\}}|V qd S r r )r- r. r$ r r r" r0 � r1 r/ )r� r� r~ )r& rL rT r' r �next� enumerater$ r% rp r� r] r� r� rB r7 r8 rw r� rq r� �sort�dictra rh )-r� r� r� r� r� r� re r_ r` �dupr. Znb1Zr1namesZr2namesZ
collisionsr� Zkey1Zr1kZr2kZauxZidx_sortZflag_inZidx_inZidx_1Zidx_2Zr1cmnZr2cmnZr1spcZr2spcZidx_out�s1�s2r= r� r� r% r� r@ r� Zcmnr! r4 Zselectedr* �kwargsr r� r" r p s� 4��
$
�
$
$ r c C s ||fS r r )r� r� r� r� r� r� re r r r" �_rec_join_dispatcher$ s r� c C s( t ||||ddd�}t| ||fi |��S )z�
Join arrays `r1` and `r2` on keys.
Alternative to join_by, that always returns a np.recarray.
See Also
--------
join_by : equivalent function
FT)r� r� r� re r_ r` )r� r )r� r� r� r� r� r� re r� r r r" r * s �r )F)F)NN)NT)TF)N)NNNN)rj FFF)NN)TF)TF)NNNN)Nrj TF)N)N)NN)FF)r )NNN)NFr� )NNNNN)NNFFr� )N)T)NNNN)NTFF)NNN)NTF)NNNNNN)r� r� r� NTF)NNNN)r� r� r� N)D�__doc__rW ZnumpyrB Znumpy.mar] r r r Znumpy.ma.mrecordsr Znumpy.core.overridesr Znumpy.lib._iotoolsr Z
numpy.testingr Zcorers �__all__r# r r7 r r r rF rH r rN rU r[ ra rh ri r r{ r r� r� r r� r r� r r� r r� r r� r� r r� r r� r
r� r r� r r� r r� r
r� r r� r r r r r" �<module> s�
&
/
�
�
@
' �
� F
"
R
& �
\ �
� h
*
%
+ �
� X �
: �
� 5 �
�
Mini Shell