Skip to content

chunking module

Extensions for chunking of base operations.

array_gl_slicer ArraySlicer

2-dim array slicer along the column axis based on group lengths.

flex_1d_array_gl_slicer FlexArraySlicer

Flexible 1-dim array slicer along the column axis based on group lengths.

flex_array_gl_slicer FlexArraySlicer

Flexible 2-dim array slicer along the column axis based on group lengths.

group_idxs_mapper GroupIdxsMapper

Default instance of GroupIdxsMapper.

group_lens_mapper GroupLensMapper

Default instance of GroupLensMapper.

shape_gl_slicer ShapeSlicer

Flexible 2-dim shape slicer along the column axis based on group lengths.

get_group_lens_slice function

get_group_lens_slice(
    group_lens,
    chunk_meta
)

Get slice of each chunk in group lengths.

ChunkedFlexArray class

ChunkedFlexArray(
    *args,
    **kwargs
)

Class representing a chunkable flexible array.

Superclasses

Inherited members

ChunkedGroupLens class

ChunkedGroupLens(
    *args,
    **kwargs
)

Class representing chunkable group lengths.

Superclasses

Inherited members

ChunkedGroupMap class

ChunkedGroupMap(
    *args,
    **kwargs
)

Class representing a chunkable group map.

Superclasses

Inherited members

FlexArraySelector class

FlexArraySelector(
    single_type=None,
    ignore_none=True,
    mapper=None,
    keep_dims=False,
    axis=None
)

Class for selecting one element from a NumPy array's axis flexibly based on the chunk index.

The result is intended to be used together with flex_select_1d_nb() and flex_select_nb().

Method generated by attrs for class FlexArraySelector.

Superclasses

Inherited members

FlexArraySizer class

FlexArraySizer(
    arg_query=None,
    single_type=None,
    axis=None
)

Class for getting the size from the length of an axis in a flexible array.

Method generated by attrs for class ShapeSizer.

Superclasses

Inherited members

FlexArraySlicer class

FlexArraySlicer(
    single_type=None,
    ignore_none=True,
    mapper=None,
    axis=None
)

Class for selecting one element from a NumPy array's axis flexibly based on the chunk index.

The result is intended to be used together with flex_select_1d_nb() and flex_select_nb().

Method generated by attrs for class FlexArraySlicer.

Superclasses

Inherited members

GroupIdxsMapper class

GroupIdxsMapper(
    should_cache=True,
    chunk_meta_cache=NOTHING,
    arg_query=None
)

Class for mapping chunk metadata to per-group column indices.

Argument must be a group map tuple.

Method generated by attrs for class GroupIdxsMapper.

Superclasses

Inherited members

GroupLensMapper class

GroupLensMapper(
    should_cache=True,
    chunk_meta_cache=NOTHING,
    arg_query=None
)

Class for mapping chunk metadata to per-group column lengths.

Argument can be either a group map tuple or a group lengths array.

Method generated by attrs for class GroupLensMapper.

Superclasses

Inherited members

GroupLensSizer class

GroupLensSizer(
    arg_query=None,
    single_type=None
)

Class for getting the size from group lengths.

Argument can be either a group map tuple or a group lengths array.

Method generated by attrs for class ArgSizer.

Superclasses

Inherited members

get_obj_size class method

GroupLensSizer.get_obj_size(
    obj,
    single_type=None
)

Get size of an object.

GroupLensSlicer class

GroupLensSlicer(
    single_type=None,
    ignore_none=True,
    mapper=None
)

Class for slicing multiple elements from group lengths based on the chunk range.

Method generated by attrs for class ChunkTaker.

Superclasses

Inherited members

GroupMapSlicer class

GroupMapSlicer(
    single_type=None,
    ignore_none=True,
    mapper=None
)

Class for slicing multiple elements from a group map based on the chunk range.

Method generated by attrs for class ChunkTaker.

Superclasses

Inherited members