Crandore Hub

summarisebig

Grouped Summaries for Large 'arrow' Datasets

Provides a 'dplyr'-like interface for grouped summaries on large 'arrow' datasets. Complete summaries are attempted in 'arrow' first. When a result can be reconstructed from 'arrow'-computable sufficient statistics, an explicit MapReduce-style reduction and 'R' finalization strategy is available. For arbitrary 'R' functions that require raw group observations, complete groups are materialized in bounded chunks, with optional parallel execution and shared-memory processing. The MapReduce strategy follows the programming model described by Dean and Ghemawat (2008) <doi:10.1145/1327452.1327492>.

Versions across snapshots

VersionRepositoryFileSize
0.1.0 rolling linux/jammy R-4.5 summarisebig_0.1.0.tar.gz 46.2 KiB
0.1.0 rolling linux/noble R-4.5 summarisebig_0.1.0.tar.gz 46.1 KiB
0.1.0 rolling source/ R- summarisebig_0.1.0.tar.gz 30.0 KiB
0.1.0 latest linux/jammy R-4.5 summarisebig_0.1.0.tar.gz 46.2 KiB
0.1.0 latest linux/noble R-4.5 summarisebig_0.1.0.tar.gz 46.1 KiB
0.1.0 latest source/ R- summarisebig_0.1.0.tar.gz 30.0 KiB
0.1.0 2026-04-23 source/ R- summarisebig_0.1.0.tar.gz 0 B

Dependencies (latest)

Imports

Suggests