package pqarrow
Import Path
github.com/polarsignals/frostdb/pqarrow (on go.dev)
Dependency Relation
imports 18 packages, and imported by 3 packages
Package-Level Type Names (total 3)
func ColToWriter(col int, writers []MultiColumnWriter) writer.ValueWriter
ParquetConverter converts parquet.RowGroups into arrow.Records. The converted
results are accumulated in the converter and can be retrieved by calling
NewRecord, at which point the converter is reset.
(*ParquetConverter) Close()
(*ParquetConverter) Convert(ctx context.Context, rg parquet.RowGroup, s *dynparquet.Schema) error
(*ParquetConverter) Fields() []builder.ColumnBuilder
(*ParquetConverter) NewRecord() arrow.Record
(*ParquetConverter) NumRows() int
(*ParquetConverter) Reset()
func NewParquetConverter(pool memory.Allocator, iterOpts logicalplan.IterOptions) *ParquetConverter
( PreExprVisitorFunc) PostVisit(_ logicalplan.Expr) bool
( PreExprVisitorFunc) PreVisit(expr logicalplan.Expr) bool
( PreExprVisitorFunc) Visit(_ logicalplan.Expr) bool
PreExprVisitorFunc : github.com/polarsignals/frostdb/query/logicalplan.Visitor
Package-Level Functions (total 13)
func ColToWriter(col int, writers []MultiColumnWriter) writer.ValueWriter func NewParquetConverter(pool memory.Allocator, iterOpts logicalplan.IterOptions) *ParquetConverter
ParquetRowGroupToArrowSchema converts a parquet row group to an arrow schema.
func ParquetSchemaToArrowSchema(ctx context.Context, schema *parquet.Schema, s *dynparquet.Schema, options logicalplan.IterOptions) (*arrow.Schema, error)
Project will project the record according to the given projections.
func RecordDynamicCols(record arrow.Record) (columns map[string][]string) func RecordsToFile(schema *dynparquet.Schema, w dynparquet.ParquetWriter, recs []arrow.Record) error func RecordToDynamicRow(pqSchema *parquet.Schema, record arrow.Record, dyncols map[string][]string, index int) (*dynparquet.DynamicRow, error) func RecordToFile(schema *dynparquet.Schema, w dynparquet.ParquetWriter, r arrow.Record) error
RecordToRow converts an arrow record with dynamic columns into a row using a dynamic parquet schema.
func SerializeRecord(r arrow.Record, schema *dynparquet.Schema) (*dynparquet.SerializedBuffer, error)
SingleMatchingColumn returns true if there is only a single matching column for the given column matchers.
![]() |
The pages are generated with Golds v0.8.2. (GOOS=linux GOARCH=amd64) Golds is a Go 101 project developed by Tapir Liu. PR and bug reports are welcome and can be submitted to the issue list. Please follow @zigo_101 (reachable from the left QR code) to get the latest news of Golds. |