Module parse 

Parser implementations for converting strings to Arrow types

Used by the CSV and JSON readers to convert strings to Arrow types

Macros

parser_primitive 🔒

Structs

DecimalAccumulator 🔒

Accumulates decimal digits into chunk, folding it into value whenever it reaches MAX_CHUNK_DIGITS digits

Interval 🔒

IntervalAmount 🔒

IntervalParseConfig

Config to parse interval strings

TimestampParser 🔒

Helper for parsing RFC3339 timestamps

Enums

DecimalParseError 🔒

The reason a decimal string could not be parsed.

IntervalUnit

Represents the units of an interval, with each variant corresponding to a bit in the interval’s bitfield representation

MantissaError 🔒

Why scanning the digits of a decimal string stopped.

Constants

EPOCH_DAYS_FROM_CE 🔒

Number of days between 0001-01-01 and 1970-01-01

ERR_NANOSECONDS_NOT_SUPPORTED 🔒

Error message if nanosecond conversion request beyond supported interval

INTERVAL_PRECISION 🔒

Chosen based on the number of decimal digits in 1 week in nanoseconds

MAX_CHUNK_DIGITS 🔒

The maximum number of decimal digits accumulated in a u64 before the chunk is folded into the native value: every 18-digit number fits in a u64, and splits into two halves that each fit in a u32 (see decimal_chunk_to_native).

NANOS_PER_HOUR 🔒

NANOS_PER_MILLIS 🔒

NANOS_PER_MINUTE 🔒

NANOS_PER_SECOND 🔒

Traits

Parser

Specialized parsing implementations to convert strings to Arrow types.

Functions

decimal_chunk_to_native 🔒

Converts a chunk of at most MAX_CHUNK_DIGITS digits to the native type, negated if negative.

decimal_pow 🔒

Returns 10^exp as a T::Native, or an overflow error if the result does not fit in the native type.

fold_decimal_chunk 🔒

Folds a chunk of up to MAX_CHUNK_DIGITS digits into value, producing value * 10^chunk_len + chunk (chunk is negated first when parsing a negative number).

not_interval_amount 🔒

test if a character is NOT part of an interval numeric amount

parse_date 🔒

parse_date_to_days 🔒

Parse a date string into days since 1970-01-01, covering the full Date32 range (years ≈ ±5,881,580) for the signed extended-year form.

parse_decimal

Parses the string representation of a decimal number into the unscaled native value of a decimal type with the given precision and scale.

parse_decimal_checked 🔒

Like parse_decimal, but reports failures as a DecimalParseError instead of formatting an error message, for callers that discard or re-wrap the error.

parse_decimal_exponent 🔒

Parses the digits of an exponent ([+|-] digits), saturating at the bounds of i64; any exponent that large scales every non-zero mantissa out of range of every decimal type.

parse_decimal_mantissa 🔒

Scans mantissa (digits with at most one decimal point; the sign has already been removed) and folds the digits that are significant at scale into a native value, rounding half away from zero on the first digit that is not. Also returns an upper bound on the number of decimal digits of the value: the digits kept, the zeros appended to reach the scale, and the digit that rounding up can add.

parse_decimal_native 🔒

Parses s as a decimal with the given scale into the native type of T, checking only that the result fits the native type (not the precision), and returns it with an upper bound on its number of decimal digits.

parse_extended_ymd 🔒

Parse the ISO 8601 signed extended-year form (±YYYY[Y...]-MM-DD) into raw (year, month, day) components, without validating the calendar date.

parse_interval_components 🔒

parse the string into a vector of interval components i.e. (amount, unit) tuples

parse_interval_day_time

Parse human-readable interval string to Arrow [IntervalDayTimeType]

parse_interval_month_day_nano

Parse human-readable interval string to Arrow [IntervalMonthDayNanoType]

parse_interval_month_day_nano_config

Parse human-readable interval string to Arrow [IntervalMonthDayNanoType]

parse_interval_year_month

Parse human-readable interval string to Arrow [IntervalYearMonthType]

parse_nanos 🔒

Parse nanoseconds from the first N values in digits, subtracting the offset O

split_interval_components 🔒

Split an interval into a vec of amounts and units.

split_sign 🔒

Splits an optional leading sign from bytes, returning whether it is - and the bytes that follow it.

string_to_datetime

Accepts a string and parses it relative to the provided timezone

string_to_time 🔒

string_to_time_nanoseconds

Accepts a string in ISO8601 standard format and some variants and converts it to nanoseconds since midnight.

string_to_timestamp_nanos

Accepts a string in RFC3339 / ISO8601 standard format and some variants and converts it to a nanosecond precision timestamp.

to_timestamp_nanos 🔒

Fallible conversion of NaiveDateTime to i64 nanoseconds

trim_pre_and_post_whitespace 🔒

this is a no-op if the string starts and ends with a digit, otherwise it will trim whitespace from the start and end of the string.

Type Aliases

MonthDayNano

A tuple representing (months, days, nanoseconds) in an interval