Module parse 

Parser implementations for converting strings to Arrow types

Used by the CSV and JSON readers to convert strings to Arrow types

Macros

parser_primitive 🔒

Structs

DecimalAccumulator 🔒

Accumulates decimal digits into chunk, folding it into value whenever it reaches MAX_CHUNK_DIGITS digits

Interval 🔒

IntervalAmount 🔒

IntervalParseConfig

Config to parse interval strings

TimestampParser 🔒

Helper for parsing RFC3339 timestamps

Enums

DecimalParseError 🔒

The reason a decimal string could not be parsed.

IntervalUnit

Represents the units of an interval, with each variant corresponding to a bit in the interval’s bitfield representation

MantissaError 🔒

Why scanning the digits of a decimal string stopped.

Constants

EPOCH_DAYS_FROM_CE 🔒

Number of days between 0001-01-01 and 1970-01-01

ERR_NANOSECONDS_NOT_SUPPORTED 🔒

Error message if nanosecond conversion request beyond supported interval

INTERVAL_PRECISION 🔒

Chosen based on the number of decimal digits in 1 week in nanoseconds

MAX_CHUNK_DIGITS 🔒

The maximum number of decimal digits accumulated in a u64 before the chunk is folded into the native value: every 18-digit number fits in a u64, and splits into two halves that each fit in a u32 (see decimal_chunk_to_native).

NANOS_PER_HOUR 🔒

NANOS_PER_MILLIS 🔒

NANOS_PER_MINUTE 🔒

NANOS_PER_SECOND 🔒

Traits

Parser

Specialized parsing implementations to convert strings to Arrow types.

Functions

decimal_chunk_to_native 🔒

Converts a chunk of at most MAX_CHUNK_DIGITS digits to the native type, negated if negative.

decimal_pow 🔒

Returns 10^exp as a T::Native, or an overflow error if the result does not fit in the native type.

fold_decimal_chunk 🔒

Folds a chunk of up to MAX_CHUNK_DIGITS digits into value, producing value * 10^chunk_len + chunk (chunk is negated first when parsing a negative number).

not_interval_amount 🔒

test if a character is NOT part of an interval numeric amount

parse_date 🔒

parse_date_to_days 🔒

Parse a date string into days since 1970-01-01, covering the full Date32 range (years ≈ ±5,881,580) for the signed extended-year form.

parse_decimal

Parses the string representation of a decimal number into the unscaled native value of a decimal type with the given precision and scale.

parse_decimal_checked 🔒

Like parse_decimal, but reports failures as a DecimalParseError instead of formatting an error message, for callers that discard or re-wrap the error.

parse_decimal_exponent 🔒

Parses the digits of an exponent ([+|-] digits), saturating at the bounds of i64; any exponent that large scales every non-zero mantissa out of range of every decimal type.

parse_decimal_mantissa 🔒

Scans mantissa (digits with at most one decimal point; the sign has already been removed) and folds the digits that are significant at scale into a native value, rounding half away from zero on the first digit that is not.

parse_decimal_native 🔒

Parses s as a decimal with the given scale into the native type of T, checking only that the result fits the native type (not the precision).

parse_extended_ymd 🔒

Parse the ISO 8601 signed extended-year form (±YYYY[Y...]-MM-DD) into raw (year, month, day) components, without validating the calendar date.

parse_interval_components 🔒

parse the string into a vector of interval components i.e. (amount, unit) tuples

parse_interval_day_time

Parse human-readable interval string to Arrow [IntervalDayTimeType]

parse_interval_month_day_nano

Parse human-readable interval string to Arrow [IntervalMonthDayNanoType]

parse_interval_month_day_nano_config

Parse human-readable interval string to Arrow [IntervalMonthDayNanoType]

parse_interval_year_month

Parse human-readable interval string to Arrow [IntervalYearMonthType]

parse_nanos 🔒

Parse nanoseconds from the first N values in digits, subtracting the offset O

split_interval_components 🔒

Split an interval into a vec of amounts and units.

split_sign 🔒

Splits an optional leading sign from bytes, returning whether it is - and the bytes that follow it.

string_to_datetime

Accepts a string and parses it relative to the provided timezone

string_to_time 🔒

string_to_time_nanoseconds

Accepts a string in ISO8601 standard format and some variants and converts it to nanoseconds since midnight.

string_to_timestamp_nanos

Accepts a string in RFC3339 / ISO8601 standard format and some variants and converts it to a nanosecond precision timestamp.

to_timestamp_nanos 🔒

Fallible conversion of NaiveDateTime to i64 nanoseconds

trim_pre_and_post_whitespace 🔒

this is a no-op if the string starts and ends with a digit, otherwise it will trim whitespace from the start and end of the string.

Type Aliases

MonthDayNano

A tuple representing (months, days, nanoseconds) in an interval