com.netflix.iceberg.types

Class TypeUtil

java.lang.Object

com.netflix.iceberg.types.TypeUtil

public class TypeUtil
extends java.lang.Object

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	TypeUtil.CustomOrderSchemaVisitor<T>
static interface	TypeUtil.NextID Interface for passing a function that assigns column IDs.
static class	TypeUtil.SchemaVisitor<T>

Constructor Summary

Constructors

Constructor and Description
TypeUtil()

Method Summary

Modifier and Type	Method and Description
static Schema	assignFreshIds(Schema schema, TypeUtil.NextID nextId) Assigns fresh ids from the nextId function for all fields in a schema.
static Type	assignFreshIds(Type type, TypeUtil.NextID nextId) Assigns fresh ids from the nextId function for all fields in a type.
static int	decimalRequriedBytes(int precision)
static Type	find(Schema schema, java.util.function.Predicate<Type> predicate)
static java.util.Set<java.lang.Integer>	getProjectedIds(Schema schema)
static java.util.Set<java.lang.Integer>	getProjectedIds(Type schema)
static java.util.Map<java.lang.Integer,Types.NestedField>	indexById(Types.StructType struct)
static java.util.Map<java.lang.String,java.lang.Integer>	indexByName(Types.StructType struct)
static boolean	isPromotionAllowed(Type from, Type.PrimitiveType to)
static Schema	join(Schema left, Schema right)
static Schema	reassignIds(Schema schema, Schema idSourceSchema) Reassigns ids in a schema from another schema.
static Schema	select(Schema schema, java.util.Set<java.lang.Integer> fieldIds)
static Schema	selectNot(Schema schema, java.util.Set<java.lang.Integer> fieldIds)
static <T> T	visit(Schema schema, TypeUtil.CustomOrderSchemaVisitor<T> visitor)
static <T> T	visit(Schema schema, TypeUtil.SchemaVisitor<T> visitor)
static <T> T	visit(Type type, TypeUtil.CustomOrderSchemaVisitor<T> visitor) Used to traverse types with traversals other than pre-order.
static <T> T	visit(Type type, TypeUtil.SchemaVisitor<T> visitor)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TypeUtil

public TypeUtil()

Method Detail

select

public static Schema select(Schema schema,
                            java.util.Set<java.lang.Integer> fieldIds)

getProjectedIds

public static java.util.Set<java.lang.Integer> getProjectedIds(Schema schema)

getProjectedIds

public static java.util.Set<java.lang.Integer> getProjectedIds(Type schema)

selectNot

public static Schema selectNot(Schema schema,
                               java.util.Set<java.lang.Integer> fieldIds)

join

public static Schema join(Schema left,
                          Schema right)

indexByName

public static java.util.Map<java.lang.String,java.lang.Integer> indexByName(Types.StructType struct)

indexById

public static java.util.Map<java.lang.Integer,Types.NestedField> indexById(Types.StructType struct)

assignFreshIds

public static Type assignFreshIds(Type type,
                                  TypeUtil.NextID nextId)

Assigns fresh ids from the nextId function for all fields in a type.

Parameters:

type - a type

nextId - an id assignment function

Returns:

an structurally identical type with new ids assigned by the nextId function

assignFreshIds

public static Schema assignFreshIds(Schema schema,
                                    TypeUtil.NextID nextId)

Assigns fresh ids from the nextId function for all fields in a schema.

Parameters:

schema - a schema

nextId - an id assignment function

Returns:

an structurally identical schema with new ids assigned by the nextId function

reassignIds

public static Schema reassignIds(Schema schema,
                                 Schema idSourceSchema)

Reassigns ids in a schema from another schema.

Ids are determined by field names. If a field in the schema cannot be found in the source schema, this will throw IllegalArgumentException.

This will not alter a schema's structure, nullability, or types.

Parameters:

schema - the schema to have ids reassigned

idSourceSchema - the schema from which field ids will be used

Returns:

an structurally identical schema with field ids matching the source schema

Throws:

java.lang.IllegalArgumentException - if a field cannot be found (by name) in the source schema

find

public static Type find(Schema schema,
                        java.util.function.Predicate<Type> predicate)

isPromotionAllowed

public static boolean isPromotionAllowed(Type from,
                                         Type.PrimitiveType to)

visit

public static <T> T visit(Schema schema,
                          TypeUtil.SchemaVisitor<T> visitor)

visit

public static <T> T visit(Type type,
                          TypeUtil.SchemaVisitor<T> visitor)

visit

public static <T> T visit(Schema schema,
                          TypeUtil.CustomOrderSchemaVisitor<T> visitor)

visit

public static <T> T visit(Type type,
                          TypeUtil.CustomOrderSchemaVisitor<T> visitor)

Used to traverse types with traversals other than pre-order.

This passes a Supplier to each visitor method that returns the result of traversing child types. Structs are passed an Iterable that traverses child fields during iteration.

An example use is assigning column IDs, which should be done with a post-order traversal.

Type Parameters:

T - the type returned by the visitor

Parameters:

type - a type to traverse with a visitor

visitor - a custom order visitor

Returns:

the result of traversing the given type with the visitor

decimalRequriedBytes

public static int decimalRequriedBytes(int precision)