Greenplum Database -> Spark Data Type Mapping
When you load Greenplum data into Spark, the Greenplum-Spark Connector maps Greenplum Database data types to Spark data types for you.
For additional information on Greenplum Database or Spark data types, refer to:
Supported Data Types
The mapping between supported Greenplum Database column types and Spark data types is identified in the table below:
Greenplum Column Type | Spark Type |
---|---|
bigint | LongType |
bigSerial | LongType |
boolean | BooleanType |
char | StringType |
date | DateType |
decimal | DecimalType |
float | DoubleType |
int | IntegerType |
real | FloatType |
serial | IntegerType |
smallInt | ShortType |
text | StringType |
time | TimeStampType |
timestamp | TimeStampType |
timestamptz | TimeStampType |
timetz | TimeStampType |
varchar | StringType |
The Greenplum-Spark Connector does not support complex types, nor does it support any data type not listed in the table above.