| Package | Description |
|---|---|
| org.apache.carbondata.sdk.file |
| Modifier and Type | Method and Description |
|---|---|
Schema |
Schema.asOriginOrder()
Sort the schema order as original order
|
static Schema |
AvroCarbonWriter.getCarbonSchemaFromAvroSchema(org.apache.avro.Schema avroSchema)
converts avro schema to carbon schema required by carbonWriter
|
static Schema |
Schema.parseJson(String json)
Create a Schema using JSON string, for example:
[
{"name":"string"},
{"age":"int"}
]
|
static Schema |
CarbonSchemaReader.readSchema(String path)
read schema from path,
path can be folder path, carbonindex file path, and carbondata file path
and will not check all files schema
|
static Schema |
CarbonSchemaReader.readSchema(String path,
boolean validateSchema)
read schema from path,
path can be folder path, carbonindex file path, and carbondata file path
and user can decide whether check all files schema
|
static Schema |
CarbonSchemaReader.readSchema(String path,
boolean validateSchema,
org.apache.hadoop.conf.Configuration conf)
read schema from path,
path can be folder path, carbonindex file path, and carbondata file path
and user can decide whether check all files schema
|
static Schema |
CarbonSchemaReader.readSchema(String path,
org.apache.hadoop.conf.Configuration conf)
read schema from path,
path can be folder path, carbonindex file path, and carbondata file path
and will not check all files schema
|
static Schema |
CarbonSchemaReader.readSchemaInDataFile(String dataFilePath)
Deprecated.
|
static Schema |
CarbonSchemaReader.readSchemaInIndexFile(String indexFilePath)
Deprecated.
|
static Schema |
CarbonSchemaReader.readSchemaInSchemaFile(String schemaFilePath)
Deprecated.
|
| Modifier and Type | Method and Description |
|---|---|
org.apache.carbondata.processing.loading.model.CarbonLoadModel |
CarbonWriterBuilder.buildLoadModel(Schema carbonSchema) |
CarbonWriterBuilder |
CarbonWriterBuilder.withCsvInput(Schema schema)
to build a
CarbonWriter, which accepts row in CSV format |
CarbonWriterBuilder |
CarbonWriterBuilder.withJsonInput(Schema carbonSchema)
to build a
CarbonWriter, which accepts Json object |
static void |
TestUtil.writeFilesAndVerify(int rows,
Schema schema,
String path)
write file and verify
|
static void |
TestUtil.writeFilesAndVerify(int rows,
Schema schema,
String path,
String[] sortColumns,
int blockletSize,
int blockSize)
Invoke CarbonWriter API to write carbon files and assert the file is rewritten
|
static void |
TestUtil.writeFilesAndVerify(Schema schema,
String path) |
Copyright © 2016–2019 The Apache Software Foundation. All rights reserved.