A C F G I L N O P R S U W

A

appendBatchData(CarbonIterator<Object[]>, TaskAttemptContext, CarbonLoadModel) - Static method in class org.apache.carbondata.streaming.segment.StreamSegment

invoke CarbonStreamOutputFormat to append batch data to existing carbondata file

C

CARBON_ENCODER_ROW_BUFFER_SIZE - Static variable in class org.apache.carbondata.streaming.CarbonStreamOutputFormat

CARBON_ENCODER_ROW_BUFFER_SIZE_DEFAULT - Static variable in class org.apache.carbondata.streaming.CarbonStreamOutputFormat

CARBON_STREAM_BLOCKLET_ROW_NUMS - Static variable in class org.apache.carbondata.streaming.CarbonStreamOutputFormat

CARBON_STREAM_BLOCKLET_ROW_NUMS_DEFAULT - Static variable in class org.apache.carbondata.streaming.CarbonStreamOutputFormat

CARBON_STREAM_CACHE_SIZE - Static variable in class org.apache.carbondata.streaming.CarbonStreamOutputFormat

CARBON_STREAM_CACHE_SIZE_DEFAULT - Static variable in class org.apache.carbondata.streaming.CarbonStreamOutputFormat

CARBON_STREAM_PARSER - Static variable in interface org.apache.carbondata.streaming.parser.CarbonStreamParser

CARBON_STREAM_PARSER_CSV - Static variable in interface org.apache.carbondata.streaming.parser.CarbonStreamParser

CARBON_STREAM_PARSER_DEFAULT - Static variable in interface org.apache.carbondata.streaming.parser.CarbonStreamParser

CARBON_STREAM_PARSER_ROW_PARSER - Static variable in interface org.apache.carbondata.streaming.parser.CarbonStreamParser

CarbonStreamException - Exception in org.apache.carbondata.streaming

Stream exception

CarbonStreamException(String) - Constructor for exception org.apache.carbondata.streaming.CarbonStreamException

CarbonStreamException(String, Throwable) - Constructor for exception org.apache.carbondata.streaming.CarbonStreamException

CarbonStreamInputFormat - Class in org.apache.carbondata.streaming

Stream input format

CarbonStreamInputFormat() - Constructor for class org.apache.carbondata.streaming.CarbonStreamInputFormat

CarbonStreamOutputFormat - Class in org.apache.carbondata.streaming

Stream output format

CarbonStreamOutputFormat() - Constructor for class org.apache.carbondata.streaming.CarbonStreamOutputFormat

CarbonStreamParser - Interface in org.apache.carbondata.streaming.parser

Stream parser interface

CarbonStreamRecordReader - Class in org.apache.carbondata.streaming

Stream record reader

CarbonStreamRecordReader() - Constructor for class org.apache.carbondata.streaming.CarbonStreamRecordReader

CarbonStreamRecordWriter - Class in org.apache.carbondata.streaming

Stream record writer

CarbonStreamRecordWriter(TaskAttemptContext, CarbonLoadModel) - Constructor for class org.apache.carbondata.streaming.CarbonStreamRecordWriter

close() - Method in class org.apache.carbondata.streaming.CarbonStreamRecordReader

close(TaskAttemptContext) - Method in class org.apache.carbondata.streaming.CarbonStreamRecordWriter

close() - Method in interface org.apache.carbondata.streaming.parser.CarbonStreamParser

close() - Method in class org.apache.carbondata.streaming.parser.CSVStreamParserImp

close(CarbonTable, String) - Static method in class org.apache.carbondata.streaming.segment.StreamSegment

marker old stream segment to finished status and create new stream segment

createRecordReader(InputSplit, TaskAttemptContext) - Method in class org.apache.carbondata.streaming.CarbonStreamInputFormat

CSVStreamParserImp - Class in org.apache.carbondata.streaming.parser

CSV Stream Parser, it is also the default parser.

CSVStreamParserImp() - Constructor for class org.apache.carbondata.streaming.parser.CSVStreamParserImp

F

finishStreaming(CarbonTable) - Static method in class org.apache.carbondata.streaming.segment.StreamSegment

change the status of the segment from "streaming" to "streaming finish"

G

getCarbonLoadModel(Configuration) - Static method in class org.apache.carbondata.streaming.CarbonStreamOutputFormat

getComplexDimensions(CarbonTable, CarbonColumn[], Cache<DictionaryColumnUniqueIdentifier, Dictionary>) - Static method in class org.apache.carbondata.streaming.CarbonStreamInputFormat

getCurrentKey() - Method in class org.apache.carbondata.streaming.CarbonStreamRecordReader

getCurrentValue() - Method in class org.apache.carbondata.streaming.CarbonStreamRecordReader

getFileName() - Method in class org.apache.carbondata.streaming.CarbonStreamRecordWriter

getProgress() - Method in class org.apache.carbondata.streaming.CarbonStreamRecordReader

getRecordWriter(TaskAttemptContext) - Method in class org.apache.carbondata.streaming.CarbonStreamOutputFormat

getSegmentDir() - Method in class org.apache.carbondata.streaming.CarbonStreamRecordWriter

getSegmentId(Configuration) - Static method in class org.apache.carbondata.streaming.CarbonStreamOutputFormat

I

initialize(InputSplit, TaskAttemptContext) - Method in class org.apache.carbondata.streaming.CarbonStreamRecordReader

initialize(Configuration, StructType) - Method in interface org.apache.carbondata.streaming.parser.CarbonStreamParser

initialize(Configuration, StructType) - Method in class org.apache.carbondata.streaming.parser.CSVStreamParserImp

L

listDataFiles(String, FileFactory.FileType) - Static method in class org.apache.carbondata.streaming.segment.StreamSegment

list all carbondata files of a segment

N

nextKeyValue() - Method in class org.apache.carbondata.streaming.CarbonStreamRecordReader

O

open(CarbonTable) - Static method in class org.apache.carbondata.streaming.segment.StreamSegment

get stream segment or create new stream segment if not exists

org.apache.carbondata.streaming - package org.apache.carbondata.streaming

org.apache.carbondata.streaming.parser - package org.apache.carbondata.streaming.parser

org.apache.carbondata.streaming.segment - package org.apache.carbondata.streaming.segment

P

parserRow(InternalRow) - Method in interface org.apache.carbondata.streaming.parser.CarbonStreamParser

parserRow(InternalRow) - Method in class org.apache.carbondata.streaming.parser.CSVStreamParserImp

R

READ_BUFFER_SIZE - Static variable in class org.apache.carbondata.streaming.CarbonStreamInputFormat

READ_BUFFER_SIZE_DEFAULT - Static variable in class org.apache.carbondata.streaming.CarbonStreamInputFormat

recoverFileIfRequired(String, String, String) - Static method in class org.apache.carbondata.streaming.segment.StreamSegment

check the health of stream data file and try to recover data file from task fault this method will be invoked in following scenarios.

recoverSegmentIfRequired(String) - Static method in class org.apache.carbondata.streaming.segment.StreamSegment

check the health of stream segment and try to recover segment from job fault this method will be invoked in following scenarios.

S

setCarbonLoadModel(Configuration, CarbonLoadModel) - Static method in class org.apache.carbondata.streaming.CarbonStreamOutputFormat

setHasException(boolean) - Method in class org.apache.carbondata.streaming.CarbonStreamRecordWriter

setInputMetricsStats(InputMetricsStats) - Method in class org.apache.carbondata.streaming.CarbonStreamRecordReader

setQueryModel(QueryModel) - Method in class org.apache.carbondata.streaming.CarbonStreamRecordReader

setSegmentId(Configuration, String) - Static method in class org.apache.carbondata.streaming.CarbonStreamOutputFormat

setUseRawRow(boolean) - Method in class org.apache.carbondata.streaming.CarbonStreamRecordReader

setVectorReader(boolean) - Method in class org.apache.carbondata.streaming.CarbonStreamRecordReader

size(String) - Static method in class org.apache.carbondata.streaming.segment.StreamSegment

calculate the size of the segment by the accumulation of data sizes in index file

StreamBlockletReader - Class in org.apache.carbondata.streaming

stream blocklet reader

StreamBlockletWriter - Class in org.apache.carbondata.streaming

stream blocklet writer

StreamSegment - Class in org.apache.carbondata.streaming.segment

streaming segment manager

StreamSegment() - Constructor for class org.apache.carbondata.streaming.segment.StreamSegment

U

updateIndexFile(String) - Static method in class org.apache.carbondata.streaming.segment.StreamSegment

update carbonindex file after a stream batch.

W

write(Void, Object) - Method in class org.apache.carbondata.streaming.CarbonStreamRecordWriter

A C F G I L N O P R S U W