org.apache.carbondata.datamap.bloom

Class BloomDataMapWriter

java.lang.Object

org.apache.carbondata.core.datamap.dev.DataMapWriter

org.apache.carbondata.datamap.bloom.BloomDataMapWriter

Direct Known Subclasses:

BloomDataMapBuilder

@InterfaceAudience.Internal
public class BloomDataMapWriter
extends DataMapWriter

BloomDataMap is constructed in CG level (blocklet level). For each indexed column, a bloom filter is constructed to indicate whether a value belongs to this blocklet. Bloom filter of blocklet that belongs to same block will be written to one index file suffixed with .bloomindex. So the number of bloom index file will be equal to that of the blocks.

Field Summary

Fields

Modifier and Type	Field and Description
protected int	currentBlockletId
protected List<CarbonBloomFilter>	indexBloomFilters

Fields inherited from class org.apache.carbondata.core.datamap.dev.DataMapWriter

dataMapPath, segmentId, tablePath

Method Summary

Modifier and Type	Method and Description
void	finish()
protected byte[]	getStringData(Object data)
void	onBlockEnd(String blockId)
void	onBlockletEnd(int blockletId)
void	onBlockletStart(int blockletId)
void	onBlockStart(String blockId)
void	onPageAdded(int blockletId, int pageId, int pageSize, ColumnPage[] pages)
protected void	releaseResouce()
protected void	resetBloomFilters()
protected void	writeBloomDataMapFile()

Methods inherited from class org.apache.carbondata.core.datamap.dev.DataMapWriter

commitFile, getDefaultDataMapPath, getIndexColumns

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

currentBlockletId

protected int currentBlockletId

indexBloomFilters

protected List<CarbonBloomFilter> indexBloomFilters

Method Detail

onBlockStart

public void onBlockStart(String blockId)
                  throws IOException

Specified by:

onBlockStart in class DataMapWriter

Throws:

IOException

onBlockEnd

public void onBlockEnd(String blockId)
                throws IOException

Specified by:

onBlockEnd in class DataMapWriter

Throws:

IOException

onBlockletStart

public void onBlockletStart(int blockletId)

Specified by:

onBlockletStart in class DataMapWriter

resetBloomFilters

protected void resetBloomFilters()

onBlockletEnd

public void onBlockletEnd(int blockletId)

Specified by:

onBlockletEnd in class DataMapWriter

onPageAdded

public void onPageAdded(int blockletId,
                        int pageId,
                        int pageSize,
                        ColumnPage[] pages)

Specified by:

onPageAdded in class DataMapWriter

getStringData

protected byte[] getStringData(Object data)

writeBloomDataMapFile

protected void writeBloomDataMapFile()

finish

public void finish()
            throws IOException

Specified by:

finish in class DataMapWriter

Throws:

IOException

releaseResouce

protected void releaseResouce()