org.deeplearning4j.datasets.fetchers

Class MnistDataFetcher

java.lang.Object

org.nd4j.linalg.dataset.api.iterator.fetcher.BaseDataFetcher

org.deeplearning4j.datasets.fetchers.MnistDataFetcher

All Implemented Interfaces:

Serializable, org.nd4j.linalg.dataset.api.iterator.fetcher.DataSetFetcher

Direct Known Subclasses:

EmnistDataFetcher

public class MnistDataFetcher
extends org.nd4j.linalg.dataset.api.iterator.fetcher.BaseDataFetcher

Data fetcher for the MNIST dataset

Author:

Adam Gibson

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
protected boolean	binarize
protected static long	CHECKSUM_TEST_FEATURES
protected static long	CHECKSUM_TEST_LABELS
protected static long	CHECKSUM_TRAIN_FEATURES
protected static long	CHECKSUM_TRAIN_LABELS
protected static long[]	CHECKSUMS_TEST
protected static long[]	CHECKSUMS_TRAIN
protected boolean	firstShuffle
protected boolean	fOrder
protected MnistManager	man
static int	NUM_EXAMPLES
static int	NUM_EXAMPLES_TEST
protected int	numExamples
protected boolean	oneIndexed
protected int[]	order
protected Random	rng
protected boolean	shuffle
protected boolean	train

Fields inherited from class org.nd4j.linalg.dataset.api.iterator.fetcher.BaseDataFetcher

curr, cursor, inputColumns, log, numOutcomes, totalExamples

Constructor Summary

Constructors

Constructor and Description
MnistDataFetcher()
MnistDataFetcher(boolean binarize) Constructor telling whether to binarize the dataset or not
MnistDataFetcher(boolean binarize, boolean train, boolean shuffle, long rngSeed, int numExamples)

Method Summary

Modifier and Type	Method and Description
void	fetch(int numExamples)
org.nd4j.linalg.dataset.DataSet	next()
void	reset()

Methods inherited from class org.nd4j.linalg.dataset.api.iterator.fetcher.BaseDataFetcher

createInputMatrix, createOutputMatrix, createOutputVector, cursor, hasMore, initializeCurrFromList, inputColumns, totalExamples, totalOutcomes

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

NUM_EXAMPLES

public static final int NUM_EXAMPLES

See Also:

Constant Field Values

NUM_EXAMPLES_TEST

public static final int NUM_EXAMPLES_TEST

See Also:

Constant Field Values

CHECKSUM_TRAIN_FEATURES

protected static final long CHECKSUM_TRAIN_FEATURES

See Also:

Constant Field Values

CHECKSUM_TRAIN_LABELS

protected static final long CHECKSUM_TRAIN_LABELS

See Also:

Constant Field Values

CHECKSUM_TEST_FEATURES

protected static final long CHECKSUM_TEST_FEATURES

See Also:

Constant Field Values

CHECKSUM_TEST_LABELS

protected static final long CHECKSUM_TEST_LABELS

See Also:

Constant Field Values

CHECKSUMS_TRAIN

protected static final long[] CHECKSUMS_TRAIN

CHECKSUMS_TEST

protected static final long[] CHECKSUMS_TEST

man

protected transient MnistManager man

binarize

protected boolean binarize

train

protected boolean train

order

protected int[] order

rng

protected Random rng

shuffle

protected boolean shuffle

oneIndexed

protected boolean oneIndexed

fOrder

protected boolean fOrder

firstShuffle

protected boolean firstShuffle

numExamples

protected final int numExamples

Constructor Detail

MnistDataFetcher

public MnistDataFetcher(boolean binarize)
                 throws IOException

Constructor telling whether to binarize the dataset or not

Parameters:

binarize - whether to binarize the dataset or not

Throws:

IOException

MnistDataFetcher

public MnistDataFetcher(boolean binarize,
                        boolean train,
                        boolean shuffle,
                        long rngSeed,
                        int numExamples)
                 throws IOException

Throws:

IOException

MnistDataFetcher

public MnistDataFetcher()
                 throws IOException

Throws:

IOException

Method Detail

fetch

public void fetch(int numExamples)

reset

public void reset()

Specified by:

reset in interface org.nd4j.linalg.dataset.api.iterator.fetcher.DataSetFetcher

Overrides:

reset in class org.nd4j.linalg.dataset.api.iterator.fetcher.BaseDataFetcher

next

public org.nd4j.linalg.dataset.DataSet next()

Specified by:

next in interface org.nd4j.linalg.dataset.api.iterator.fetcher.DataSetFetcher

Overrides:

next in class org.nd4j.linalg.dataset.api.iterator.fetcher.BaseDataFetcher