org.deeplearning4j.datasets.fetchers

Class CacheableExtractableDataSetFetcher

java.lang.Object

org.deeplearning4j.datasets.fetchers.CacheableExtractableDataSetFetcher

Direct Known Subclasses:

Cifar10Fetcher, SvhnDataFetcher, TinyImageNetFetcher, UciSequenceDataFetcher

public abstract class CacheableExtractableDataSetFetcher
extends Object

Abstract class for enabling dataset downloading and local caching.

Author:

Justin Long (crockpotveggies)

Constructor Summary

Constructors

Constructor and Description
CacheableExtractableDataSetFetcher()

Method Summary

Modifier and Type	Method and Description
String	dataSetName(DataSetType set)
protected static void	deleteIfEmpty(File localCache)
void	downloadAndExtract()
void	downloadAndExtract(DataSetType set) Downloads and extracts the local dataset.
long	expectedChecksum()
long	expectedChecksum(DataSetType set)
protected File	getLocalCacheDir()
org.datavec.api.records.reader.RecordReader	getRecordReader(long rngSeed, int[] imgDim, DataSetType set, ImageTransform imageTransform)
boolean	isCached() Returns a boolean indicating if the dataset is already cached locally.
String	localCacheName()
String	remoteDataUrl()
String	remoteDataUrl(DataSetType set)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CacheableExtractableDataSetFetcher

public CacheableExtractableDataSetFetcher()

Method Detail

dataSetName

public String dataSetName(DataSetType set)

remoteDataUrl

public String remoteDataUrl()

expectedChecksum

public long expectedChecksum()

downloadAndExtract

public void downloadAndExtract()
                        throws IOException

Throws:

IOException

downloadAndExtract

public void downloadAndExtract(DataSetType set)
                        throws IOException

Downloads and extracts the local dataset.

Throws:

IOException

getLocalCacheDir

protected File getLocalCacheDir()

isCached

public boolean isCached()

Returns a boolean indicating if the dataset is already cached locally.

Returns:

boolean

deleteIfEmpty

protected static void deleteIfEmpty(File localCache)

remoteDataUrl

public String remoteDataUrl(DataSetType set)

localCacheName

public String localCacheName()

expectedChecksum

public long expectedChecksum(DataSetType set)

getRecordReader

public org.datavec.api.records.reader.RecordReader getRecordReader(long rngSeed,
                                                                   int[] imgDim,
                                                                   DataSetType set,
                                                                   ImageTransform imageTransform)