cascading.aws.s3.logs

Class Main

java.lang.Object

cascading.aws.s3.logs.Main

public class Main
extends java.lang.Object

A trivial application that can read S3 logs from a S3 bucket, place them into a Kafka topic, the the logs from the topic, parse them, and write them to directories partitioned on log values.

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	DD_MMM_YYYY
static cascading.tuple.type.DateType	DMY
static cascading.tuple.Fields	KEY
static cascading.tuple.Fields	KEY_LINE
static cascading.tuple.Fields	LINE
static java.util.TimeZone	UTC

Constructor Summary

Constructors

Constructor and Description
Main()

Method Summary

Modifier and Type	Method and Description
static void	main(java.lang.String[] args)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DD_MMM_YYYY

public static final java.lang.String DD_MMM_YYYY

See Also:

Constant Field Values

UTC

public static final java.util.TimeZone UTC

DMY

public static final cascading.tuple.type.DateType DMY

KEY

public static final cascading.tuple.Fields KEY

LINE

public static final cascading.tuple.Fields LINE

KEY_LINE

public static final cascading.tuple.Fields KEY_LINE

Constructor Detail

Main

public Main()

Method Detail

main

public static void main(java.lang.String[] args)
                 throws java.io.IOException

Throws:

java.io.IOException