com.freedomoss.crowdcontrol.webharvest.plugin.s3

Class S3ListPlugin

java.lang.Object

WebHarvestPlugin

com.freedomoss.crowdcontrol.webharvest.plugin.s3.S3ListPlugin

public class S3ListPlugin
extends WebHarvestPlugin

Gets the list of objects (i.e. files or folders) form AWS S3 location. Supports filtering by regexp file name pattern and dates in "dd/MM/yyyy hh:mm:ss aaa z" format

See Also:

Usage : {code} {code}

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	DATE_FORMAT

Constructor Summary

Constructors

Constructor and Description
S3ListPlugin()

Method Summary

Modifier and Type	Method and Description
Variable	executePlugin(Scraper scraper, ScraperContext context)
java.lang.String	getName()
java.lang.String[]	getRequiredAttributes()
java.lang.String[]	getValidAttributes()

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DATE_FORMAT

public static final java.lang.String DATE_FORMAT

See Also:

Constant Field Values

Constructor Detail

S3ListPlugin

public S3ListPlugin()

Method Detail

getValidAttributes

public java.lang.String[] getValidAttributes()

getRequiredAttributes

public java.lang.String[] getRequiredAttributes()

getName

public java.lang.String getName()

executePlugin

public Variable executePlugin(Scraper scraper,
                              ScraperContext context)