water.persist
Class PersistS3Task

java.lang.Object
  extended by jsr166y.ForkJoinTask<java.lang.Void>
      extended by jsr166y.CountedCompleter
          extended by water.H2O.H2OCountedCompleter
              extended by water.DTask<T>
                  extended by water.DRemoteTask<T>
                      extended by water.MRTask
                          extended by water.persist.PersistS3Task
All Implemented Interfaces:
java.io.Serializable, java.lang.Cloneable, java.util.concurrent.Future<java.lang.Void>, Freezable

public class PersistS3Task
extends MRTask

Map/reduce upload to S3.

See Also:
Serialized Form

Nested Class Summary
static class PersistS3Task.Progress
           
 
Field Summary
 
Fields inherited from class water.MRTask
_hi, _lo
 
Fields inherited from class water.DRemoteTask
_fs, _is_local, _keys
 
Fields inherited from class water.DTask
_cls, _eFromNode, _exception, _fname, _lineNum, _msg, _mth
 
Constructor Summary
PersistS3Task()
           
 
Method Summary
static Key init(Value value)
           
 void map(Key key)
          Run some useful function over this local key, and record the results in the this MRTask.
 void reduce(DRemoteTask rt)
           
static void run(Key dest, Value value, java.lang.String bucket, java.lang.String object)
           
 
Methods inherited from class water.MRTask
hi, init, lcompute, lo, lonCompletion, memOverheadPerChunk, onExceptionalCompletion
 
Methods inherited from class water.DRemoteTask
alsoBlockFor, alsoBlockFor, clone, compute2, dfork, getFutures, invoke, invokeOnAllNodes, keys, merge, merge, merge, onCompletion, reduceAlsoBlock
 
Methods inherited from class water.DTask
copyOver, dinvoke, frozenType, getDException, hasException, logVerbose, newInstance, onAck, onAckAck, read, setException, toDocField, write, writeJSONFields
 
Methods inherited from class water.H2O.H2OCountedCompleter
compute, priority
 
Methods inherited from class jsr166y.CountedCompleter
addToPendingCount, compareAndSetPendingCount, complete, exec, getCompleter, getPendingCount, getRawResult, setCompleter, setPendingCount, setRawResult, tryComplete
 
Methods inherited from class jsr166y.ForkJoinTask
adapt, adapt, adapt, cancel, compareAndSetForkJoinTaskTag, completeExceptionally, fork, get, get, getException, getForkJoinTaskTag, getPool, getQueuedTaskCount, getSurplusQueuedTaskCount, helpQuiesce, inForkJoinPool, invoke, invokeAll, invokeAll, invokeAll, isCancelled, isCompletedAbnormally, isCompletedNormally, isDone, join, peekNextLocalTask, pollNextLocalTask, pollTask, quietlyComplete, quietlyInvoke, quietlyJoin, reinitialize, setForkJoinTaskTag, tryUnfork
 
Methods inherited from class java.lang.Object
equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Constructor Detail

PersistS3Task

public PersistS3Task()
Method Detail

init

public static Key init(Value value)

run

public static void run(Key dest,
                       Value value,
                       java.lang.String bucket,
                       java.lang.String object)

map

public void map(Key key)
Description copied from class: MRTask
Run some useful function over this local key, and record the results in the this MRTask.

Specified by:
map in class MRTask

reduce

public void reduce(DRemoteTask rt)
Specified by:
reduce in class DRemoteTask