Package org.apache.cassandra.spark.bulkwriter.cloudstorage

Class CloudStorageStreamSession

java.lang.Object

org.apache.cassandra.spark.bulkwriter.StreamSession<TransportContext.CloudStorageTransportContext>

org.apache.cassandra.spark.bulkwriter.cloudstorage.CloudStorageStreamSession

public class CloudStorageStreamSession
extends StreamSession<TransportContext.CloudStorageTransportContext>

StreamSession implementation that is used for streaming bundled SSTables for S3_COMPAT transport option.

Field Summary

Fields

Modifier and Type	Field	Description
protected org.apache.cassandra.bridge.CassandraBridge	bridge
protected BundleNameGenerator	bundleNameGenerator
protected CloudStorageDataTransferApi	dataTransferApi

Fields inherited from class org.apache.cassandra.spark.bulkwriter.StreamSession

errors, executorService, failureHandler, replicas, sessionID, sstableWriter, tokenRange, tokenRangeMapping, transportContext, writerContext

Constructor Summary

Constructors

Constructor	Description
CloudStorageStreamSession(BulkWriterContext bulkWriterContext, SortedSSTableWriter sstableWriter, TransportContext.CloudStorageTransportContext transportContext, java.lang.String sessionID, com.google.common.collect.Range<java.math.BigInteger> tokenRange, org.apache.cassandra.bridge.CassandraBridge bridge, ReplicaAwareFailureHandler<RingInstance> failureHandler, java.util.concurrent.ExecutorService executorService)
CloudStorageStreamSession(BulkWriterContext bulkWriterContext, SortedSSTableWriter sstableWriter, TransportContext.CloudStorageTransportContext transportContext, java.lang.String sessionID, com.google.common.collect.Range<java.math.BigInteger> tokenRange, ReplicaAwareFailureHandler<RingInstance> failureHandler, java.util.concurrent.ExecutorService executorService)

Method Summary

Modifier and Type	Method	Description
protected StreamResult	doFinalizeStream()	Finalize the stream with the produced sstables and return the stream result.
protected void	onSSTablesProduced(java.util.Set<org.apache.cassandra.bridge.SSTableDescriptor> sstables)	Get notified on sstables produced.
protected void	sendRemainingSSTables()	Send the SSTable(s) written by SSTableWriter The code runs on a separate thread

Methods inherited from class org.apache.cassandra.spark.bulkwriter.StreamSession

addRow, finalizeStreamAsync, getTokenRange, isFileStreamed, isStreamFinalized, recordStreamedFile, rowCount, setLastStreamFailure, throwIfLastStreamFailed

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

bundleNameGenerator

protected final BundleNameGenerator bundleNameGenerator

dataTransferApi

protected final CloudStorageDataTransferApi dataTransferApi

bridge

protected final org.apache.cassandra.bridge.CassandraBridge bridge

Constructor Detail

CloudStorageStreamSession

public CloudStorageStreamSession(BulkWriterContext bulkWriterContext,
                                 SortedSSTableWriter sstableWriter,
                                 TransportContext.CloudStorageTransportContext transportContext,
                                 java.lang.String sessionID,
                                 com.google.common.collect.Range<java.math.BigInteger> tokenRange,
                                 ReplicaAwareFailureHandler<RingInstance> failureHandler,
                                 java.util.concurrent.ExecutorService executorService)

CloudStorageStreamSession

public CloudStorageStreamSession(BulkWriterContext bulkWriterContext,
                                 SortedSSTableWriter sstableWriter,
                                 TransportContext.CloudStorageTransportContext transportContext,
                                 java.lang.String sessionID,
                                 com.google.common.collect.Range<java.math.BigInteger> tokenRange,
                                 org.apache.cassandra.bridge.CassandraBridge bridge,
                                 ReplicaAwareFailureHandler<RingInstance> failureHandler,
                                 java.util.concurrent.ExecutorService executorService)

Method Detail

onSSTablesProduced

protected void onSSTablesProduced(java.util.Set<org.apache.cassandra.bridge.SSTableDescriptor> sstables)

Description copied from class: StreamSession

Get notified on sstables produced. When the method is invoked, the input parameter 'sstables' is guaranteed to be non-empty.

Specified by:

onSSTablesProduced in class StreamSession<TransportContext.CloudStorageTransportContext>

Parameters:

sstables - produces SSTables

doFinalizeStream

protected StreamResult doFinalizeStream()

Description copied from class: StreamSession

Finalize the stream with the produced sstables and return the stream result.

Specified by:

doFinalizeStream in class StreamSession<TransportContext.CloudStorageTransportContext>

Returns:

stream result

sendRemainingSSTables

protected void sendRemainingSSTables()

Description copied from class: StreamSession

Send the SSTable(s) written by SSTableWriter The code runs on a separate thread

Specified by:

sendRemainingSSTables in class StreamSession<TransportContext.CloudStorageTransportContext>