Package com.c12e.cortex.profiles.module

Interface CortexWriter<T extends CortexWriter>

Type Parameters:

T - Implementation of the interface for subtype returns

All Known Subinterfaces:

CortexConnectionWriter, CortexDataSourceStreamWriter, CortexDataSourceWriter, CortexProfileWriter

All Known Implementing Classes:

DefaultCortexConnectionWriter.CortexWriteParameters, DefaultCortexDataSourceStreamWriter.CortexWriteStreamParameters, DefaultCortexDataSourceWriter.CortexWriteParameters, DefaultCortexProfileWriter.CortexWriteParameters

public interface CortexWriter<T extends CortexWriter>

Common interface of writer builder parameters

Method Summary

Modifier and Type	Method	Description
T	deltaMerge(CortexDeltaMergeBuilder mergeBuilder)	An instance of a builder to perform delta table merge.
T	mode(org.apache.spark.sql.SaveMode saveMode)	Spark save mode
T	option(java.lang.String key, java.lang.String value)	Overwrites value at key
T	options(java.util.Map<java.lang.String,java.lang.String> writeOptions)	Merges new options with current options
T	partitionBy(java.lang.String... columnNames)	Create partitions on column name(s)
T	project(java.lang.String project)	Sets the project
T	resourceName(java.lang.String resourceName)	Sets the resource to write to
void	save()	Completes building and begins write process
T	setDataset(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> ds)	Sets the dataset to write

Method Detail

project

T project(java.lang.String project)

Sets the project

Parameters:

project -

Returns:

this instance

resourceName

T resourceName(java.lang.String resourceName)

Sets the resource to write to

Parameters:

resourceName -

Returns:

this instance

options

T options(java.util.Map<java.lang.String,java.lang.String> writeOptions)

Merges new options with current options

Parameters:

writeOptions -

Returns:

this instance

option

T option(java.lang.String key,
         java.lang.String value)

Overwrites value at key

Parameters:

key -

value -

Returns:

this instance

mode

T mode(org.apache.spark.sql.SaveMode saveMode)

Spark save mode

Parameters:

saveMode -

Returns:

this instance

setDataset

T setDataset(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> ds)

Sets the dataset to write

Parameters:

ds -

Returns:

this instance

partitionBy

T partitionBy(java.lang.String... columnNames)

Create partitions on column name(s)

Parameters:

columnNames -

Returns:

this instance

deltaMerge

T deltaMerge(CortexDeltaMergeBuilder mergeBuilder)

An instance of a builder to perform delta table merge. Only applicable if ContentType is delta

Parameters:

mergeBuilder -

Returns:

this instance

save

void save()

Completes building and begins write process