Package com.c12e.cortex.profiles.module.datasource

Interface CortexDataSourceStreamWriter

All Superinterfaces:

CortexWriter<CortexDataSourceStreamWriter>

All Known Implementing Classes:

DefaultCortexDataSourceStreamWriter.CortexWriteStreamParameters

public interface CortexDataSourceStreamWriter
extends CortexWriter<CortexDataSourceStreamWriter>

Method Summary

Modifier and Type	Method	Description
CortexDataSourceStreamWriter	performAggregation(java.lang.Boolean performAggregation)	Perform groupBy aggregation on primary key, an expensive operation that should be turned off if the micro-batch dataset from the streaming data source always contains unique keys
CortexDataSourceStreamWriter	performFeatureCatalogCalculations(java.lang.Boolean performCalculations)	Perform feature catalog calculations FeatureCatalog
CortexDataSourceStreamWriter	setDataSourcePair(CortexDataSourcePair fabricDataSourcePair)	Sets the stream reader return type

Methods inherited from interface com.c12e.cortex.profiles.module.CortexWriter

deltaMerge, mode, option, options, partitionBy, project, resourceName, save, setDataset

Method Detail

setDataSourcePair

CortexDataSourceStreamWriter setDataSourcePair(CortexDataSourcePair fabricDataSourcePair)

Sets the stream reader return type

Parameters:

fabricDataSourcePair -

Returns:

this instance

performAggregation

CortexDataSourceStreamWriter performAggregation(java.lang.Boolean performAggregation)

Perform groupBy aggregation on primary key, an expensive operation that should be turned off if the micro-batch dataset from the streaming data source always contains unique keys

Parameters:

performAggregation -

Returns:

this instance

performFeatureCatalogCalculations

CortexDataSourceStreamWriter performFeatureCatalogCalculations(java.lang.Boolean performCalculations)

Perform feature catalog calculations FeatureCatalog

Parameters:

performCalculations -

Returns:

this instance