Class DefaultCortexDataSourceWriter
- java.lang.Object
-
- com.c12e.cortex.profiles.module.datasource.DefaultCortexDataSourceWriter
-
- All Implemented Interfaces:
CortexModule<CortexDataSourceWriter>
,CortexDataSourceWriterModule
public class DefaultCortexDataSourceWriter extends java.lang.Object implements CortexDataSourceWriterModule
Default implementation of CortexDataSourceWriterModule
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description class
DefaultCortexDataSourceWriter.CortexWriteParameters
-
Constructor Summary
Constructors Modifier Constructor Description protected
DefaultCortexDataSourceWriter(com.c12e.cortex.phoenix.Catalog catalog, FeatureCatalog featureCatalog, CortexValidator validator, PhoenixRemoteStorage phoenixRemoteStorage, CortexConnectionWriterModule cortexConnectionWriterModule)
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description CortexDataSourceWriter
getBuilder()
Create module specific builderprotected com.c12e.cortex.phoenix.DataSource
getDataSource(DefaultCortexDataSourceWriter.CortexWriteParameters cortexWriteParameters)
protected com.c12e.cortex.phoenix.Connection
getWriteConnection(java.lang.String project, java.lang.String dataSourceName)
protected org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>
prepareDataset(DefaultCortexDataSourceWriter.CortexWriteParameters cortexWriteParameters)
protected void
validateDataSet(DefaultCortexDataSourceWriter.CortexWriteParameters cortexWriteParameters, com.c12e.cortex.phoenix.DataSource dataSource)
void
write(DefaultCortexDataSourceWriter.CortexWriteParameters cortexWriteParameters)
Write to a Cortex DataSource using the builder instanceprotected void
writeToDataSource(DefaultCortexDataSourceWriter.CortexWriteParameters cortexWriteParameters, com.c12e.cortex.phoenix.Connection phoenixProfileConnection)
-
-
-
Constructor Detail
-
DefaultCortexDataSourceWriter
@Inject protected DefaultCortexDataSourceWriter(com.c12e.cortex.phoenix.Catalog catalog, FeatureCatalog featureCatalog, @Named("spark.cortex.writer.dataSource.validator.impl") CortexValidator validator, PhoenixRemoteStorage phoenixRemoteStorage, CortexConnectionWriterModule cortexConnectionWriterModule)
-
-
Method Detail
-
getDataSource
protected com.c12e.cortex.phoenix.DataSource getDataSource(DefaultCortexDataSourceWriter.CortexWriteParameters cortexWriteParameters)
-
prepareDataset
protected org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> prepareDataset(DefaultCortexDataSourceWriter.CortexWriteParameters cortexWriteParameters)
-
validateDataSet
protected void validateDataSet(DefaultCortexDataSourceWriter.CortexWriteParameters cortexWriteParameters, com.c12e.cortex.phoenix.DataSource dataSource)
-
getWriteConnection
protected com.c12e.cortex.phoenix.Connection getWriteConnection(java.lang.String project, java.lang.String dataSourceName)
-
writeToDataSource
protected void writeToDataSource(DefaultCortexDataSourceWriter.CortexWriteParameters cortexWriteParameters, com.c12e.cortex.phoenix.Connection phoenixProfileConnection)
-
write
public void write(DefaultCortexDataSourceWriter.CortexWriteParameters cortexWriteParameters)
Write to a Cortex DataSource using the builder instance- Parameters:
cortexWriteParameters
- builder instance
-
getBuilder
public CortexDataSourceWriter getBuilder()
Description copied from interface:CortexModule
Create module specific builder- Specified by:
getBuilder
in interfaceCortexModule<CortexDataSourceWriter>
- Returns:
- builder instance
-
-