Package com.c12e.cortex.profiles.module.job

Class BuildProfileJob

java.lang.Object

com.c12e.cortex.profiles.module.job.BuildProfileJob

All Implemented Interfaces:

java.lang.Runnable

public class BuildProfileJob
extends java.lang.Object
implements java.lang.Runnable

Job that builds a ProfileSchema

Field Summary

Fields

Modifier and Type	Field	Description
java.util.function.Function<CortexProfileWriter,CortexProfileWriter>	defaultWriterOptions	Default writer options, remove option with by returning dws
java.util.function.BiFunction<java.lang.String,java.lang.String,org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>>	getDataset
java.util.function.Supplier<java.lang.Boolean>	performFeatureCatalogCalculations	Perform FeatureCatalog calculations, is an expensive operation and may be set to false depending on the dataset
java.util.function.Function<CortexProfileWriter,CortexProfileWriter>	writerOptions	Expand on writer options

Constructor Summary

Constructors

Constructor	Description
BuildProfileJob(java.lang.String project, java.lang.String profileSchema, CortexContext cortexContext)	Constructor

Method Summary

Modifier and Type	Method	Description
void	run()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

defaultWriterOptions

public java.util.function.Function<CortexProfileWriter,CortexProfileWriter> defaultWriterOptions

Default writer options, remove option with by returning dws

writerOptions

public java.util.function.Function<CortexProfileWriter,CortexProfileWriter> writerOptions

Expand on writer options

performFeatureCatalogCalculations

public java.util.function.Supplier<java.lang.Boolean> performFeatureCatalogCalculations

Perform FeatureCatalog calculations, is an expensive operation and may be set to false depending on the dataset

getDataset

public java.util.function.BiFunction<java.lang.String,java.lang.String,org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>> getDataset

Constructor Detail

BuildProfileJob

public BuildProfileJob(java.lang.String project,
                       java.lang.String profileSchema,
                       CortexContext cortexContext)

Constructor

Parameters:

project - the project

profileSchema - the schema

cortexContext - the context

Method Detail

run

public void run()

Specified by:

run in interface java.lang.Runnable