Class StreamedETLFilesystemBackendStep

java.lang.Object

com.kingsrook.qqq.backend.core.processes.implementations.etl.streamed.StreamedETLBackendStep

com.kingsrook.qqq.backend.module.filesystem.processes.implementations.etl.streamed.StreamedETLFilesystemBackendStep

All Implemented Interfaces:

BackendStep

public class StreamedETLFilesystemBackendStep
extends StreamedETLBackendStep

Extension to the base StreamedETLBackendStep, unique for where the source table is a filesystem, where we want/need to collect the filenames that were processed in the Extract step, so they can be passed into the cleanup step. Similar in purpose to the BasicETLCollectSourceFileNamesStep - only in this case, due to the streaming behavior of the StreamedETLProcess, we can't really inject this code as a separate backend step - so instead we extend that step, and override its postTransform method to intercept the records invalid input: '&' file names.

Constructor Summary

Constructors

Constructor	Description
StreamedETLFilesystemBackendStep()

Method Summary

Modifier and Type	Method	Description
protected void	preTransform(List<QRecord> qRecords, RunBackendStepInput runBackendStepInput, RunBackendStepOutput runBackendStepOutput)	Customization point for subclasses of this step.

Methods inherited from class com.kingsrook.qqq.backend.core.processes.implementations.etl.streamed.StreamedETLBackendStep

postTransform, run

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

StreamedETLFilesystemBackendStep

public StreamedETLFilesystemBackendStep()

Method Details

preTransform

protected void preTransform(List<QRecord> qRecords,
 RunBackendStepInput runBackendStepInput,
 RunBackendStepOutput runBackendStepOutput)

Description copied from class: StreamedETLBackendStep

Customization point for subclasses of this step.

Overrides:

preTransform in class StreamedETLBackendStep