0.0.0+develop

Classes

Class	Description
`flytekitplugins.spark.agent.DatabricksAgent`	This is the base class for all async agents.
`flytekitplugins.spark.agent.DatabricksAgentV2`	Add DatabricksAgentV2 to support running the k8s spark and databricks spark together in the same workflow.
`flytekitplugins.spark.agent.DatabricksJobMetadata`
`flytekitplugins.spark.models.SparkJob`
`flytekitplugins.spark.pyspark_transformers.PySparkPipelineModelTransformer`	Base transformer type that should be implemented for every python native type that can be handled by flytekit.
`flytekitplugins.spark.schema.SparkDataFrameSchemaReader`	Implements how SparkDataFrame should be read using the `open` method of FlyteSchema.
`flytekitplugins.spark.schema.SparkDataFrameSchemaWriter`	Implements how SparkDataFrame should be written to using `open` method of FlyteSchema.
`flytekitplugins.spark.schema.SparkDataFrameTransformer`	Transforms Spark DataFrame’s to and from a Schema (typed/untyped).
`flytekitplugins.spark.sd_transformers.ParquetToSparkDecodingHandler`	Helper class that provides a standard way to create an ABC using.
`flytekitplugins.spark.sd_transformers.SparkDataFrameRenderer`	Render a Spark dataframe schema as an HTML table.
`flytekitplugins.spark.sd_transformers.SparkToParquetEncodingHandler`	Helper class that provides a standard way to create an ABC using.
`flytekitplugins.spark.task.Databricks`	Deprecated.
`flytekitplugins.spark.task.DatabricksV2`	Use this to configure a Databricks task.
`flytekitplugins.spark.task.PysparkFunctionTask`	Actual Plugin that transforms the local python code for execution within a spark context.
`flytekitplugins.spark.task.Spark`	Use this to configure a SparkContext for a your task.