Skip to content

SparkConnectorSource

Source code in docs_src/capo_glue/types/spark_connector_source.py
class SparkConnectorSource(TypedDict, closed=True):
    name: "capo_glue.types.node_name.NodeName"
    """<p>The name of the data source.</p>"""
    connection_name: (
        "capo_glue.types.enclosed_in_string_property.EnclosedInStringProperty"
    )
    """<p>The name of the connection that is associated with the connector.</p>"""
    connector_name: (
        "capo_glue.types.enclosed_in_string_property.EnclosedInStringProperty"
    )
    """<p>The name of a connector that assists with accessing the data store in Glue Studio.</p>"""
    connection_type: (
        "capo_glue.types.enclosed_in_string_property.EnclosedInStringProperty"
    )
    """<p>The type of connection, such as marketplace.spark or custom.spark, designating a connection to an Apache Spark data store.</p>"""
    additional_options: NotRequired[
        "capo_glue.types.additional_options.AdditionalOptions"
    ]
    """<p>Additional connection options for the connector.</p>"""
    output_schemas: NotRequired["capo_glue.types.glue_schemas.GlueSchemas"]
    """<p>Specifies data schema for the custom spark source.</p>"""

additional_options instance-attribute

additional_options: NotRequired[AdditionalOptions]

Additional connection options for the connector.

connection_name instance-attribute

connection_name: EnclosedInStringProperty

The name of the connection that is associated with the connector.

connection_type instance-attribute

connection_type: EnclosedInStringProperty

The type of connection, such as marketplace.spark or custom.spark, designating a connection to an Apache Spark data store.

connector_name instance-attribute

connector_name: EnclosedInStringProperty

The name of a connector that assists with accessing the data store in Glue Studio.

name instance-attribute

name: NodeName

The name of the data source.

output_schemas instance-attribute

output_schemas: NotRequired[GlueSchemas]

Specifies data schema for the custom spark source.