create_recipe_job
async
¶
create_recipe_job(
name: JobName,
role_arn: Arn,
*,
config_overrides: Optional[AsyncDataBrewClientConfig] = None,
dataset_name: Optional[DatasetName] = None,
encryption_key_arn: Optional[EncryptionKeyArn] = None,
encryption_mode: Optional[EncryptionMode] = None,
log_subscription: Optional[LogSubscription] = None,
max_capacity: Optional[MaxCapacity] = None,
max_retries: Optional[MaxRetries] = None,
outputs: Optional[OutputList] = None,
data_catalog_outputs: Optional[DataCatalogOutputList] = None,
database_outputs: Optional[DatabaseOutputList] = None,
project_name: Optional[ProjectName] = None,
recipe_reference: Optional[RecipeReference] = None,
tags: Optional[TagMap] = None,
timeout: Optional[Timeout] = None,
) -> CreateRecipeJobResponse
Creates a new job to transform input data, using steps defined in an existing Glue DataBrew recipe
Parameters:
-
dataset_name(Optional[DatasetName], default:None) –The name of the dataset that this job processes.
-
encryption_key_arn(Optional[EncryptionKeyArn], default:None) –The Amazon Resource Name (ARN) of an encryption key that is used to protect the job.
-
encryption_mode(Optional[EncryptionMode], default:None) –The encryption mode for the job, which can be one of the following:
-
SSE-KMS- Server-side encryption with keys managed by KMS. -
SSE-S3- Server-side encryption with keys managed by Amazon S3.
-
-
name(JobName) –A unique name for the job. Valid characters are alphanumeric (A-Z, a-z, 0-9), hyphen (-), period (.), and space.
-
log_subscription(Optional[LogSubscription], default:None) –Enables or disables Amazon CloudWatch logging for the job. If logging is enabled, CloudWatch writes one log stream for each job run.
-
max_capacity(Optional[MaxCapacity], default:None) –The maximum number of nodes that DataBrew can consume when the job processes data.
-
max_retries(Optional[MaxRetries], default:None) –The maximum number of times to retry the job after a job run fails.
-
outputs(Optional[OutputList], default:None) –One or more artifacts that represent the output from running the job.
-
data_catalog_outputs(Optional[DataCatalogOutputList], default:None) –One or more artifacts that represent the Glue Data Catalog output from running the job.
-
database_outputs(Optional[DatabaseOutputList], default:None) –Represents a list of JDBC database output objects which defines the output destination for a DataBrew recipe job to write to.
-
project_name(Optional[ProjectName], default:None) –Either the name of an existing project, or a combination of a recipe and a dataset to associate with the recipe.
-
role_arn(Arn) –The Amazon Resource Name (ARN) of the Identity and Access Management (IAM) role to be assumed when DataBrew runs the job.
-
tags(Optional[TagMap], default:None) –Metadata tags to apply to this job.
-
timeout(Optional[Timeout], default:None) –The job's timeout in minutes. A job that attempts to run longer than this timeout period ends with a status of
TIMEOUT.
Raises:
-
AccessDeniedException–Access to the specified resource was denied.
-
ConflictException–Updating or deleting a resource can cause an inconsistent state.
-
ResourceNotFoundException–One or more resources can't be found.
-
ServiceQuotaExceededException–A service quota is exceeded.
-
ValidationException–The input parameters for this request failed validation.
-
UnknownServiceError–The service returned an error code this client does not model.
Source code in docs_src/capo_databrew/_services/async_data_brew.py
638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 | |