create_bulk_import_job
async
¶
create_bulk_import_job(
job_name: BulkImportJobName,
job_role_arn: ARN,
files: Files,
error_report_location: ErrorReportLocation,
*,
config_overrides: Optional[AsyncIoTSiteWiseClientConfig] = None,
job_configuration: Optional[JobConfiguration] = None,
adaptive_ingestion: Optional[AdaptiveIngestion] = None,
delete_files_after_import: Optional[DeleteFilesAfterImport] = None,
dataset_id: Optional[ID] = None,
workspace_name: Optional[WorkspaceName] = None,
) -> CreateBulkImportJobResponse
Defines a job to ingest data to IoT SiteWise from Amazon S3. For more information, see Create a bulk import job (CLI) in the Amazon Simple Storage Service User Guide.
Before you create a bulk import job that ingests data into time series outside of a workspace, you must enable IoT SiteWise warm tier or IoT SiteWise cold tier. For more information about how to configure storage settings, see PutStorageConfiguration. This requirement doesn't apply to bulk import jobs that ingest data into a session dataset in a workspace (jobs that specify a workspaceName and datasetId). Those jobs don't use IoT SiteWise warm or cold tier storage.
Bulk import is designed to store historical data to IoT SiteWise.
-
Newly ingested data in the hot tier triggers notifications and computations.
-
After data moves from the hot tier to the warm or cold tier based on retention settings, it does not trigger computations or notifications.
-
Data older than 7 days does not trigger computations or notifications.
Parameters:
-
job_name(BulkImportJobName) –The unique name that helps identify the job request.
-
job_role_arn(ARN) –The ARN of the IAM role that allows IoT SiteWise to read Amazon S3 data.
-
files(Files) –The files in the specified Amazon S3 bucket that contain your data. You can specify up to 100 files for each bulk import job. Each file supports the following size limits:
-
Parquet files – Up to 256 MiB.
-
Other file formats – Up to 5 GiB.
-
-
error_report_location(ErrorReportLocation) –The Amazon S3 destination where errors associated with the job creation request are saved.
-
job_configuration(Optional[JobConfiguration], default:None) –Contains the configuration information of a job, such as the file format used to save data in Amazon S3.
-
adaptive_ingestion(Optional[AdaptiveIngestion], default:None) –If set to true, ingest new data into IoT SiteWise storage. Measurements with notifications, metrics and transforms are computed. If set to false, historical data is ingested into IoT SiteWise as is.
-
delete_files_after_import(Optional[DeleteFilesAfterImport], default:None) –If set to true, your data files is deleted from S3, after ingestion into IoT SiteWise storage.
-
dataset_id(Optional[ID], default:None) –The ID of the session dataset to ingest data into. Specify this field, together with
workspaceName, to ingest data into a session dataset in a workspace. -
workspace_name(Optional[WorkspaceName], default:None) –The name of the workspace that contains the session dataset. Specify this field together with
datasetId.
Raises:
-
ConflictingOperationException–Your request has conflicting operations. This can occur if you're trying to perform more than one operation on the same resource at the same time.
-
InternalFailureException–IoT SiteWise can't process your request right now. Try again later.
-
InvalidRequestException–The request isn't valid. This can occur if your request contains malformed JSON or unsupported characters. Check your request and try again.
-
LimitExceededException–You've reached the quota for a resource. For example, this can occur if you're trying to associate more than the allowed number of child assets or attempting to create more than the allowed number of properties for an asset model.
For more information, see Quotas in the IoT SiteWise User Guide.
-
ResourceAlreadyExistsException–The resource already exists.
-
ResourceNotFoundException–The requested resource can't be found.
-
ThrottlingException–Your request exceeded a rate limit. For example, you might have exceeded the number of IoT SiteWise assets that can be created per second, the allowed number of messages per second, and so on.
For more information, see Quotas in the IoT SiteWise User Guide.
-
UnknownServiceError–The service returned an error code this client does not model.
Source code in docs_src/capo_iotsitewise/_services/async_io_t_site_wise.py
1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 2065 2066 2067 2068 2069 2070 2071 2072 2073 2074 2075 2076 2077 2078 2079 2080 2081 2082 2083 | |