Data Structures | Functions
data_lake_processor.h File Reference

Data lake processor module header file. More...

#include "mcl_core/mcl_http_client.h"
#include "data_lake_object.h"
Include dependency graph for data_lake_processor.h:
This graph shows which files directly or indirectly include this file:

Go to the source code of this file.

Data Structures

struct  data_lake_processor_t
 

Functions

mcl_error_t data_lake_processor_generate_upload_url (data_lake_processor_t *processor, data_lake_object_t *object, const char *subtenant_id)
 
mcl_error_t data_lake_processor_generate_upload_urls (data_lake_processor_t *processor, mcl_list_t *object_list, const char *subtenant_id)
 
mcl_error_t data_lake_processor_upload (data_lake_processor_t *processor, mcl_data_lake_object_t *object)
 

Detailed Description

Data lake processor module header file.

Copyright
Copyright (C) 2019 Siemens Aktiengesellschaft.
All rights reserved.

Definition in file data_lake_processor.h.

Function Documentation

mcl_error_t data_lake_processor_generate_upload_url ( data_lake_processor_t *  processor,
data_lake_object_t *  object,
const char *  subtenant_id 
)

This function gets the signed URL to upload data to.

Parameters
[in]processorData lake processor.
[in]objectData lake object.
[in]subtenant_idSubtenant ID.
Returns

Definition at line 43 of file data_lake_processor.c.

References _generate_upload_urls(), MCL_DEBUG_ENTRY, MCL_DEBUG_LEAVE, and SINGLE_OBJECT_SIZE.

Referenced by mcl_data_lake_generate_upload_url(), and mcl_data_lake_generate_upload_url_for_subtenant().

Here is the call graph for this function:

Here is the caller graph for this function:

mcl_error_t data_lake_processor_generate_upload_urls ( data_lake_processor_t *  processor,
mcl_list_t *  object_list,
const char *  subtenant_id 
)

This function gets the signed URLs for a list of objects to upload data to.

Parameters
[in]processorData lake processor.
[in]object_listList of data lake objects.
[in]subtenant_idSubtenant ID.
Returns

Definition at line 57 of file data_lake_processor.c.

References _data_lake_object_list_to_array(), _generate_upload_urls(), mcl_list_t::count, MCL_DEBUG_ENTRY, MCL_DEBUG_LEAVE, MCL_FREE, MCL_NULL, and MCL_OUT_OF_MEMORY.

Referenced by mcl_data_lake_generate_upload_urls(), and mcl_data_lake_generate_upload_urls_for_subtenant().

Here is the call graph for this function:

Here is the caller graph for this function:

mcl_error_t data_lake_processor_upload ( data_lake_processor_t *  processor,
mcl_data_lake_object_t *  object 
)

This function is used to upload objects to data lake.

Parameters
[in]processorData lake processor handle to be used.
[in]objectData lake object to be uploaded.
Returns