Integration Integration processors

Podcast

Play an AI-generated podcast conversation about this lesson

Questions and Answers

What is the first step in the lifecycle of an integration job?

Postprocessor

Preprocessor (correct)

Database handler

Integration processor

What is the primary function of a preprocessor in the integration job lifecycle?

To handle post-processing tasks

To perform preprocessing before returning the job (correct)

To validate integration parameters

To log integration errors

Which parameter must be included when submitting a product using a preprocessor?

ProductName

CustomerId

ProductCode

ERPNumber (correct)

Which of the following tables are created by the LookupInfo preprocessor?

ProductLookup, CustomerLookup, MiscLookup Signup and view all the answers

What potential risk is associated with using the LookupInfo processor?

It sends all customers and products, which can be excessive. Signup and view all the answers

When should you use the 'None' option in the preprocessor list?

When there is no need for a preprocessor Signup and view all the answers

What method is called to indicate failure of an integration job?

siteConnection.ProcessIntegrationJobFailure() Signup and view all the answers

What kind of integration jobs does the Integration Framework typically utilize?

Jobs with predefined natural keys from the source system Signup and view all the answers

Which clause in an SQL statement gets replaced if there are step parameters?

Where clause Signup and view all the answers

What is the role of the WindowsIntegrationBroker.ProcessJob method?

It handles the IntegrationJobDefinitionStep processing. Signup and view all the answers

Which of the following actions does the CleanupD step perform?

Deletes all archived datasets older than the specified RetentionDays. Signup and view all the answers

What flexibility does the IJobPreprocessor interface offer to developers?

It lets developers populate the IntegrationJob object uniquely. Signup and view all the answers

In which scenario is the 'None' step name used?

When no logic is needed on the integration server. Signup and view all the answers

What does the SourceMask in the FileUpload step represent?

The criteria used to select files with specific patterns. Signup and view all the answers

What is returned by each IntegrationJobDefinitionStep?

A DataSet. Signup and view all the answers

What must be true about the DeleteSourceFilesOnCopy parameter in the FileUpload step?

It can only be set to True or False. Signup and view all the answers

What must the Columns clause specify when reading from a flat file source?

All columns to be read from the file Signup and view all the answers

What does the RemoteServerUrl parameter allow you to do?

Override the default location for the API call Signup and view all the answers

What is a key feature of the OdbcQuery structure?

It can utilize a parameterized where clause. Signup and view all the answers

How does the OleDbQuery correspond to OdbcQuery?

They are constructed in the same way as OdbcQuery. Signup and view all the answers

What will happen if the flat file source does not match the specified columns?

The system will error out. Signup and view all the answers

When is the parameterized where clause invoked in an OdbcQuery?

When a step parameter is provided in the integration job. Signup and view all the answers

What is unnecessary when defining columns in a flat file according to the content?

Providing titles for the columns Signup and view all the answers

What kind of data sources does the OleDbQuery connect to?

Remote Ole data sources Signup and view all the answers

What is the purpose of the 'BaseUrl' in the context of the product feed integrations?

To set the base URL for the site. Signup and view all the answers

What action does 'RebuildProductSearchIndex' perform?

It performs a full re-index of the product search index. Signup and view all the answers

What does the 'RefreshDynamicCategories' function do when the 'RefreshSearch' parameter is set to true?

It regenerates all dynamic categories and rebuilds the search index. Signup and view all the answers

What is the role of the 'ReturnDataSet' function in integration jobs?

To set the ResultDataSet with data returned from the integration processor. Signup and view all the answers

How does the system ensure that records are uniquely written into a delta dataset?

By utilizing a hash key based on the select clause and parameters. Signup and view all the answers

What is a limitation mentioned regarding field mapping drop-down boxes?

Some field mappings need to be entered manually due to system defects. Signup and view all the answers

What interface must developers implement for creating custom postprocessors?

IPostprocessor Signup and view all the answers

How are 'From' and 'To' fields in field mapping defined?

They are relative to the job type being executed. Signup and view all the answers

What does the 'From' property represent in a refresh job?

Data in the ERP or other back end system Signup and view all the answers

What type of field type allows for populating a static value for all records?

StaticValue Signup and view all the answers

In a submit job, what does the 'To' property represent?

Configured commerce object model Signup and view all the answers

How is the natural key utilized in the Lookup field type?

It is formed by multiple tiered lookups Signup and view all the answers

What specifies a relationship to a child collection in the field types?

ChildCollection Signup and view all the answers

For the Content field type, how must additional parameters be structured?

In exact order with commas as separators Signup and view all the answers

What is the role of the ApplicationSetting field type?

To populate 'To Property' from application settings Signup and view all the answers

Which field type can handle multi-level lookups?

Lookup Signup and view all the answers

Study Notes

Integration Jobs Lifecycle

An integration job consists of three components: Preprocessor, Integration Processor, and Postprocessor.
Integration jobs are executed through the IWebServiceHandler.GetIntegrationJob method.
Use siteConnection.ProcessIntegrationJobFailure(integrationJob.Id.ToString(), message); to fail an integration job.

Preprocessors

Preprocessors prepare the data before it's processed.
The GenericSubmit preprocessor populates the initial dataset with values from the object.
The LookupInformation preprocessor creates tables in the IntegrationJob.InitialDataSet for product, customer and user profile lookups.
The SqlQuery preprocessor creates a SQL statement based on provided values for Select, From, Where and Parameterized Where clauses.
Developers can create custom preprocessors by implementing the IJobPreprocessor interface.

Integration Processors

Integration processors are responsible for interacting with the external system.
Processors are called by the WindowsIntegrationBroker.ProcessJob method.
Each Integration Processor returns a DataSet for each IntegrationJobDefinitionStep of the IntegrationJob.
These DataSets are merged into the ResultsDataSet and sent back to the Configured Commerce Website.
The None processor is used when no processing is required.
The CleanupDataSets processor deletes archived datasets that are older than a specified retention period.
The FileUpload processor transfers files from the integration server to the web.
The FlatFile processor reads data from flat file sources like CSV, XLS, or XLSX.
The OdbcQuery processor connects to a remote Odbc Datasource and retrieves data.
The OleDbQuery processor connects to a remote Ole Datasource and retrieves data.
Predefined processors are available for integration with specific third-party partners, including ProductFeedBazzaarVoice, ProductFeedCertona, and ProductFeedMonetate.
The RebuildProductSearchIndex processor performs a full re-index of the product search index.
The RefreshDynamicCategories processor regenerates dynamic categories and can optionally rebuild the search index.
The ReturnDataSet processor sets the IntegrationJob.ResultDataSet to the DataSet returned from the integration processor.
Custom postprocessors can be created by implementing the IPostprocessor interface.

Field Mapping

The Field Mapping tab allows mapping source data to destination data through objects.
Mapping is done by specifying field type, source property, destination property, overwrite, and dataset key values.
Delta datasets use a hash key containing select clauses and step parameters to compare datasets.
The dataset key ensures unique record identification within the dataset.
Some field mappings require manual entry.
The "From" property indicates the data source (ERP or other back-end system for refresh jobs, Configured Commerce object model for submit jobs).
The "To" property represents the destination of the data (Configured Commerce object model for refresh jobs, ERP or other back-end system for submit jobs).
Supported field types include:
- Field for mapping data from source to destination.
- StaticValue for mapping a static value to the "To Property".
- ApplicationSetting for mapping from an application setting to the "To Property".
- Lookup for mapping a parent object based on a natural key.
- ChildCollection for specifying the relationship to a child collection.
- Content for creating content in the "To Property".

Studying That Suits You

Use AI to generate personalized quizzes and flashcards to suit your learning preferences.

Description

Explore the essential components of integration jobs, including preprocessors, integration processors, and postprocessors. Understand the flow of data and how to manage job failures through specific methods. This quiz offers insight into custom development of preprocessors and integration processing.