TargetSmart Automation Workflows

In addition to the TargetSmart Developer API, TargetSmart also provides a solution for executing custom data processing workflows that TargetSmart implements for specific client needs. The TargetSmartAutomation class can be used to execute these workflows for common purposes such as customized list matching workflows. Workflow execution can take minutes to hours depending on the workflow type, size of data, and queuing.

Authentication

TargetSmart Automation workflows use SFTP. You will need to obtain SFTP credentials from TargetSmart to utilize TargetSmartAutomation.

Quickstart

To instantiate TargetSmartAutomation, you can either store your SFTP username and password as the environmental variables TS_SFTP_USERNAME and TS_SFTP_PASSWORD, or pass them in as keyword arguments. Credentials for your account are provided by TargetSmart.

Store SFTP username and password as environmental variables

from parsons import TargetSmartAutomation
ts_auto = TargetSmartAutomation()

Pass SFTP username and password as arguments

# DO NOT store password literals in your source code.
from parsons import TargetSmartAutomation
ts_auto = TargetSmartAutomation(
    sftp_username='my_sftp_username', sftp_password='my_sftp_password'
)

You can then call class methods:

input_table = Table.from_csv('my_file_to_match.csv')

# Execute a custom workflow that TargetSmart has provisioned for you. This
# blocks until completion and may take minutes/hours depending on the data size
# and workflow type
output_table = ts_auto.match(
    input_table,
    'workflow_name_provided_by_targetsmart',
    'my_job_name',
    emails=['bob@example.com'],
)

# Most Automation workflows perform list matching, but not all.
# The :meth:`~TargetSmartAutomation.execute` method is an alias for the
# :meth:`~TargetSmartAutomation.match` method to avoid confusion in these cases.
# This is the equivalent to the above
output_table = ts_auto.execute(
    input_table,
    'workflow_name_provided_by_targetsmart',
    'my_job_name',
    emails=['bob@example.com'],
)

# Optionally check the status of a workflow execution
ts_auto.match_status(job_name='my_job_name')

# Optionally remove all files for the match job. TargetSmart's lifecycle rules
# will remove eventually if not.
ts_auto.remove_files(job_name='my_job_name')

API

class parsons.targetsmart.targetsmart_automation.TargetSmartAutomation(sftp_username=None, sftp_password=None)

• Automation overview

• Automation integration doc

match(table, job_type, job_name=None, emails=None, call_back=None, remove_files=True)

Submit a file for custom data processing using the TargetSmart Automation workflow solution.

Warning

Table Columns

Each Automation workflow expects an input file that meets the layout requirements provided by TargetSmart. The number of columns and column order is significant. So, if it expected 10 columns and you only provide 9, it will fail. However, if you provide 10 columns that are out of order, the job may succeed, but with non-optimal results. You can obtain the layout requirements and other information about a workflow by visiting the Automation console in My TargetSmart. Contact TargetSmart Client Services for support.

Parameters:

• table – Parsons Table Object A table object with the required columns. Each workflow type requires the input file to meet the requirements provided by TargetSmart. You can locate the input and output layouts for your available workflows using the My TargetSmart Automation console.

• job_type – str The workflow name to execute. This is case sensitive.. You can locate the workflow names and other information by visiting the Automation console in My TargetSmart.

• job_name – str Optional job execution name.

• emails – list A list of emails that will received status notifications. This is useful in debugging failed jobs.

• call_back – str A callback url to which the status will be posted. See TargetSmart documentation for more details.

• remove_files – boolean Remove the configuration, file to be matched and matched file from the TargetSmart SFTP upon completion or failure of match.

execute(*args, **kwargs)

Most Automation workflows perform list matching. However, it is possible that a custom workflow might be provisioned for a client for other types of file processing. The execute method is provided as an alias for the match method which may be a confusing name in these cases.