Data can be imported into your aiWARE account using a series of rules, including where you would like to pull the data from, when you want the data to be imported, and what type of AI processing you would like the data to be processed with. Within your Data Center Utility, you can create and manage your Data Sources and their individual schedules for ingestion.

Please note that your account has been provisioned with Data Sources that are relevant to your business use case. This includes the use of specific AI Engines to process this imported data.

Creating a New Source

The first step in creating scheduled data importing is to create the Data Source in which the data is imported from.

Basic Source Configuration

  1. Name your Source

  2. Navigate to your Data Center Utility available in your right-hand Utility Bar

  3. Click the New button at the top right of your Data Center window.

  4. Click the Source menu item

    1. The New Source Panel will open

  5. Select the Source Type from the dropdown you wish to import data from

    1. Note that depending on your source selection, the required information will change

  6. Complete the required information for the Data Source

Content Templates (Optional)

If you would like to add additional structured metadata to each file that is imported via a source, the Content Template tab allows you to do so.

  1. Click the Content Template Tab

  2. Select your desired Content Template that has been created for your Organization by clicking the + icon

  3. Complete the Content Template Form data

Click the Create button to create your new Source. This source will now be available from the Source navigation item inside your Data Center.

Creating a Scheduled Job

Upon creating your Data Source, you can now add a schedule to import data from this source.

  1. From Data Center, click the New button at the top right of your window

  2. Click Schedule Job

    1. The New Ingestion Job Panel will open

  3. Select the corresponding Adapter Card for your source

Configuration:

  1. Choose your Source from the Select a Source dropdown

  2. Click the Next Button

Program Info (Radio and TV Data Sources Only)

This step in the Schedule Creation wizard only applies to Radio and TV Data Sources

  1. Fill out all required information for the Program Information step

Schedule:

The scheduling step allows you to choose how often you would like to import data from this source.

Recurring

A recurring schedule allows you to set the hour, day, or week in which the data in imported into your account.

Continuous

A continuous schedule will import data from the source until the end date and time are reached.

Note that the supported schedule types available are based on your data source

Once your schedule is configured click the Next Button.

Processing:

When your account was provisioned, a Veritone customer representative will configure your available AI Packages based on your processing needs. Each AI Package represents a discrete set of AI engines and settings for your data processing needs.

Note that if your AI Package dropdown is empty or does not contain the required AI Engines, please reach out to our customer service team immediately.

Select your desired AI Package from the dropdown and click the Next button.

Content Templates

If you would like to extend each piece of data that is imported using this schedule, the Content Template tab allows you to include this additional structured metadata on each file.

  1. Select your desired Content Template that has been created for your Organization by clicking the + icon

  2. Complete the Content Template Form data

  3. Click the Next Button

Customization

The last step of this process allows you to name the schedule, choose the folder in your Data Center account that the files will be organized within and add additional tags to any imported data for this Scheduled Job.

Click the Save button to create your new Schedule.

Upon creating your Schedule you can view this Data Source and Schedule from the Sources section of your Data Center utility. Each Source will be listed in the Source Section, and simply click on each source to view their associated schedules, and click on each schedule to view associated imported data.


Did this answer your question?