Scheduling

Warning

Visit RudderStack Docs for more up-to-date information on the new UI and Activation API.

By making your PB Project as a GIT Repository, you can seamlessly collaborate with your teammates, with modular control over your model files. Check out this link on making your project available as a git repository.

Prerequisites

  1. You should have already created a GIT Repository from your PB project.

  2. We recommend using a different target schema and user for profiles for RudderStack cloud than the one used for CLI. This will maintain isolation of manual runs using CLI and those by RudderStack cloud.

../_images/DifferentSchemasWebCLI.png

Different target schema in web app (left) and CLI (right).

Configure Web App

Follow these steps to configure Profiles from the RudderStack web app:

  1. Login to RudderStack web app.

../_images/WebApp-Login.png

RudderStack Web App

  1. On the left side navigation bar, click on ‘Enhance’, then ‘Profiles’.

../_images/WebApp-Menu.png

Profiles on left sidebar

  1. On top right, click on the button ‘New Profile’.

../_images/WebApp-Create-Project.png

Create New Profile

  1. Enter the Profile name and description (optional), then click on the button “Done” to save changes.

../_images/WebApp-Add.png

Enter Profile Name and Description

  1. Next, enter the GIT Repo SSH URL.

../_images/WebApp-Add_2.png

Add GIT Repo URL

  1. Please select the warehouse (Snowflake or Redshift) and enter data warehouse credentials. Say you selected Snowflake, so please enter Profile, Account, Warehouse Name, Database, Schema, User, Password and Role.

../_images/WebApp-Add_3.png

Add Warehouse Credentials

  1. Now you can define the interval at which to automatically run the profile, using one of these scheduling options:

    Basic: If you want to run on a fixed set of intervals.
    Cron: If you want to run on, say, every 15 minutes or 1 hour, etc. Click here to know more.
    Manual: Select this if you want to manually trigger a run every time.
../_images/WebApp-Basic.png

Basic Scheduling

../_images/WebApp-Cron.png

Cron Scheduling

  1. Specify Retention time period in Days or Hours. This will retain all the materials created on warehouse within that time frame, when you do next run of the profile. Say you set this to 1 day, then after your profile has been run then it’ll check for materials older than 1 day and will clean them up.

../_images/WebApp-Retention.png

Define Retention Policy

  1. Click on the “Create” button at bottm right to create the profile.

../_images/WebApp-Create.png

Create Profile

  1. You will get a SSH key. Please copy, as it will not be visible later. Then, paste on your GIT Repo (see section Associating SSH Key to Git Project).

../_images/WebApp-SSHKey.png

Copy SSH Key

  1. After creating the profile, you can manually trigger its run by clicking on the Run button in top right.

../_images/WebApp-Project-Details.png

Profile details

  1. Click on “History” to see the list of all previous runs. Use filters to narrow down dates.

../_images/WebApp-Run-Instance.png

List of all instances the Profile was run

  1. If any error message is there then it’ll be displayed on screen when you click on “Error” in the list.

  2. Artifacts are SQL file(s) that were created and run on the warehouse. You will get folder-wise artifacts by clicking on the + button before the timestamp, showing when it was run.

../_images/WebApp-Artefacts.png

Artifacts folder

../_images/WebApp-Artefacts-1.png

List of artifacts

  1. To edit a profile, click on Settings and then click on the Pencil icon next to a section to edit it.

../_images/WebApp-Settings-Edit.png

Edit a Profile

  1. You can define multiple profiles.

../_images/WebApp-Project-List.png

Profiles list