How to do an incremental load by ID

Modified on Tue, 23 Aug 2016 at 10:15 AM

This process can work for both Microsoft SQL Server & Oracle.  There are separate attachments for each of these.


Steps to Implement Incremental Load by ID

1. Create a custom procedure (code attached)

    update_last_seq_id_parameter


2. In load table job description enter something like this:

Where accountid is the column name of the sequential id.


3. In Where Clause (Source) add:

    (NOLOCK)

    WHERE accountid > $Pload_accounts_accountid$


4. Create a parameter:

    name: 'yourloadtable_yourid'

    value: some id

    comment: Last MAX accountid Processed


5. In your job:

    ……Some tasks…..

    execute update_last_seq_id_parameter (attached) this will capture the MAX accounted and will use it in the WHERE clause during next run

Was this article helpful?

That’s Great!

Thank you for your feedback

Sorry! We couldn't be helpful

Thank you for your feedback

Let us know how can we improve this article!

Select atleast one of the reasons

Feedback sent

We appreciate your effort and will try to fix the article