There are two parameters in Oracle Data Integrator topology that can be tweaked to improve performance of loading. These two parameters are,
- Array Fetch size
- Batch Update size
The Array Fetch size parameter can be tweaked for the source data server. This defines the number of records read from the source at a time and this data is stored in the agent.
The Batch Update size parameter may be tweaked for the target data server. This defines the number of records fetched in one batch to be written to be server stored in the agent.
When you increase number of records per batch, the time taken to read and write the total records will be less. This would mean you have lesser batches in total, hence improving performance. Since more data is stored in RAM, a good RAM size would be a necessity.
Oracle recommends the following,
- For good networks with little latency values less than 30 can be kept. However with a poor network the parameters have to be set as greater than 100.
- The typical values as per oracle is between 50 and 500.
Recommendation from Oracle ODI Performance tuning documentation. |
Here is a very interesting read on how this parameter if optimally set improves performance.
Thank you Athul, Really useful.
ReplyDelete