Tag Archive for: ODI

Oracle Data Integrator Cloud Service (ODICS) – PART 2

Oracle is one of the prominent leaders in providing comprehensive data integration solutions that includes Oracle Data Integrator Cloud Service (ODICS), Oracle Data Integration Platform Cloud, Oracle Golden Gate, Oracle Enterprise Data Quality, Oracle Enterprise Metadata Management, and Oracle Stream Analytics.  ODICS provides continuous access to timely, reliable and heterogeneous data from both on-site and cloud solutions to support analytical and operational business needs.

 

New key investment areas ensure Oracle Data Integrator Cloud Services continues to support clients during their business growth and transformation process. ODICS introduces new functionality in the following areas:

 

Oracle Object Storage and Oracle Object Storage Classic

  • Oracle Object Storage and Object Storage Classic provide fast, stable and secure cloud storage and now ODICS will integrate Oracle Cloud Infrastructure (OCI) seamlessly with them.
  • ODICS comes with a collection of Knowledge Modules (KMs) that can be used to link to Oracle Object Storage and Object Storage Classic in Mappings and Packages to manage files within the local archive or the Hadoop Distributed File System (HDFS).

 

ODI Object Storage

Figure 1 ODI Object Storage

 

Autonomous Databases

  • ODICS now comes with optimized Loading and Integration Knowledge Modules (KMs) that are certified with Oracle Autonomous databases such as:
    • Oracle Autonomous Data Warehouse Cloud (ADW)
    • Oracle Autonomous Transaction Processing (ATP)
  • ODICS works easily with ADW and ATP to achieve better performance in a fully managed environment that is configured for specific workloads by integrating with Autonomous Databases.
  • Both ADW and ATP use the same set of Knowledge Modules and utilize the updated native integration of Oracle Object Storage and Oracle Object Storage Classic.
  • Additionally, Oracle Data Integrator users can also use native integration between Oracle Autonomous Data Warehouse and Oracle Object Storage to allow fast data transmission to ADW or ATP and simplify the entire loading process.

 

ODI Autonomous Data Warehouse

Figure 2 ODI Autonomous Data Warehouse

 

 

Oracle Enterprise Resource Planning (ERP) Cloud

  • The new release also provides a new Infrastructure and Software Platform for Oracle Enterprise Resource Planning (ERP) Cloud, a suite of cloud apps for accounting, project management, sourcing, risk management, and operations.
  • ODICS works seamlessly into the Oracle Enterprise Resource Management (ERP) platform which allows companies to incorporate their ERP data into their data warehouses, data marts. The native application also lets ODICS customers load data into Oracle’s ERP Cloud.

 

ODICS ERP

Figure 3 ODICS ERP

 

 

In the next post, we will discuss more key features such as Oracle Sales Cloud, Oracle Service Cloud, GIT Offline Support, and SAP Delta Extraction.

 

 

Oracle Data Integrator Cloud Service (ODICS) – PART 1

Oracle is one of the prominent leaders in providing comprehensive data integration solutions that includes Oracle Data Integrator Cloud Service (ODICS), Oracle Data Integration Platform Cloud, Oracle Golden Gate, Oracle Enterprise Data Quality, Oracle Enterprise Metadata Management, and Oracle Stream Analytics.  ODICS provides continuous access to timely, reliable and heterogeneous data from both on-site and cloud solutions to support analytical and operational business needs.

ODICS Overview:

  • ODICS provides high-performance data transformation capabilities with its transparent E-LT architecture and extended support for cloud and big data applications.
  • ODICS supports all the features included in Oracle Data Integrator Enterprise Edition within its’ heterogeneous cloud service.
  • ODICS provides an easy-to-use interface to improve productivity, reduce development costs and decrease the total cost of ownership.
  • Oracle Data Integrator Cloud Platform is fully integrated with Oracle Process as a Service (PaaS) platform, such as Oracle Database Cloud Service, Oracle Database Exadata Cloud Service and/or Oracle Big Data Cloud Service to deliver data needs.
  • ODICS can work with third-party systems as well as Oracle solutions as shown in the below screenshot.
ODI On-Premises Integration with Cloud Services

ODI On-Premises Integration with Cloud Services

 

Cloud E-LT Architecture for High Performance vs Traditional ETL Approach:

  •  Traditional ETL software is based on proprietary engines that execute row by row data transformations, thus limiting performance.
  • We can execute data transformations on the target server by implementing an E-LT architecture based on your existing RDBMS engines and SQL.
  • The E-LT architecture gathers data from different sources, loads into the target and performs transformations using the database power.
  • While utilizing existing environment data infrastructures, Oracle Data Integrator delivers flexibility by using target server for data transformations thereby minimizing network traffic.
  • The new E-LT architecture ensures the highest performance possible.
ODICS ELT vs ETL Architecture Differences

ODICS ELT vs ETL Architecture Differences

 

Oracle Data Integrator Architecture Components:

The Oracle Data Integrator (ODI) architecture components include the below feature sets.

 

ODI SDK Java-based API for run time and scheduling Operations.
ODI Studio Designers’ studio to manage connections, interface designs, development, and automation including scheduling.
ODI Standalone Agent It can be configured in a standalone domain and managed by WebLogic Management Framework.
ODI J2EE:

 

This is the Java EE agent based on the Java EE framework that runs on a WebLogic domain a Managed Server configured in a WebLogic domain. This feature set only comes with Enterprise Installation.
ODI Standalone Agent Template Domain files that are required when Oracle WebLogic Server is not handling your Oracle Data Integrator installation. This feature set is accessible only with the type of Standalone Install.
ODI Console As an alternative to certain features of ODI Studio, we can access the web-based console available to assigned users.
FMW Upgrade This is the upgrade assistant used to upgrade the Oracle Data Integrator version from 11g to 12c.
Repository Creation Utility The Repository Creation Utility (RCU) is used to create database schemas and included with the Standalone Installation type. Enterprise Installation does not include RCU but RCU is included with the installation of Oracle Fusion Middleware infrastructure distribution.

 

ODICS Architecture

ODICS Architecture

 

New / Enhanced Big Data and Cloud Features within ODICS:

 ODICS continues to evolve with technological advancements for Big Data and Cloud Knowledge Modules for better transformations.

Big Data Features:

  • Spark Knowledge Modules (KM) Improvement: The emphasis was on producing high-performance, and easy-to-read code (Spark) instead of handwritten scripts. Spark KMs now leverage the latest features such as Dataframes from Apache Spark 2.x to speed up the ODI processes.
  • Spark KMs support in Knowledge Module Editor: The Spark KMs are now fully supported and can be customized as per specific needs.
  • Hadoop Complex Types Enhancements: ODI enhances its support capability to Apache HDFS and Kafka Architecture.
  • Big Data Configuration Wizard: The Big Data Configuration Wizard is now updated with new templates for the current Cloudera distribution.
Spark KMs In Knowledge Module Editor

Spark KMs In Knowledge Module Editor

 

Cloud Features:

  • RESTful Service Support: ODICS can invoke RESTful Service in Topology configurations that include RESTful Service connectivity, resource URI, methods, and parameters.
  • Business Intelligence Cloud Service (BICS) Knowledge Modules: BICS is now supported out of the box in ODICS.
  •  Connectivity with Salesforce: ODICS is fully certified with Salesforce.com and now includes a JDBC driver for this technology out of the box.
ODI Integration With Salesforce

ODI Integration With Salesforce

 

In the next part, we will focus on more key feature highlights within ODICS.