DronaBlog

Tuesday, July 3, 2018

What are the MDM Best Practices for Working With Batch Jobs?


In this article we will see different Informatica MDM Best Practices for Batch Jobs. This article gives  the overall idea about various points to be taken into account while running Batch Jobs such as Stage Jobs, Load Jobs, Match Jobs, Merge Jobs.


  1. Schema : The very first point is to create the proper schema as per the business requirement. The schema is very important for any activity in Informatica MDM Hub. If the schema is not present then there is nothing to do with any batch job.
  2. Parallel Processes : In order to avoid issues with the MDM Hub related to the processes, limit the number of parallel processes. If more parallel processes are created then it will lead to insufficiency in the resources. 
  3. Mappings in the Stage Jobs : Define mapping first before running stage jobs. Mappings are used to perform the transformation of data in the stage tables.
  4. Match Rules : Define the match rules before running the Match Jobs. If no match rules are set then there will not be match records found after the Match Job is run.
  5. Production Jobs :
  • Before running any production batch jobs, run the test with small data sets.
  • Run the individual component such as the cleanse engine component to determine whether each component is working properly or not.
  • After the individual component test is successful, integrate all the components and test the entire module with the sample data and check whether everything is working well or not.

The major points above need to be considered while running the Batch Jobs in MDM Hub.





How to handle NoSuchMethodException exception

Scenario : 
The exception - NoSuchMethodException occurs if the setter or the getter method does not present in classes created during the WSDL skeleton or the client generation.

public class ElectronicAddressRequest {
    protected List<ElectronicAddressSO> electronicAddress;

    public List<ElectronicAddressSO> getElectronicAddress() {
        if (electronicAddress == null) {
            electronicAddress = new ArrayList<ElectronicAddressSO>();
        }
        return this.electronicAddress;
    }


Here is what the ElectronicAddressSO class looks like below :

public class ElectronicAddressSO {

    protected String electronicAddress;
    protected String electronicAddressType;

    public String getElectronicAddress() {
        return electronicAddress;
    }

     public void setElectronicAddress(String value) {
        this.electronicAddress = value;
    }

     public String getElectronicAddressType() {
        return electronicAddressType;
    }

     public void setElectronicAddressType(String value) {
        this.electronicAddressType = value;
    }

}

In the above code, the setter method is not created for the ElectronicAddressRequest if you use the wsdl2j tool to create the skeleton.

Error  :

When you try to run the application you will get the error below.

weblogic.wsee.jaxws.framework.policy.advertisementimpl.AdvertisementHelperImpl registerExtension
WARNING: Registering oracle.j2ee.ws.wsdl.extensions.addressing.AddressingExtensionRegistry extension failed; java.lang.NoSuchMethodException: oracle.j2ee.ws.wsdl.extensions.addressing.AddressingExtensionRegistry.registerSerializersAndTypes(com.ibm.wsdl.extensions.PopulatedExtensionRegistry)
Mar 11, 2015 12:22:12 PM weblogic.wsee.jaxws.spi.WLSServiceDelegate addWsdlDefinitionFeature
SEVERE: Failed to create WsdlDefinitionFeature for wsdl location: http://rmv-eap-spr-d11.ddc.dot.state.ma.us:57453/MARMV_MainFrame_Provider/LicenseUpdateService?wsdl, error: com.sun.xml.ws.wsdl.parser.InaccessibleWSDLException, message: 2 counts of InaccessibleWSDLException.


Solution :
In order to handle this error, add the method below in the ElectronicAddressRequest class :


public void setElectronicAddress(ElectronicAddressSO oElectronicAddressSO) {
        if (null != electronicAddress) {
            electronicAddress.add(oElectronicAddressSO);
        } else {
            List<ElectronicAddressSO> listContactInformation = new ArrayList<ElectronicAddressSO>();
            listContactInformation.add(oElectronicAddressSO);
            this.electronicAddress = listContactInformation;
        }
    }

Monday, July 2, 2018

How to configure JMS in Informatica MDM Hub?

Are you looking for an article to better understand the configuration of JMS in Informatica MDM 9.7, 10+ version with JBOSS-eap-6.2.0? This article will explain the step by step procedure to configure JMS in the MDM Hub console and the JBOSS configuration files.

Step 1 : JMS configuration in JBOSS Configuration files
 The configuration file used for the JMS queue configuration is "standalone-full.xml". This file is present at the location - Installation directory\jboss-eap-6.2\standalone\configuration. Open this file and include the code below to add the new queue to the JBOSS server.

<jms-destinations>
      <jms-queue name="queue/siperian.sif.jms.queue">
             <entry name="queue/siperian.sif.jms.queue" /> 
             <entry name="jboss/exported/queue/siperian.sif.jms.queue" /> 
      </jms-queue>
      <jms-queue name="queue/OutboundQueue">
            <entry name="queue/OutboundQueue" /> 
            <entry name="jboss/exported/queue/OutboundQueue" /> 
      </jms-queue>
</jms-destinations>

Step 2 : Start the JBOSS server
Use the command below to start the Jboss server.

standalone.bat -c Standalone-full.xml -b 0.0.0.0 -bmanagement 0.0.0.0

Step 3 : MDM Hub Configuration 
a)  Queue Configuration :
      1. The JMS queue server configuration -
         Right click on the Message Queues and select "Add Message Queue Server". Use the Connection Factory Name as siperian.mrm.jms.xaconnectionfactory. Also enable the "Data Changes Monitoring". If it is not enabled then use the button "Toggle Data Changes Monitoring Status" to change from disabled to enabled.

 Fig 1: JMS queue server configuration

    2. The JMS queue configuration -
       Right click on the connection factory configured and select "Add Message Queue". Use the Queue name which configured in  "standalone-full.xml" file. i.e. jboss/exported/queue/OutboundQueue. Select the radio button Use with message triggers. After configuration is completed, test the queue connection by using the Test button provided at the bottom of the right panel. 

 Fig 2: JMS queue configuration

  3. The JMS queue - SIF Manager configuration -
      Select the SIF Manager and press the button "Generate and Deploy ORS Specific Schema". After pressing this button, Schema Url will be populated. Check if any out of sync objects are present in the ORS by pressing "Find Out of Sync Objects" button. 


Fig 3 : JMS Queue configuration in SIF Manager



   4. Set the Triggers for the Base object : 

       Create the triggers for the base object and select the appropriate events for it.

  
Fig 4 : Trigger configuration for Base Objects

Once you have completed all of the above configuration the queue is ready for use. The message will be sent on the queue whenever the event is triggered.

How to Clean Java Cache for Informatica MDM hub application

This article elaborates how to clear the Java Cache. I have encountered several situations where the MDM Hub application is unable to launch. Sometimes it launches but it isn't possible to see the content on the Hub console. In all such cases the temporary files and the Java Cache must be removed.

Below are the three main steps which need to be performed.

A. Remove temporary files and cookies from the browser.
You can go to the internet browser setting and clear its temporary files and cookies.

B. Clear your Java cache in Windows:
In order to clear Java Cache follow these steps:
1. Below are the steps as per the operating system:
      1.1 Windows 7/Vista: Click on Start > Control Panel
      1.2 Windows 8: On the Start screen, type Control Pane and  then click the Control Panel icon
2. Select the Java icon present on the window and open it. You can locate the Java icon on the window as below: 
     2.1 Select Programs. Then click the Java icon.
     2.2 Enter Java in the search box which is available in the upper-right corner of the Control Panel window. After providing Java in the search box press the Enter button. 
    2.3 After that double-click Java 32-bit to open it.
3. Select the Settings button under Temporary Internet Files on the General tab of the dialog.
4. Select Delete Files and the Delete Temporary Files window appears. Make sure all boxes are selected with check marks and click OK.
5. Click the OK button again.
6. Click the OK button again to close the Java Control Panel window.

C. Clear Java Applications:
1. Use command 'javaws -viewer' to view the applications which are accessing Java.
2. Remove the application available on the Java Viewer.
3. Clear the browser history.
4. Restart the system.

I hope this article is helpful if you face a similar kind of issue in your MDM hub application. Below is a good video which explains the Informatica MDM Hub.



How to handle OutOfMemoryErrors in Eclipse

Are you getting OutOfMemoryErrors in your Eclipse development tool and looking for a solution for this? If yes, then you have reached the correct place. This article provides important information for handling OutOfMemoryErrors in the Eclipse environment. 

Allocating enough memory and solving OutOfMemoryErrors
  • By default, Eclipse will allocate up to 384 megabytes of Java heap memory. 
  • This should be ample for all typical development tasks. 
  • However, depending on the JRE that you are running, the number of additional plug-ins you are using, and the number of files you will be working with, you could conceivably have to increase this amount. 
  • Eclipse allows you to pass arguments directly to the Java VM using the -vmargs command line argument, which must follow all other Eclipse specific arguments. 
  • Thus, to increase the available heap memory, you would typically use:

eclipse -vmargs -Xmx<memory size>
       with the <memory size> value set to greater than "384M" (384 megabytes -- the default).

What is PermSize?
  • When using an Oracle JRE, you may also need to increase the size of the permanent generation memory. 
  • The default maximum is 64 megabytes, but more may be needed depending on your plug-in configuration and use. 
  • When the VM runs out of permanent generation memory it may crash or hang during class loading. 
  • The maximum permanent generation size is increased using the -XX:MaxPermSize=<memory size> argument:

eclipse -vmargs -XX:MaxPermSize=<memory size>


  • This argument may not be available for all VM versions and platforms; consult your VM documentation for more details.

Note: Setting memory sizes to be larger than the amount of available physical memory on your machine will cause Java to "thrash" as it copies objects back and forth to virtual memory, which will severely degrade your performance.


Sunday, July 1, 2018

Learn Informatica Master Data Management - MDM in easy steps

Are you interested in pursuing a career in Informatica Master Data Management (MDM) and looking for material on it? Or do you just want to learn this new technology/tool? Then you have reached the right place. This article provides information about how to start learning Informatica MDM, its prerequisites, etc. 

Who can learn Informatica MDM?
Any IT professional, business analyst, or college student can learn Informatica MDM. However, it is always good to have technical knowledge in the IT industry before starting to study Informatica MDM. Often business analysts and data stewards learn MDM to better understand the benefits and the constraints of the MDM tool. ETL (Extract Transform and Load) developers learn MDM technology to understand downstream for ETL and also to pursue a career in MDM.

What are the prerequisites?
  • A good computer system or laptop with at least 8 GB RAM and a good processor are essential. The MDM tool is an application requiring sufficient memory. 
  • Basic knowledge of application servers such as Weblogic, Websphere, or Jboss are required.
  • Basic understanding of the Java Technology will be helpful to learn customization of the MDM tool.
  • Other additional tools such as SOAP UI, SQL Developer, Eclipse, Notepad ++, etc. will assist you to work more efficiently with the MDM tool.

How is the Informatica MDM Tool installed?
In order to install the Informatica MDM tool a license must be purchased from Informatica. There is no free version of the Informatica MDM tool. Once the license and installers are obtained the installation guide available on the Informatica website can be used.  Below are three main steps involved during the installaton:
  1. Installation of the Oracle database and the creation of the CMX_SYSTEM and the CMX_ORS schema
  2. Installation of the application server (Weblogic or Websphere or Jboss)
  3. Installation of the MDM hub Server and the Process Server; Resourcekit is optional.
Learn MDM free online?
Many training institutes provide instruction about Informatica MDM but this can be expensive. However, you can still learn MDM through Youtube video channels or material available on the Informatica website. Below is a good video where you can start your studies about MDM.

Informatica Master Data Management Interview Questions and Answers

Are you preparing for the Informatica MDM interview? Are you interested in knowing the questions normally asked during such an interview? Are you also looking for answers for MDM interview questions then you have reached the right place. This article provides detailed information about the Informatica MDM interview and questions. Good luck with your interview!

How to prepare for the Informatica MDM interview?
Everyone would like to pursue a good career in the IT industry. Informatica MDM is at its peak so most of the MDM consultants earning decent salaries. If you are also interested in growing your career in MDM then
1. Study MDM properly. You can refer MDM documents and online videos.
2. Practice with the Informatica MDM tool, Informatica Data Director, Provisioning Tool, and Active VOS.
3. Various interview question and answers are available online which you will see below in this article.

Do we need to prepare for IDD, SIF, and Active VOS?
The answer is yes. Nowadays Informatica MDM is competitive. The MDM market is doing well and is looking for outstanding candidates with significant experience in customization. So whenever customization occurs IDD, SIF, and Active VOS come into the picture. So it is good to have knowledge on Informatica Data Director (IDD), Services Integration Framework (SIF) and Active VOS.

How to start Preparation for the MDM Interview?
If you are done with basic studies and looking for online material to prepare for the interview then I would recommend several youtube videos on this topic. Below is one of the videos on Informatica MDM interview questions and answers. It presents basic MDM hub topics such as tokenization,  match and merge process, Informatica Data Director and SIF. This video also provides various interview questions on stage jobs, load jobs, and customization.



How to prepare documents MDM Interview?
We work on many MDM projects over the period of time. Which might leads to loose track of what versions of MDM on which worked or what are the technologies used in the project. So it is good idea to document it and keep updating it. Here is video which will help you for preparation of such document. Such document will be handy during preparation for MDM interview.


What are the Core Principles of Data Governance and How to Achieve Them?

  In today's data-centric world, organizations are overwhelmed with vast volumes of data flowing from systems, apps, devices, and extern...