How to monitor what are users logged in to the Informatica Data Director Application?

Are you looking for an article on how to monitor IDD users? Are you also looking for information what changes need to be made in order to achieve it? If yes, then refer this article. This article explains what is need of user monitoring and how to configure it.

Introduction

The Informatica Data Director (IDD) is one of the business critical application. The various business users uses IDD application. It is always good idea to monitor users using the application for security reason. In lower environments such as development or QA, it become more tedious to  track who made the change. So having monitory control on login mechanism will try to avoid such incidents. This articles helps to configure IDD application for monitoring users who uses it.

Configuration file

We need to use log4j.xml file to log users which uses IDD application. We can use existing log file or can create new  log file.

File Location

We need to update log4j.xml file from below location

<install directory>\hub\server\conf

Code Changes

Add the code below after consoleappender code in the log4j.xml file

<!-- File appender for Login Tracker-->

    <appender name="loginAppender" class="org.apache.log4j.RollingFileAppender">

        <param name="File" value="/hub/server/logs/LoginTracker.log"/>

        <param name="MaxBackupIndex" value="5"/>

        <param name="MaxFileSize" value="500MB"/>

        <param name="Threshold" value="DEBUG"/>

        <layout class="org.apache.log4j.PatternLayout">

            <!-- The default pattern: Date Priority [Category] Thread Message -->

            <param name="ConversionPattern" value="[%d{ISO8601}] [%t] [%-5p] %c: %m%n"/>

        </layout>

    </appender>

    <!-- Added the following category to invoke the appender for Login Tracker -->

    <category name="com.siperian.dsapp.common.util.LoginLogger">

        <priority value="INFO"/>

     <appender-ref ref="loginAppender"/>

    </category>

    <!-- Added the following category to invoke the appender for Login Tracker of MDM-->

    <category name="com.siperian.sam.authn.jaas.JndiLoginModule">

        <priority value="INFO"/>

     <appender-ref ref="loginAppender"/>

    </category>

Server Restart

Normally application server restart is not required. However, if log file is not generated after above code changes then restart the application server.

How to analyze the log file

If user is logged in or logged out then this information will be stored in the log file. The log file entry will look like as below :

[2018-09-25 15:03:31,774] [http-/0.0.0.0:8080-5] [INFO ] com.siperian.dsapp.common.util.LoginLogger: User <admin> logged into IDD

[2018-09-25 15:04:14,255] [http-/0.0.0.0:8080-2] [INFO ] com.siperian.dsapp.common.util.LoginLogger: User <admin> has been logged out of the IDD"

[2018-09-25 15:04:14,329] [http-/0.0.0.0:8080-2] [INFO ] com.siperian.dsapp.common.util.LoginLogger: User <testuser> logged into IDD

[2018-09-25 15:05:16,295] [http-/0.0.0.0:8080-5] [INFO ] com.siperian.dsapp.common.util.LoginLogger: User <testuser> has been logged out of the IDD"

[2018-09-25 15:05:16,295] [http-/0.0.0.0:8080-5] [INFO ] com.siperian.dsapp.common.util.LoginLogger: User <admin> has been logged out of the IDD"

[2018-09-25 15:05:23,309] [http-/0.0.0.0:8080-6] [INFO ] com.siperian.dsapp.common.util.LoginLogger: User <jamesmanager> logged into IDD

[2018-09-25 15:06:32,365] [http-/0.0.0.0:8080-7] [INFO ] com.siperian.dsapp.common.util.LoginLogger: User <jamesmanager> has been logged out of the IDD"

The video below provides additional information about how to monitor users which are logged in the IDD Application.

Informatica Master Data Management - MDM - Quiz - 10

Q1. Match rule sets include which of the following

A. A search level that dictates the search strategy
B. Any number of automatic and manual match column rules
C. A filter to selectively include or exclude records from tha match batch
D. Match path for inter-table/Intra-table-matching

Q2. Which correctly describes master data??

A. Customer name
B. Customer address
C. Customer purchases
D. Customer preferences

Q3. A role is a set of privileges to access secure informatica MDM hub resources

A. True
B. False

Q4. Which statement best describes what the build match group(BMG) process does

A. Allows only a single "null to non-null" match into any group
B. Removes redundant matching
C. Executes in advance of the consolidate process
D. All statements are correct

Q5. What happens to records in the stage process that have structural integrity issues?

A. They are written to reject tables.
B. They are placed in the manager merge process
C. They are written to the raw table
D. They are added to the enhanced filtering process for resolution.

Previous Quiz             Next Quiz

Informatica Master Data Management - MDM - Quiz - 9

Q1. Which of these features are supported in Metadata manager?

A. The renaming of certain design objects.
B. Promoting record states.
C. Running a simulation of applying a change List.
D. Validate repository.

Q2. After configuration of the hub store which batch jobs are created automatically?

A. External Match jobs
B. Revalidate Jobs
C. Promote jobs
D. Synchronize jobs

Q3. When grand children are displyaed in table, view all grand children are deplayed not just those related to the selected child.

A. True
B. False

Q4. What does the trust frameWork do dynamically?

A. Defines whether two records will match
B. Maintains cell-level survivor ship of only the best attributes
C. Calculates a data quality score to be used on a data score card.
D. Standardizes data to make its most trustworthy form.

Q5. Which of the following is NOT an advantage of the MDM hub?

A. Can run in any database and version.
B. Flexibility to use any data model that is appropriate for a given customer.
C. A consistent design and architecture built on a single code base.
D. The ability to handle any data domain.

Previous Quiz             Next Quiz

What is Hard Delete Detection in Informatica MDM?

Do you know how Hard Delete Detection (HDD) works in Informatica MDM? Are you interested in knowing the basic concepts and the working principles of HDD? Are you looking for a sample code of HDD? If so, then you can refer to this article. In this article we will discuss the Hard Delete Detection process and its usage in the Informatica MDM.

What is the Hard Delete Detection?

Hard Delete detection is abbreviated as HDD. It is a process to determine the records removed or physically deleted from the source system. Informatica MDM determines the records which are removed from the source system and soft delete it in the associated MDM base object tables.

What are the soft delete and the hard delete?

 Soft delete and hard delete are not Informatica MDM concepts. These are well known concepts for any database management system. Soft deletion is achieved by using a column such as 'STATUS'  or 'ACTIVE_INACTIVE' or any other column which tells the record is deleted or active for business. So soft deleted records are physically maintained in the database but are not active for business purposes.  The soft deleted records can be recovered by making them active and making them available them for business.

      On the other hand the hard deleted records are physically removed from  the database and those are not available to business once those are hard deleted.

Do all types of databases support HDD in Informatica?

No. Only Oracle and Microsoft SQL Server environments can detect records that are removed from the source systems.  The DB2 database environment cannot detect records which are removed from the source systems.

How HDD works in the Informatica MDM?

• The stage job  in the MDM Hub compares all the records in the landing with the records in the previous landing table (aka PRL table) associated with each landing table.
• After determining the missing records in the landing table those are flagged as hard deletes for a full load. 
• The hard delete flagged records are reinserted back into the landing table along with a delete flag value. 
• For flagging records for hard deletes in the source, either we can use HUB_STATE_IND column or any other custom column.
•  After running the stage and the load job in the MDM Hub, records are updated in the associated base object table. 

What are the requirements for HDD implemenation?

Below are major requirements for implementing HDD :

1.  In order for HDD to work, we need to have a full load every time. It does not work with incremental or transitional loads.
2. We need to create a hard delete detection table in the repository table to configure hard deletes. 
3.  In order to make entry into the job metric table, we need to maintain an additional configuration.
4. HDD requires user exits to be written in Java.

What are the User Exits required for HDD implementation?

Below are the user exits required to be implemented for HDD:

1. Post Landing User Exits

2. Post Stage User Exits

Sample code for User Exits:

Here is a sample code for Post Landing User Exits:

public class PostLandingUE implements PostLandingUserExit {

public void processUserExit(UserExitContext oUEContext, String stagingTableName, String landingTableName,

String PRLTableName) throws Exception {

try {

HardDeleteDetection hdd = new HardDeleteDetection(oUEContext.getBatchJobRowid(), stagingTableName); 

hdd.startHardDeleteDetection(oUEContext.getDBConnection());

} catch (Exception e) {

e.printStackTrace();

} 

}

}

Here is a sample code for Post Stage User Exits:

public class PostStageUE implements PostStageUserExit {

public void processUserExit(UserExitContext userExitContext, String stagingTableName, String landingTableName,

String PRLTableName) throws Exception {

try {

ConsensusFlagUpdate consensusProcess = new ConsensusFlagUpdate(userExitContext.getBatchJobRowid(), stagingTableName); 

consensusProcess.startConsensusFlagUpdate(userExitContext.getDBConnection());

} catch (Exception e) {

e.printStackTrace();

} 

}

}

The video below provides detailed information about the Hard Delete detection process in the MDM hub.

How to use 'grep' commands in Unix?

Are you looking for  details about 'grep' commands in the Unix environment? Are you also looking for what are structures and samples for various 'grep' commands in the Unix system? If so, then this article provides detailed information about 'grep' command with its usage. 

What is the 'grep' command?

The word grep stands for globally search a regular expression and print. The command 'grep' is a command-line utility. It is used for searching plain-text data. The search is performed by using a regular expression.

Commands:

1. Use the command below to search a specific string in the specified file
grep "Techno Guru" test_file

2. Use the command below to search a specific string in all the files
grep "Techno Guru" *

3. Use the command below to search a specific string in only in the .log  files. We can also use regular expressions such as abc*.log, *test*.*, abc*.log. Search will be performed against files which matches this file patterns.
grep "Techno Guru" *.log

4. Use the command below to perform case in-sensitive search. The command below will matches all the words such as "TECHNO GURU", "Techno Guru", "tEchno Guru", "techno guru" etc.
grep -i "Techno Guru" test_file

5. To print the matched line, along with 5 lines after it.
grep  -A 5 -i "Techno Guru" test_file

6. To perform recursive search
grep -r "Techno Guru" test_file

7. To perform recursive search in all the files. Below command searches "Techno Guru" word in all the files under the current directory and its sub directory
grep -r "Techno Guru" *

8. Use the command below to search using regular expression in search string. The command below searches for starting string "Techno" and ends with "Guru". You can use other different search pattern as well.
grep "Techno*Guru" test_file

9. What are the regular patterns can be used?
The below mentioned regular patterns can be used while working with grep command.
? : Matched at most once.
* : Matched zero or more times.
+  : Matched one or more times.
{n} : Matched exactly n times.
{n,} : Matched n or more times.
{,m}  : Matched at most m times.
{n,m} : Matched at least n times, but not more than m times.

10. Use 'grep -w' command to search for full words and not for sub-strings. In the below command exact "Techno" or "techno" or "TECHNO" will be matched in the file. However if file contains "Technoworld" then it will not be identified as match.
grep -iw "Techno" test_file

11. Displaying lines before/after/around the match using grep -A, -B and -C
If you are performing file analysis in real time project, it will be useful to see some lines after or before the match.

a) To display 5 lines after match
grep -A 5 -i "Techno Guru" test_file

b) To display 5 lines before match
grep -B 5 "Techno Guru" test_file

c) To display 4 lines around match. The option -C used for the match to be appeared with the lines from both the side.
grep -C 4 "Techno Guru" test_file

12. To count the number of matches use the command below
grep -c "Technology World"  Test_file

13. To count the number lines which does NOT found match, use the command below
grep -v -c "Technology World"  Test_file

14. To highlight the search. In order to see which part matches the line, we can highlight it as (Use can use any color to highlight)
export GREP_OPTIONS='--color=auto' GREP_COLOR='99;8'

15. To determine the name of files in which match string found.
grep -l "Techno" test_*

16. Use the command below to show only matched string as by default grep command shows the line which matches the given string.
grep -o "Techno Guru" Test_file

Learn more about Unix in the video below:

How to install Weblogic Server?

Are you looking for an article about how to install weblogic server? If so, then refer this article as it provides detailed step by step instructions about how to install weblogic server. In this article, we are going to see steps for installing weblogic server with version 10.3.6.

Step 1: Download weblogic server installer  from Oracle website. If you downloaded on the Windows system then it will be .exe file. The first thing we need to create Weblogic server installation is the 'Domain. Double click on .exe file to launch it. You will get below dialog window where you need to provide domain name and location of domain. Provide these details and click on 'Next' button.

Step 2: We need to create administrator user to perform administrator activities on weblogic server. To create admin user provide user name and password and optional description in the dialog window as shown in below screen shot and click on 'Next' button.

Step 3: Based on environment we need to choose Development Mode or Production Mode. Choose option appropriately. You can either select available JDK or Other JDK which is installed in your system. I would recommend to use the 'Other JDK' option as it will be for maintainability perspective. After selecting JDK option click on 'Next' button.

Step 4: Select all the components which are required for your environment. Based on these selections the next screen will change. In our current selection we are choosing 'Administration Server', 'Managed Servers, Clusters and Machines' and 'Deployments and Services' options. If you need JMS configuration also then choose option accordingly and then click the 'Next' button.

Step 5: In the next dialog box we need to provide the details about Administration Server, such as Administration Server Name, Listen port, SSL port etc. Once all these details are provided then click on the 'Next' button.

Step 6: After providing admin server details, next screen will ask us to provide managed server details. Provide the managed server name, hosting server, listening port and SSL port if SSL is enabled. Once all these details are provided then click on 'Next' button.

Step 7: In this step we need to configure cluster if your project requires cluster to be configured for better application availability and performance. Click the 'Next' button on this screen.

Step 8: In the next step assign servers to clusters. Once servers are assigned to cluster click on the 'Next' button.

Step 9: We need to create machine on which servers will be running. So configure machine name and listen address and listen port. Once these details are provided click on the 'Next' button.

Step 10: In this step assign Admin Server and Manged servers to machine. Once assignment is done click on the 'Next' button.

Step 11: Assign JMS Services, Work manager and any other services to clusters  or servers which are configured in earlier steps. Click on the 'Next' button.

Step 12: We will see summary of Weblogic server configuration in the next screen. Click on the 'Create' button.

Step 13: In this screen, we can see progress of  Weblogic server installation and  components which are getting installed. Once 100% installation is done then click on the 'Done' button.

With these steps, Weblogic server is ready for use. You can refer the video below to learn more about Weblogic server.

How to install Informatica MDM software?

Are you planning to install Informatica MDM in the Windows system? Are you looking for step by step instructions about the installation of Informatica MDM? If so, then you can refer to this article to understand the steps involved during the MDM installation.

Step 1: Locate the installer file, received from the Informatica Support team. In the Windows system, it will be .exe file. Double click on the .exe file. The dialog window will appear as shown in the screen below. Read the agreement and select the radio button corresponding to 'I accept the terms of the License Agreement' and then click on the 'Next' button.

Step 2: Select the file system location on the Windows System where you would like to install the Informatica MDM product. You can browse the location using the 'Choose' button. After providing the location click on the 'Next' button.

Step 3: If you would like to create a short cut for the MDM Hub on the Desktop or in the Start Menu then choose  the shortcut folder location. Click on the 'Next' button after choosing the shortcut folder option.

Step 4: When you buy the Informatica product from Informatica, it comes with the license file. You can browse the license file using 'Choose' button and then click on the 'Next' button.

Step 5: The next step is important. If you are using the Weblogic application server then select the radio button corresponding to the 'Weblogic' option or else select the other based on the application server you are using in your environment. After it, click on the 'Next' button.

Step 6: The next step will ask to provide the application server home location. You can provide the path or browse the application server home location by using 'Choose' button. After providing the home path, click on the 'Next' button.

Step 7: If you are using the Weblogic application server then the dialog window mentioned below will appear to provide the Weblogic application server details. You need to provide the host name (it is the server name on which the weblogic server is installed), Server name, Weblogic user name, Weblogic user password and listen port on which the weblogic server is listening. You can get the information from your middleware (application server installation) team. In the screen shot below, the sample values are provided. After providing the server details, click on the 'Next' button.

Step 8:  After providing the details about the application server, the next step is to provide the database details. If you are using the Oracle database then select the radio button corresponding to 'Oracle 11g R2' or the respective database version (If  you are using a higher version of MDM then the database version option will be different). Click on the 'Next' button.

Step 9: Based on the database setup, if you can select the database Service Name or the database SID (Oracle System Id). You can get the Service Name or the SID name from your DBA. Click on the 'Next' button.

Step 10: If you are using the Oracle database then the dialog window mentioned below will appear to provide the Oracle database details. You need to provide the Server (it is the name of the server on which the Oracle database is installed), Port on which the database is listening, Service name, System Schema name and System Schema password. You can get the information from your DBA team. In the screen shot below, the sample values are provided. After providing the database details, click on the 'Next' button.

Step 11: The next dialog window will show connect url. You can verify connect url. If you would like to make any changes in connect url then select the radio button corresponding to 'Yes' or else select the radio button corresponding to 'No' option. After selecting the appropriate option click on the 'Next' button.

Step 12: After the installation of the MDM product we need to run the post install script. It can be done in two ways: We can run the post install script

 1)  immediately after running the installation file  or

 2)  manually after the installation is done.

 If you would like to run the post install script immediately after the installation is done then select the radio button corresponding to the 'Yes' option. After the appropriate option selection click on the 'Next' button.

Step 13: After providing all necessary information, the pre-installation summary will be provided as shown in the screen shot below. It shows the Product Name, the Install Folder, the Shortcut location, the Application server details and the database details.

Step 14: The pre-installation summary also provides more information as shown in the screen shot below. It shows the required disk space as well as the available disk space. If everything looks good then click on the 'Install' button.

Step 15: The installation will start and the progress bar will show the progress of installation. The screen shot below provides the details about progress with the steps of execution.

Step 16: Finally, the installation will be completed and the successful message will appear on the screen. 

With the help of these steps, you will be able to  install the MDM software successfully. Refer to the video below to learn the Informatica MDM product.