<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" media="screen" href="/~d/styles/rss2full.xsl"?><?xml-stylesheet type="text/css" media="screen" href="http://feeds.feedburner.com/~d/styles/itemcontent.css"?><rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:wfw="http://wellformedweb.org/CommentAPI/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:feedburner="http://rssnamespace.org/feedburner/ext/1.0" version="2.0">

<channel>
	<title>Informatica Perspectives » Data Services</title>
	
	<link>http://blogs.informatica.com/perspectives</link>
	<description>Perspectives from The Data Integration Company</description>
	<pubDate>Fri, 13 Nov 2009 18:59:50 +0000</pubDate>
	<generator>http://wordpress.org/?v=2.5</generator>
	<language>en</language>
			<atom10:link xmlns:atom10="http://www.w3.org/2005/Atom" rel="self" href="http://feeds.feedburner.com/InformaticaPerspectivesDataServices" type="application/rss+xml" /><atom10:link xmlns:atom10="http://www.w3.org/2005/Atom" rel="hub" href="http://pubsubhubbub.appspot.com" /><item>
		<title>The NEXT BIG THING Is Here - Informatica 9</title>
		<link>http://feedproxy.google.com/~r/InformaticaPerspectivesDataServices/~3/WyVhiR1VOWk/</link>
		<comments>http://blogs.informatica.com/perspectives/index.php/2009/11/10/the-next-big-thing-is-here-informatica-9/#comments</comments>
		<pubDate>Tue, 10 Nov 2009 22:17:48 +0000</pubDate>
		<dc:creator>John Schmidt</dc:creator>
		
		<category><![CDATA[Business Impact / Benefits]]></category>

		<category><![CDATA[Business/IT Collaboration]]></category>

		<category><![CDATA[CIO]]></category>

		<category><![CDATA[Cloud Computing]]></category>

		<category><![CDATA[Data Governance]]></category>

		<category><![CDATA[Data Integration]]></category>

		<category><![CDATA[Data Quality]]></category>

		<category><![CDATA[Data Services]]></category>

		<category><![CDATA[Governance, Risk and Compliance]]></category>

		<category><![CDATA[Integration Competency Centers]]></category>

		<category><![CDATA[Operational Efficiency]]></category>

		<category><![CDATA[Agile]]></category>

		<category><![CDATA[Factory]]></category>

		<category><![CDATA[ICC]]></category>

		<category><![CDATA[Informatica 9]]></category>

		<category><![CDATA[Lean Integration]]></category>

		<guid isPermaLink="false">http://blogs.informatica.com/perspectives/?p=554</guid>
		<description><![CDATA[  For those of you who have been following my blog for some time, you no doubt remember the May article on THE NEXT BIG THING and the 10 Weeks to Lean Integration series. You also hopefully recall the discussions about the Integration Factory being the dominant integration platform technology for the next decade. [...]]]></description>
			<content:encoded><![CDATA[<p><a title="Informatica 9" href="http://www.informatica.com/9" target="_blank" onclick="pageTracker._trackPageview('/outgoing/www.informatica.com/9?referer=');"><img src="http://www.informatica.com/blogs/bloginfa9.jpg" border="0" alt="Informatica 9" width="50" height="63" /> <img src="http://www.informatica.com/blogs/edm_john_schmidt.jpg" border="0" alt="John Schmidt" width="50" height="63" /></a> For those of you who have been following my blog for some time, you no doubt remember the May article on <a href="http://blogs.informatica.com/perspectives/index.php/2009/05/11/the-next-big-thing-is-lean-integration/">THE NEXT BIG THING </a>and the <a href="http://blogs.informatica.com/perspectives/index.php/2009/01/14/10-weeks-to-lean-integration/">10 Weeks to Lean Integration</a> series. You also hopefully recall the discussions about the Integration Factory being the dominant integration platform technology for the next decade. While elements of the factory capability have been around for years, the Informatica 9 platform now offers the ability to build high-speed, efficient, “green” integrations with seamless collaboration between Business and IT.<span id="more-554"></span></p>
<p>Organizations have been implementing factory elements for years using a combination of custom workflows and standard Informatica functionality. If we go back to PowerCenter 6 or earlier, some organizations implemented shared capabilities and self-service portals using custom metadata extensions and custom user interfaces.  Every successive release of the Informatica platform has added more and more out of the box capability to the point were Informatica 9 is the most sophisticated “out of the box” factory yet. </p>
<p>To be clear, there is always room to add even more automated capability so the ICC staff and Lean Integration teams will continue to have opportunities for even greater efficiency and improvements in productivity and cycle-time, but the out-of-the-box functionality is a huge step in enabling highly efficient integration assembly lines. As a refresher, here are the <strong>7 lean principles</strong>:</p>
<ol>
<li>Focus on Customer, Eliminate Waste (i.e. &#034;green&#034;)</li>
<li>Continuously Improve </li>
<li>Empower the Team</li>
<li>Optimize the Whole</li>
<li>Plan for Change and Mass Customize</li>
<li>Automate Processes and Deliver Fast</li>
<li>Build Quality In</li>
</ol>
<p>Let’s compare these principles to the primary themes and focus of Informatica 9: SOA-Based Data Services, Pervasive Data Quality, and Business-IT Collaboration.  Business-IT Collaboration is critical for <em><strong>focusing on the customer</strong></em> (the business IS the customer) and eliminating waste.  Business-IT Collaboration involves <em><strong>empowering business teams</strong></em> by supporting self-service capabilities such as the ability for the business to profile data, create business rules, and monitor data quality without the typical dependence on IT.  Wasted activities are eliminated due to the “High-Fidelity Collaboration” capability, meaning that metadata artefacts are shared between business and IT and appear to each in the manner appropriate to their needs, yet they are still operating on the same objects. This <em><strong>reduces waste</strong></em> because translation problems don’t crop up like they used to when the business works with spreadsheets which need to be translated into implementation-level details by IT using different tools. In other words, in Informatica 9 “<em><strong>quality is built in</strong></em>” from the start rather than being “inspected in” during an integration test.</p>
<p>Pervasive Data Quality systematically <em><strong>builds quality in</strong></em>. Different roles such as stewards, architects, developers, etc. have role-appropriate tools to understand and improve the quality of data. These tools support all data types (customer, product, vendor, accounts, etc), have built-in AddressDoctor Version 5 capabilities and geo-coding, and have full read/write access capabilities – in short everything the Informatica platform can access at high performance.  What’s more, the tools have the ability to manage the business rules around data quality as part of the integration layer rather than have the logic contained elsewhere. This enables loose coupling and rapid change in support of the Lean <em><strong>plan for change</strong></em> principle.</p>
<p>SOA-based Data Services further allows loose coupling with the data services layer which dramatically helps on the <em><strong>plan for change </strong></em>front.  Whether wishing to read or write data using SQL or Web Services, with small messages or large datasets, in real-time or in batch, the “multi-modal data provisioning services” (which means that the same data object definitions can be used for all these different styles of access through a common definition and platform), means <em><strong>less waste</strong></em> because the simplified management of these capabilities is in one place.  Further simplifying management is the ability to administer the policies governing the SLAs of these data objects in one place.  With this Data Services layer, companies will be able to eliminate the integration ‘hairball’ far more effectively, by reducing the waste which comes from the complexity of the historical point-to-point approach.  Further, having data profiling capabilities available at the fingertips of architects and developers <em><strong>reduces waste</strong></em> because of the in-depth understanding of the data at the point in time when the data service abstraction layer is being defined.</p>
<p>To complete the picture, following are the Informatica 9 themes and key capabilities which support the Lean integration principles:</p>
<p>SOA-Based Data Services</p>
<ul>
<li>Multimodal data provisioning services</li>
<li>Universal data discovery services</li>
<li>Policy-based data services governance</li>
</ul>
<p>Pervasive Data Quality</p>
<ul>
<li>Unified role-specific tools for stakeholders</li>
<li>Comprehensive support for all tools for nearly all purposes</li>
<li>Open to all applications</li>
</ul>
<p>Business-IT Collaboration</p>
<ul>
<li>Business Empowerment</li>
<li>IT Productivity</li>
<li>High-Fidelity Collaboration</li>
</ul>
<p><strong>The next big thing – Lean Integration and the Integration Factory are now here</strong>.  No more excuses for anyone to hold back.</p>
<img src="http://feeds.feedburner.com/~r/InformaticaPerspectivesDataServices/~4/WyVhiR1VOWk" height="1" width="1"/>]]></content:encoded>
			<wfw:commentRss>http://blogs.informatica.com/perspectives/index.php/2009/11/10/the-next-big-thing-is-here-informatica-9/feed/</wfw:commentRss>
		<feedburner:origLink>http://blogs.informatica.com/perspectives/index.php/2009/11/10/the-next-big-thing-is-here-informatica-9/</feedburner:origLink></item>
		<item>
		<title>Your Data Is YOUR Business</title>
		<link>http://feedproxy.google.com/~r/InformaticaPerspectivesDataServices/~3/pQvJUtqwMAo/</link>
		<comments>http://blogs.informatica.com/perspectives/index.php/2009/11/10/your-data-is-your-business/#comments</comments>
		<pubDate>Tue, 10 Nov 2009 18:05:08 +0000</pubDate>
		<dc:creator>Chris Boorman</dc:creator>
		
		<category><![CDATA[Business Impact / Benefits]]></category>

		<category><![CDATA[Business/IT Collaboration]]></category>

		<category><![CDATA[Customers]]></category>

		<category><![CDATA[Data Integration]]></category>

		<category><![CDATA[Data Quality]]></category>

		<category><![CDATA[Data Services]]></category>

		<category><![CDATA[Data Warehousing]]></category>

		<category><![CDATA[News &amp; Announcements]]></category>

		<category><![CDATA[Pervasive Data Quality]]></category>

		<category><![CDATA[Real-Time]]></category>

		<category><![CDATA[Informatica 9]]></category>

		<guid isPermaLink="false">http://blogs.informatica.com/perspectives/?p=557</guid>
		<description><![CDATA[ A customer commented on this to me the other day – &#034;your data is your business&#034;.  Two meanings in one phrase and eloquently stating the modern world that we live in today.  We have evolved computing in many ways over the last 20 years.  Today, with the launch of Informatica 9, we are evolving [...]]]></description>
			<content:encoded><![CDATA[<p><a title="Informatica 9" href="http://www.informatica.com/9" target="_blank" onclick="pageTracker._trackPageview('/outgoing/www.informatica.com/9?referer=');"><img src="http://www.informatica.com/blogs/bloginfa9.jpg" border="0" alt="Informatica 9" width="50" height="63" /> </a><img class="alignleft" style="left;" src="http://www.informatica.com/blogs/chris_boorman.jpg" border="0" alt="Chris Boorman" width="50" height="63" />A customer commented on this to me the other day – &#034;your data is your business&#034;.  Two meanings in one phrase and eloquently stating the modern world that we live in today.  We have evolved computing in many ways over the last 20 years.  Today, with the launch of Informatica 9, we are evolving the computing model one further time because, quite simply <strong>“Your data is <em>YOUR </em>business”</strong> and <strong>&#034;Your data <em>IS</em></strong><em> </em><strong>your business&#034;.</strong></p>
<p>It’s your organization’s most important proprietary asset. Are you really managing it that way?</p>
<p>The answer for most companies is “No”.<span id="more-557"></span></p>
<p>So how have we arrived at this place we find ourselves in, and why do we need another solution?</p>
<p>Quite simply, because we need to focus on driving the most competitive advantage out of our data.  We’ve become addicted to our computers and we have built systems for the business time, after time, after time.  Today most business users are presented with numerous applications that purport to provide the most timely, relevant and trustworthy data.  The problem is, they don’t.  There, I’ve said it – computer systems today cannot be trusted, they do not deliver the data that the business user wants and they do not provide it in the timely way that business users need it – no wonder business users are fleeing to the clouds!  The trouble is that we are about to make the same mistake again – numerous new systems now running on other people’s infrastructure with multiple versions of the truth.</p>
<p>Just think about it for a minute – which version of “Customer record” do you really, absolutely trust?  Is it the one that comes from your old creaking order processing system?  Or is it the one in your sales support system, or maybe the one in your CRM, or your financial system, or the one in that custom built application that went live last month but still needs tweaking, or is it the version in your new cloud-based SaaS application running .. well &#8230; no idea where really!</p>
<p>In fact, we have ended up with an IT hairball that is costly to maintain, precarious to modify and fragile.  This house WILL come tumbling down if we don’t do something about it.  SOA was going to fix the problems – but the original designers forgot about the data.</p>
<p>You see, our IT infrastructure has become commoditized – it no longer matters where the IT infrastructure is.  On-premise, hosted on Amazon or underneath the latest fancy cloud computing service.  Indeed, applications are becoming commoditized.  It’s the data that matters, it’s the data that provides the competitive advantage, it’s the data that ultimately lets you understand who your customers are, what they have, how they work and what they can buy.  It’s the data that allows you to run marketing campaigns to promote your goods and services, it’s the data that is moved between enterprises, it’s the data that represents health care records, it’s the data, it&#039;s the data, it&#039;s the data.</p>
<p>As one of our salespeople so eloquently put it to me, “Follow the data - it’s all about the data”.</p>
<p>Today with Informatica 9 we are launching an infrastructure platform that will, quite literally, transform your business and transform your world because, for the first time ever, you can really focus on becoming a data-driven enterprise.  It is designed to help IT deliver timely, trustworthy and relevant data to the business.  This is not a job for IT alone – it is about the Business and IT collaborating together more effectively, driving out data quality issues and delivering data to the enterprise in the most timely and applicable format – whether that is in traditional IT systems or in the internet cloud.</p>
<p>Welcome to <a title="Informatica 9" href="http://www.informatica.com/9" target="_blank" onclick="pageTracker._trackPageview('/outgoing/www.informatica.com/9?referer=');">Informatica 9</a>, welcome to <strong>YOUR </strong>data.</p>
<img src="http://feeds.feedburner.com/~r/InformaticaPerspectivesDataServices/~4/pQvJUtqwMAo" height="1" width="1"/>]]></content:encoded>
			<wfw:commentRss>http://blogs.informatica.com/perspectives/index.php/2009/11/10/your-data-is-your-business/feed/</wfw:commentRss>
		<feedburner:origLink>http://blogs.informatica.com/perspectives/index.php/2009/11/10/your-data-is-your-business/</feedburner:origLink></item>
		<item>
		<title>Building A Foundation For MDM</title>
		<link>http://feedproxy.google.com/~r/InformaticaPerspectivesDataServices/~3/a-LvfeRtRSE/</link>
		<comments>http://blogs.informatica.com/perspectives/index.php/2009/10/28/building-a-foundation-for-mdm/#comments</comments>
		<pubDate>Wed, 28 Oct 2009 22:55:09 +0000</pubDate>
		<dc:creator>Michael Destein</dc:creator>
		
		<category><![CDATA[Customers]]></category>

		<category><![CDATA[Data Integration Platform]]></category>

		<category><![CDATA[Data Services]]></category>

		<category><![CDATA[Data Warehousing]]></category>

		<category><![CDATA[Enterprise Data Management]]></category>

		<category><![CDATA[Identity Resolution]]></category>

		<category><![CDATA[Master Data Management]]></category>

		<category><![CDATA[Operational Efficiency]]></category>

		<category><![CDATA[Pervasive Data Quality]]></category>

		<category><![CDATA[SOA]]></category>

		<category><![CDATA[Data Integration]]></category>

		<category><![CDATA[Data Quality]]></category>

		<category><![CDATA[Matching]]></category>

		<category><![CDATA[MDM]]></category>

		<category><![CDATA[Metadata]]></category>

		<guid isPermaLink="false">http://blogs.informatica.com/perspectives/?p=538</guid>
		<description><![CDATA[Organizations are selecting different approaches and tools for customer master and product master, sometimes even different tools for operational and analytical MDM applications.  But the common threads are data integration and data quality.]]></description>
			<content:encoded><![CDATA[<p><a title="Informatica 9" href="http://www.informatica.com/9" target="_blank" onclick="pageTracker._trackPageview('/outgoing/www.informatica.com/9?referer=');"><img src="http://www.informatica.com/blogs/bloginfa9.jpg" border="0" alt="Informatica 9" width="50" height="63" align="left" /></a> <img src="http://www.informatica.com/blogs/mike_destein.jpg" border="0" alt="Michael Destein" width="50" height="63" align="left" /></a></p>
<p>Since recently attending the Gartner MDM Summit, reading the latest report on <a title="Forrester MDM Trends 2009" href="http://www.forrester.com/go?docid=48286" target="_blank" onclick="pageTracker._trackPageview('/outgoing/www.forrester.com/go?docid=48286&amp;referer=');">MDM Trends</a> from Forrester, and speaking with several customers, a few trends are starting to emerge:</p>
<ul>
<li>There is no one single technology that will help organizations solve all of their MDM challenges</li>
<li>While some MDM products are supporting multiple domains, they are still either customer-centric or product-centric</li>
<li>Analytical style of MDM is gaining in importance, and</li>
<li>The common challenges across all data domains and hub styles are data integration and data quality</li>
</ul>
<p><span id="more-538"></span></p>
<p><!--[if !supportLists]--><!--[endif]--><!--[if !supportLists]--><!--[endif]--><!--[if !supportLists]--><!--[endif]--></p>
<p class="MsoNormal">At Informatica, we have been working with many customers that are seeing these same trends as well.<span> </span>They are selecting different approaches and tools for customer master and product master, sometimes even different tools for operational and analytical MDM applications.<span> </span>But the common threads are data integration and data quality:</p>
<p class="MsoNormal"><strong>Data Integration</strong></p>
<p><!--[if !supportLists]--><!--[endif]--></p>
<ul>
<li>Access to multiple systems inside and outside the firewall</li>
<li>Ability to handle multiple latencies from real-time to massive batches</li>
<li>Tracking the metadata history, lineage, and audit trails</li>
</ul>
<p><!--[if !supportLists]--><!--[endif]--><!--[if !supportLists]--><!--[endif]--></p>
<p class="MsoNormal"><strong>Data Quality</strong></p>
<p><!--[if !supportLists]--><span style="Symbol;"><span><span> </span></span></span><!--[endif]--></p>
<ul>
<li>Profiling source system to understand what you are starting with</li>
<li>Identity Matching to detect duplicates</li>
<li>Address Validation for all countries of operation and customer locations</li>
<li>Cleansing and Standardization to ensure data consistency and accuracy across all attributes</li>
<li>On-going monitoring and data quality scorecards to bring continual visibility to the program</li>
</ul>
<p><!--[if !supportLists]--><!--[endif]--><!--[if !supportLists]--><!--[endif]--><!--[if !supportLists]--><!--[endif]--><!--[if !supportLists]--><!--[endif]--></p>
<p class="MsoNormal">When you look at the Informatica solution set you will see that we provide the capabilities that span these requirements.<span> </span>It’s an opportunity to help our customers be more successful by laying a foundation for MDM that provides a consistent integration layer across all data domains while applying data quality to existing data and having those same data quality rules applied at the point of entry.</p>
<p><span>What do you think? <span> </span>Is having a consistent foundation for all MDM projects important?<span> </span></span></p>
<img src="http://feeds.feedburner.com/~r/InformaticaPerspectivesDataServices/~4/a-LvfeRtRSE" height="1" width="1"/>]]></content:encoded>
			<wfw:commentRss>http://blogs.informatica.com/perspectives/index.php/2009/10/28/building-a-foundation-for-mdm/feed/</wfw:commentRss>
		<feedburner:origLink>http://blogs.informatica.com/perspectives/index.php/2009/10/28/building-a-foundation-for-mdm/</feedburner:origLink></item>
		<item>
		<title>How To Get Started with Data-Orientation - What Architects Told Me…</title>
		<link>http://feedproxy.google.com/~r/InformaticaPerspectivesDataServices/~3/FmoyyoqJAWY/</link>
		<comments>http://blogs.informatica.com/perspectives/index.php/2009/10/27/how-to-get-started-with-data-orientation-what-architects-told-me/#comments</comments>
		<pubDate>Tue, 27 Oct 2009 22:10:47 +0000</pubDate>
		<dc:creator>Ash Parikh</dc:creator>
		
		<category><![CDATA[CIO]]></category>

		<category><![CDATA[Data Services]]></category>

		<category><![CDATA[Real-Time]]></category>

		<category><![CDATA[SOA]]></category>

		<category><![CDATA[Data Virtualization]]></category>

		<category><![CDATA[Information-As-A-Service]]></category>

		<category><![CDATA[Real-Time Data Integration]]></category>

		<guid isPermaLink="false">http://blogs.informatica.com/perspectives/?p=537</guid>
		<description><![CDATA[ 
In my previous post To Successfully Service-Orient, Data-Orient First!, I shared the input I received from architects and IT managers, to serve as a handy check-list for ensuring a solid foundation for success in service-oriented infrastructures. 


The following are the data-orientation capabilities they recommended as a first step in successfully service-orienting an infrastructure:
 

Easy [...]]]></description>
			<content:encoded><![CDATA[<p><a title="Informatica 9" href="http://www.informatica.com/9" target="_blank" onclick="pageTracker._trackPageview('/outgoing/www.informatica.com/9?referer=');"><img src="http://www.informatica.com/blogs/bloginfa9.jpg" border="0" alt="Informatica 9" width="50" height="63" /> <img src="http://www.informatica.com/blogs/ds_ash_parikh.jpg" alt="Ash Parikh" width="50" height="63" /></a></p>
<p class="MsoNormal" style="margin: 0in 0in 0pt;"><span style="font-size: 10pt; font-family: Arial;">In my previous post <em style="mso-bidi-font-style: normal;"><span style="text-decoration: underline;"><a href="http://blogs.informatica.com/perspectives/index.php/2009/10/13/to-successfully-service-orient-data-orient-first-2/"><span style="color: #006699;">To Successfully Service-Orient, Data-Orient First!</span></a></span></em>, I shared the input I received from architects and IT managers, to serve as a handy check-list for ensuring a solid foundation for success in service-oriented infrastructures. </span></p>
<p class="MsoNormal" style="margin: 0in 0in 0pt;">
<p class="MsoNormal" style="margin: 0in 0in 0pt;">
<p class="MsoNormal" style="margin: 0in 0in 0pt;"><span style="font-size: 10pt; font-family: Arial;">The following are the data-orientation capabilities they recommended as a first step in successfully service-orienting an infrastructure:</span></p>
<p class="MsoNormal" style="margin: 0in 0in 0pt;"><span style="font-size: 10pt; font-family: Arial;"> </span></p>
<ol>
<li><span style="font-size: 10pt; font-family: Arial;"><span style="mso-list: Ignore;"></span></span><span style="font-size: 10pt; font-family: Arial;">Easy access of all relevant data, including new or rapidly changing data sources</span></li>
<li><span style="font-size: 10pt; font-family: Arial;"><span style="mso-list: Ignore;"></span></span><span style="font-size: 10pt; font-family: Arial;">Seamless processing of data as batch, change data capture or real-time, including handling large volumes of large data sets</span></li>
<li><span style="font-size: 10pt; font-family: Arial;"><span style="mso-list: Ignore;"><span style="font: 7pt "></span></span></span><span style="font-size: 10pt; font-family: Arial;">Proactive identification and resolution of data inaccuracies </span></li>
<li><span style="font-size: 10pt; font-family: Arial;"><span style="mso-list: Ignore;"><span style="font: 7pt "></span></span></span><span style="font-size: 10pt; font-family: Arial;">Application of complex data transformations on the data</span></li>
<li><span style="font-size: 10pt; font-family: Arial;"><span style="mso-list: Ignore;"><span style="font: 7pt "></span></span></span><span style="font-size: 10pt; font-family: Arial;">Delivery of data, exactly when it is needed, as a standards-based data service</span></li>
</ol>
<p class="MsoNormal" style="margin: 0in 0in 0pt;"><span style="font-size: 10pt; font-family: Arial;"> </span><span id="more-537"></span></p>
<p class="MsoNormal" style="margin: 0in 0in 0pt;"><span style="font-size: 10pt; font-family: Arial;">We also discussed scenarios across industry verticals where there was a compelling need for timely and trusted data delivered as a service. However, what we did not discuss was how to data-orient a service-oriented infrastructure. In order to bring the best real-world information to you, I went back to the source – the same architects and IT managers who deal with complex data-centric issues on a day-to-day basis.</span></p>
<p class="MsoNormal" style="margin: 0in 0in 0pt;"><span style="font-size: 10pt; font-family: Arial;"> </span></p>
<p class="MsoNormal" style="margin: 0in 0in 0pt;"><span style="font-size: 10pt; font-family: Arial;">The recommendations were rather prescriptive in nature, centered on solving the problem holistically rather than looking for quick and dirty solutions, as should be the case. So let’s take a look at each of these recommendations and I will leave it to you to deduce what the effective solution should look like&#8230;</span></p>
<p class="MsoNormal" style="margin: 0in 0in 0pt;">
<p class="MsoNormal" style="margin: 0in 0in 0pt;">
<p class="MsoNormal" style="margin: 0in 0in 0pt;"><strong style="mso-bidi-font-weight: normal;"><span style="font-size: 10pt; font-family: Arial;">Recommendation #1: </span></strong><span style="font-size: 10pt; font-family: Arial;">Start with a data integration platform that enables universal access to all data sources, be it structured, semi-structured,<strong style="mso-bidi-font-weight: normal;"> </strong>unstructured, cloud, partner, master, Web services…whatever it is. Also consider if you need to quickly on-board new data sources, or take advantage of data that changes rapidly. The bottom line is that there needs to be a way to include all the data you can possibly get to, in the fastest, secure and most reliable manner possible.</span></p>
<p class="MsoNormal" style="margin: 0in 0in 0pt;"><span style="font-size: 10pt; font-family: Arial;"> </span></p>
<p class="MsoNormal" style="margin: 0in 0in 0pt;"><strong style="mso-bidi-font-weight: normal;"><span style="font-size: 10pt; font-family: Arial;">Recommendation #2: </span></strong><span style="font-size: 10pt; font-family: Arial;">Make sure that the platform you choose to use can effectively support any latency of data processing, be it batch, near real-time or change data capture and real-time. Why? This is because in the real-world, data is processed at different latencies at different points in the enterprise. Without a single environment that can address all the nuances involved you will be forced to use and maintain a tangle of integration technologies.</span></p>
<p class="MsoNormal" style="margin: 0in 0in 0pt;"><span style="font-size: 10pt; font-family: Arial;"> </span></p>
<p class="MsoNormal" style="margin: 0in 0in 0pt;"><strong style="mso-bidi-font-weight: normal;"><span style="font-size: 10pt; font-family: Arial;">Recommendation #3: </span></strong><span style="font-size: 10pt; font-family: Arial;">Understand that large data volumes are different from large volumes of large data sets and plan accordingly. Technologies that handle large volumes of small messages typically do not do a good job of handling large volumes of large data sets. Bear in mind that a technology that handles large volumes of small messages has its own place in an SOA, so complement it by a technology that processes large volumes of large data sets efficiently.</span></p>
<p class="MsoNormal" style="margin: 0in 0in 0pt;"><span style="font-size: 10pt; font-family: Arial;"> </span></p>
<p class="MsoNormal" style="margin: 0in 0in 0pt;"><strong style="mso-bidi-font-weight: normal;"><span style="font-size: 10pt; font-family: Arial;">Recommendation #4: </span></strong><span style="font-size: 10pt; font-family: Arial;">Place a value on the importance of the trustworthiness of the data that is consumed by your applications and business processes. If you feel that it is inefficient and expensive to find out after-the-fact about inconsistencies and inaccuracies across all your data, then you definitely need a more proactive approach. Look for a platform that can provide integrated data profiling to proactively identify issues and also fix these issues, regardless of the complexity.</span></p>
<p class="MsoNormal" style="margin: 0in 0in 0pt;"><span style="font-size: 10pt; font-family: Arial;"> </span></p>
<p class="MsoNormal" style="margin: 0in 0in 0pt;"><strong style="mso-bidi-font-weight: normal;"><span style="font-size: 10pt; font-family: Arial;">Recommendation #5: </span></strong><span style="font-size: 10pt; font-family: Arial;">Make a list of all the complex transformations that you need to do on all your enterprise data. Any integration technology can typically handle simple format conversions, however, if you have the need for more complex transformations such as aggregation, joining, lookup, etc., or need to enable structure conversions, industry format conversions or even data masking or obfuscation of specific portions of the data, you probably need something more sophisticated.<span style="mso-spacerun: yes;"> </span></span></p>
<p class="MsoNormal" style="margin: 0in 0in 0pt;"><span style="font-size: 10pt; font-family: Arial;"> </span></p>
<p class="MsoNormal" style="margin: 0in 0in 0pt;"><strong style="mso-bidi-font-weight: normal;"><span style="font-size: 10pt; font-family: Arial;">Recommendation #6:</span></strong><span style="font-size: 10pt; font-family: Arial;"> Take a hard look at all your consuming applications. Take an inventory of the way each of these applications consume the data. Is it through Web services, or do they only understand SQL? Ideally, this should not matter to the data integration platform you choose. The data integration platform should be able to deliver timely and trusted data, in exactly the way it is needed by each application.</span></p>
<p class="MsoNormal" style="margin: 0in 0in 0pt;"><span style="font-size: 10pt; font-family: Arial;"> </span></p>
<p class="MsoNormal" style="margin: 0in 0in 0pt;"><strong style="mso-bidi-font-weight: normal;"><span style="font-size: 10pt; font-family: Arial;">Recommendation #7: </span></strong><span style="font-size: 10pt; font-family: Arial;">And finally, make sure that your applications are insulated from the underlying data sources. What this means is that if the underlying data sources change, you do not have to re-build the integrations. A solid data integration foundation would provide the necessary standards-based data abstraction to all the underlying data, so that, if and when things change in the data layer, the applications are adequately insulated.</span></p>
<p class="MsoNormal" style="margin: 0in 0in 0pt;"><span style="font-size: 10pt; font-family: Arial;"> </span></p>
<p class="MsoNormal" style="margin: 0in 0in 0pt;"><span style="font-size: 10pt; font-family: Arial;">Additionally, what I did note was a common thread across all the above suggestions, that there needs to be a single, integrated platform that can deliver all the capabilities outlined. This makes sense, as all these recommendations were made with time and cost savings in mind. If a separate technology were to be employed for each of these capabilities, the very basis for employing a service-oriented approach would be compromised, which would be to enable agility through simplicity and flexibility.</span></p>
<p class="MsoNormal" style="margin: 0in 0in 0pt;"><span style="font-size: 10pt; font-family: Arial;"> </span></p>
<p class="MsoNormal" style="margin: 0in 0in 0pt;"><span style="font-size: 10pt; font-family: Arial;">Oh, I almost forgot. There is one last prescription that the architects shared – probably one of the most important from an architect’s point of view – that the platform must support and drive the reuse of data integration logic. More on this highly important topic, in my next blog posting.</span></p>
<p class="MsoNormal" style="margin: 0in 0in 0pt;">
<img src="http://feeds.feedburner.com/~r/InformaticaPerspectivesDataServices/~4/FmoyyoqJAWY" height="1" width="1"/>]]></content:encoded>
			<wfw:commentRss>http://blogs.informatica.com/perspectives/index.php/2009/10/27/how-to-get-started-with-data-orientation-what-architects-told-me/feed/</wfw:commentRss>
		<feedburner:origLink>http://blogs.informatica.com/perspectives/index.php/2009/10/27/how-to-get-started-with-data-orientation-what-architects-told-me/</feedburner:origLink></item>
		<item>
		<title>Managing Data As An Asset (Part 2) - Walking The Walk</title>
		<link>http://feedproxy.google.com/~r/InformaticaPerspectivesDataServices/~3/CCR5zdRf4gM/</link>
		<comments>http://blogs.informatica.com/perspectives/index.php/2009/10/21/managing-data-as-an-asset-part-2-walking-the-walk/#comments</comments>
		<pubDate>Wed, 21 Oct 2009 16:18:42 +0000</pubDate>
		<dc:creator>Judy Ko</dc:creator>
		
		<category><![CDATA[Data Governance]]></category>

		<category><![CDATA[Data Quality]]></category>

		<category><![CDATA[Data Services]]></category>

		<category><![CDATA[Enterprise Data Management]]></category>

		<category><![CDATA[Data Driven Enterprise]]></category>

		<category><![CDATA[Informatica 9]]></category>

		<guid isPermaLink="false">http://blogs.informatica.com/perspectives/?p=533</guid>
		<description><![CDATA[If organizations say that data is one of their most valuable assets, they need to start walking the walk.  Data governance is often defined in terms of managing data as an asset, and this discipline, while still nascent, is evolving rapidly.  Many companies have started to define and standardize on data governance processes, as well as formalize data governance roles such as data stewards.  But we’re a long way from maturity here.  Moreover, the technology infrastructure that underpins these processes is still inadequate in most organizations.  ]]></description>
			<content:encoded><![CDATA[<p><a title="Informatica 9" href="http://www.informatica.com/9" target="_blank" onclick="pageTracker._trackPageview('/outgoing/www.informatica.com/9?referer=');"><img src="http://www.informatica.com/blogs/bloginfa9.jpg" border="0" alt="Informatica 9" width="50" height="63" /></a> <img style="left;" src="http://www.informatica.com/blogs/pers_judy_ko.jpg" border="0" alt="Judy Ko" width="50" height="63" />In <a href="http://blogs.informatica.com/perspectives/index.php/2009/10/14/managing-data-as-an-asset-part-one-putting-a-price-tag-on-data/" target="_blank">my last posting</a>, I wrote about how we often talk about managing data as an asset, but that one of the major barriers to actually doing so is the difficulty in putting a monetary value on the data.</p>
<p>A somewhat more tangible, if no less complex issue, is that the processes and tools for managing data as an asset are often not in place.  <a href="http://www.informatica.com/solutions/data_governance/Pages/index.aspx" target="_blank" onclick="pageTracker._trackPageview('/outgoing/www.informatica.com/solutions/data_governance/Pages/index.aspx?referer=');">Data governance</a> is often defined in terms of managing data as an asset, and this discipline, while still nascent, is evolving rapidly.  Many companies have started to define and standardize on data governance processes, as well as formalize data governance roles such as data stewards.  But we’re a long way from maturity here.</p>
<p>Moreover, the technology infrastructure that underpins these processes is still inadequate in most organizations.  <span id="more-533"></span>Examples of some of the typical gaps:</p>
<ul>
<li>It can take an inordinate amount of IT effort just to access the data in some legacy systems—that’s if you can even find the data you need in the first place.  If you can’t get to your asset, it has no value.</li>
<li>The different business applications in a company have different technical requirements for how they consume the same data.  In theory, data should be the ultimate reusable asset.  But if you can’t reuse it, are you getting the value you should?</li>
<li>Ideally the business is supposed to be responsible for data quality, but what is the state-of-the-art tool for them to analyze and cleanse data?  Right now, usually spreadsheets.  Do you have the means to add value to your asset?</li>
<li>There is no method for technically enforcing policies around data quality, privacy, etc.  How can you protect your assets if you can’t enforce policies for it?</li>
</ul>
<p>If organizations say that data is one of their most valuable assets, they need to start walking the walk.  They need to actually invest in the processes and people to formalize data management, and they need to update their technology infrastructure to support those processes.  At Informatica, we say that companies who are walking the walk by making these investments are “data driven”.  (We didn’t coin this term&#8211; Thomas Redman has an excellent book called <a href="http://www.thedatadrivencompany.com/" target="_blank" onclick="pageTracker._trackPageview('/outgoing/www.thedatadrivencompany.com/?referer=');">Data Driven</a>, which discusses many of these concepts.)</p>
<p>You’ll be seeing more in the future on this concept of “data driven” with the <a href="http://www.informatica.com/9" target="_blank" onclick="pageTracker._trackPageview('/outgoing/www.informatica.com/9?referer=');">Informatica 9 launch</a>.  Stay tuned.</p>
<img src="http://feeds.feedburner.com/~r/InformaticaPerspectivesDataServices/~4/CCR5zdRf4gM" height="1" width="1"/>]]></content:encoded>
			<wfw:commentRss>http://blogs.informatica.com/perspectives/index.php/2009/10/21/managing-data-as-an-asset-part-2-walking-the-walk/feed/</wfw:commentRss>
		<feedburner:origLink>http://blogs.informatica.com/perspectives/index.php/2009/10/21/managing-data-as-an-asset-part-2-walking-the-walk/</feedburner:origLink></item>
		<item>
		<title>EAI and Data Integration: Like 'Fitting Square Pegs in Round Holes'</title>
		<link>http://feedproxy.google.com/~r/InformaticaPerspectivesDataServices/~3/QfR-3GlvFdo/</link>
		<comments>http://blogs.informatica.com/perspectives/index.php/2009/10/16/eai-and-data-integration-like-fitting-square-pegs-in-round-holes/#comments</comments>
		<pubDate>Fri, 16 Oct 2009 13:00:55 +0000</pubDate>
		<dc:creator>Joe McKendrick</dc:creator>
		
		<category><![CDATA[Business Impact / Benefits]]></category>

		<category><![CDATA[Data Integration]]></category>

		<category><![CDATA[Data Integration Platform]]></category>

		<category><![CDATA[Data Services]]></category>

		<category><![CDATA[Enterprise Data Management]]></category>

		<category><![CDATA[SOA]]></category>

		<category><![CDATA[Ash Parikh]]></category>

		<category><![CDATA[David Linthicum]]></category>

		<category><![CDATA[EAI]]></category>

		<guid isPermaLink="false">http://blogs.informatica.com/perspectives/?p=528</guid>
		<description><![CDATA[For years, organizations have been relying on strategies such as enterprise application integration to streamline and automate business processes from disparate silos and systems. However, there&#039;s a large gaping hole in the capabilities EAI – and its successor, enterprise service buses – can deliver. Current middleware strategies fall short in addressing data integration and data [...]]]></description>
			<content:encoded><![CDATA[<p><a title="Informatica 9" href="http://www.informatica.com/9" target="_blank" onclick="pageTracker._trackPageview('/outgoing/www.informatica.com/9?referer=');"><img src="http://www.informatica.com/blogs/bloginfa9.jpg" border="0" alt="Informatica 9" width="50" height="63" /></a><img class="alignleft" style="left;" src="http://www.informatica.com/blogs/edm_joe_mckendrick.jpg" border="0" alt="Joe McKendrick" width="50" height="63" />For years, organizations have been relying on strategies such as enterprise application integration to streamline and automate business processes from disparate silos and systems. However, there&#039;s a large gaping hole in the capabilities EAI – and its successor, enterprise service buses – can deliver. Current middleware strategies fall short in addressing data integration and data quality issues – and this is costing organizations.<span id="more-528"></span></p>
<p>I recently had the opportunity to moderate an <a href="http://www.ebizq.net/webinars/11666.html" target="_blank" onclick="pageTracker._trackPageview('/outgoing/www.ebizq.net/webinars/11666.html?referer=');">Informatica Webinar</a>, hosted by ebizQ, featuring Dave Linthicum, CEO of the Linthicum Group and one of the world’s leading authorities on SOA, Cloud, and application and data integration, and Ash Parikh, Informatica&#039;s SOA and data services evangelist. (And a contributor here at the Perspectives site.)</p>
<p>Dave, who literally wrote the book on “Enterprise Application Integration” back in the 1990s, says EAI  and ESB approaches are not suited for today&#039;s high-transaction data integration needs, and have great limitations. But still, many organizations persist in attempting to plug in these types of solutions into vexing business problems that require a more holistic architectural approach. “There are a lot of people trying to put square pegs into round holes,” he says. “I&#039;m seeing almost an epidemic out there in the world of service oriented architecture and enterprise architecture and architecture modernization.”<br />
(Dave also talks about the challenges in introducing data integration into SOA efforts in a post <a href="http://blogs.informatica.com/perspectives/index.php/2009/10/07/understanding-data-services-in-context-of-soa-2/" target="_blank">here</a> at the Perspectives site.)</p>
<p>Dave says that while the square-peg-in-a-round-hole approach will work for a while, it&#039;s far more costly in the long run. “With EAI and ESB technology, there are certain instances and problem domains where they&#039;re a fit,” he explains. “But you need to understand there are certain limitations that are part of that technology that should be considered. Ultimately, if you don&#039;t consider them and pick those technology approaches anyway, you&#039;re going to start running into walls that are very difficult to back up and get around as you move the architecture forward.”</p>
<p>“It’s very easy to write a check for this stuff. It’s very easy to put it on a server, and it’s easy to start coding to it, and putting adapters around it. But down the line there&#039;s so many dependencies that are put into the technology – it’s very difficult to uncouple them out of the problem domain. After two or three or five years of inefficiencies, and issues with the technology, these approaches can cost you millions of dollars, and even cost you the success or failure of the architecture.”</p>
<p>Along with the issues of data integration, EAI is not equipped to manage data quality, and thus may taint the performance of SOA. “EAI will enhance overall efficiency of the business process,” Ash pointed out. “EAI will only propagate corrupt information in real time across your information systems. Sure, EAI can process messages as fast as possible across applications. But what if the information is incorrect?  Your entire process will be fed with corrupt information, such as wrong mailing address, wrong person, wrong quantity.”</p>
<p>Dave says that he&#039;s finding clients “in droves” that are missing these requirements. “They typically drive with technology, so they have the technology in mind before they even look at the requirements,” he says. “Even going as far as calling something an &#039;ESB project,&#039; which is silly. It’s a data integration project.” Data needs to be available to the enterprise, and it must be traceable and auditable, Dave says.</p>
<p>Data integration is beyond the reach of EAI and ESB solutions. Ash advocates putting data integration into a data services layer abstracted from physical databases. “It would be very tough for EAI to create a holistic view of data across heterogeneous data sources,” he says. “What would solve the problem is a centralized data abstraction layer.” Such an interface can “deliver a single view, regardless of the type or location of the data source.”</p>
<p>This data services layer in what can be loosely termed as a SOA stack, Ash observes. “Data services can be this compelling technology that sits inside this stack to enable SOA to finally realize its true potential. A single centralized layer that would eliminate all the hand coding, and solve the complexity.”</p>
<p>“Start with the architecture,” Dave advises. “You need to understand your own issues, and look at your own business requirements. And ultimately that&#039;s going to lead you do to the right technology.”</p>
<p>“At the end of the day, there are things you need to consider, as you go through data integration architecture,” he says. “Understanding how information is going from system to system. You need to look at your requirements in detail.”</p>
<img src="http://feeds.feedburner.com/~r/InformaticaPerspectivesDataServices/~4/QfR-3GlvFdo" height="1" width="1"/>]]></content:encoded>
			<wfw:commentRss>http://blogs.informatica.com/perspectives/index.php/2009/10/16/eai-and-data-integration-like-fitting-square-pegs-in-round-holes/feed/</wfw:commentRss>
		<feedburner:origLink>http://blogs.informatica.com/perspectives/index.php/2009/10/16/eai-and-data-integration-like-fitting-square-pegs-in-round-holes/</feedburner:origLink></item>
		<item>
		<title>To Successfully Service-Orient, Data-Orient First!</title>
		<link>http://feedproxy.google.com/~r/InformaticaPerspectivesDataServices/~3/2dzfcHmDa7o/</link>
		<comments>http://blogs.informatica.com/perspectives/index.php/2009/10/13/to-successfully-service-orient-data-orient-first-2/#comments</comments>
		<pubDate>Wed, 14 Oct 2009 00:26:23 +0000</pubDate>
		<dc:creator>Ash Parikh</dc:creator>
		
		<category><![CDATA[Business Impact / Benefits]]></category>

		<category><![CDATA[Data Integration Platform]]></category>

		<category><![CDATA[Data Services]]></category>

		<category><![CDATA[Real-Time]]></category>

		<category><![CDATA[SOA]]></category>

		<category><![CDATA[Information as a Services]]></category>

		<category><![CDATA[Operational Data Integration]]></category>

		<category><![CDATA[Real-Time Data Integration]]></category>

		<category><![CDATA[Service Oriented Architecture]]></category>

		<guid isPermaLink="false">http://blogs.informatica.com/perspectives/?p=525</guid>
		<description><![CDATA[ I have firmly believed that a day would come when it would be you, my fellow integrators, telling me that one needs to data-orient first before benefiting from service-orientation. That day has indeed come!
 
Just recently, I created a quick one question survey and sent it off to a number of application and enterprise [...]]]></description>
			<content:encoded><![CDATA[<p><a title="Informatica 9" href="http://www.informatica.com/9" target="_blank" onclick="pageTracker._trackPageview('/outgoing/www.informatica.com/9?referer=');"><img src="http://www.informatica.com/blogs/bloginfa9.jpg" border="0" alt="Informatica 9" width="50" height="63" /> <img src="http://www.informatica.com/blogs/ds_ash_parikh.jpg" border="0" alt="Ash Parikh" width="50" height="63" /></a>I have firmly believed that a day would come when it would be you, my fellow integrators, telling me that one needs to data-orient first before benefiting from service-orientation. That day has indeed come!</p>
<p class="MsoNormal" style="margin: 0in 0in 0pt;"><span style="font-size: 10pt; font-family: Arial;"> </span></p>
<p class="MsoNormal" style="margin: 0in 0in 0pt;"><span style="font-size: 10pt; font-family: Arial;">Just recently, I created a quick one question survey and sent it off to a number of application and enterprise architects as well as IT managers at leading enterprises. The question was:</span></p>
<p></span></p>
<ul style="margin-top: 0in;" type="square">
<li class="MsoNormal" style="margin: 0in 0in 0pt; mso-list: l0 level1 lfo1; tab-stops: list .5in;"><span style="font-size: 10pt; font-family: Arial;">What are the top three things on your mind as you architect or re-architect your infrastructures?</span></li>
</ul>
<p class="MsoNormal" style="margin: 0in 0in 0pt;">
<p class="MsoNormal" style="margin: 0in 0in 0pt;"><span style="font-size: 10pt; font-family: Arial;">There was a common thread across the responses that I received:</span></p>
<ul>
<li>
<div class="MsoNormal" style="margin: 0in 0in 0pt; mso-list: l0 level1 lfo1; tab-stops: list .5in;"><span style="font-size: 10pt; font-family: Arial;">Service-orientation or an architectural approach to increase the speed and agility of how IT responds to a business’ requests,</span></div>
</li>
<li>
<div class="MsoNormal" style="margin: 0in 0in 0pt; mso-list: l0 level1 lfo1; tab-stops: list .5in;"><span style="font-size: 10pt; font-family: Arial;">Doing more with less or something to that effect, and</span></div>
</li>
<li>
<div class="MsoNormal" style="margin: 0in 0in 0pt; mso-list: l0 level1 lfo1; tab-stops: list .5in;"><span style="font-size: 10pt; font-family: Arial;">An easy way to leverage all relevant information, when it is needed and how it is needed</span></div>
</li>
</ul>
<p class="MsoNormal" style="margin: 0in 0in 0pt;">
<p class="MsoNormal" style="margin: 0in 0in 0pt;">
<p>When I saw these responses, the pragmatic part of me started to build a list of questions in my head and I decided to call a number of these professionals and get the real scoop on their selections.</p>
<p class="MsoNormal" style="margin: 0in 0in 0pt;"><span style="font-size: 10pt; font-family: Arial;"> </span></p>
<p class="MsoNormal" style="margin: 0in 0in 0pt;"><span style="font-size: 10pt; font-family: Arial;">Here is what I heard…</span></p>
<p><span id="more-525"></span></p>
<p class="MsoNormal" style="margin: 0in 0in 0pt;"><span style="font-size: 10pt; font-family: Arial;">* An enterprise architect at a global sporting goods manufacturing company, told me that the IT organization had just completed a three-year project to service-orient its infrastructure in order to help streamline operations. However, he told me, they were stuck and didn’t know how to move ahead as this new infrastructure, which included an ESB, could not support large files. Large files are used by the company to move their business critical order and product data once a day across their supply-chain management systems.</span></p>
<p class="MsoNormal" style="margin: 0in 0in 0pt;">
<p class="MsoNormal" style="margin: 0in 0in 0pt;"><span style="font-size: 10pt; font-family: Arial;"> </span></p>
<p class="MsoNormal" style="margin: 0in 0in 0pt;">
<p>* An application architect at a leading financial services company had a problem with the quality of the data that was being delivered to his reports. As is their tradition, his company had just completed another round of acquisitions, and once again his reports were missing crucial customer data from the newly acquired company. Although the IT organization had service-oriented its infrastructure based on state-of-the-art technologies, it was a challenge to quickly understand what was in the new data sources and handle any inaccuracies and inconsistencies.</p>
<p class="MsoNormal" style="margin: 0in 0in 0pt;"><span style="font-size: 10pt; font-family: Arial;"> </span></p>
<p class="MsoNormal" style="margin: 0in 0in 0pt;">
<p class="MsoNormal" style="margin: 0in 0in 0pt;">
<p>* Another enterprise architect from a large insurance company couldn’t hide his frustrations about the fact that every time something changed in the underlying data layer, the impact was huge. Every time a data source was changed or replaced, which was frequently, the integration logic in the consuming layers had to be rebuilt. He wanted a way to easily abstract the data layer from these frequent changes. According to him, the ideal solution would be for this layer to provide the necessary insulation and deliver all relevant data as reusable standards-based service.</p>
<p class="MsoNormal" style="margin: 0in 0in 0pt;"><span style="font-size: 10pt; font-family: Arial;"> </span></p>
<p class="MsoNormal" style="margin: 0in 0in 0pt;">
<p class="MsoNormal" style="margin: 0in 0in 0pt;"><span style="font-size: 10pt; font-family: Arial;">* The enterprise architect at another large insurance company felt that there was no way to easily deliver an accurate, single-view of business entities such as “CUSTOMER,” “PROVIDER,” and “MEMBERSHIP” data, to their web portals. What they were able to achieve within their implementation was enabling the access of data across the diverse data sources and delivering the data as a Web service. But, when it came to doing complex transformations or ensuring that the quality of the data was as required, they had to resort to hand-coding or other sub-optimal means. </span></p>
<p class="MsoNormal" style="margin: 0in 0in 0pt;"><span style="font-size: 10pt; font-family: Arial;"> </span></p>
<p class="MsoNormal" style="margin: 0in 0in 0pt;">
<p class="MsoNormal" style="margin: 0in 0in 0pt;">
<p>It is becoming increasingly clear that any effort to service-orient an infrastructure needs to start with a hard look at data integration. In his recent blog entitled “<a href="http://blogs.informatica.com/perspectives/index.php/2009/10/07/understanding-data-services-in-context-of-soa-2/"><span style="color: #006699;">Understanding Data Services In Context Of SOA&#034;</span></a>, David Linthicum says that “Working from the data up to the services within SOA is clearly a best practice.” There seems to be a crystal-clear message here that “data integration” needs to be top of mind for anyone architecting their infrastructure for speed and agility.</p>
<p class="MsoNormal" style="margin: 0in 0in 0pt;"><span style="font-size: 10pt; font-family: Arial;"> </span></p>
<p class="MsoNormal" style="margin: 0in 0in 0pt;">
<p class="MsoNormal" style="margin: 0in 0in 0pt;"><span style="font-size: 10pt; font-family: Arial;">So, if you are looking to service-orient your infrastructure, I would suggest that you data-orient first by doing a 5-point check to make sure that the foundation has the following capabilities:</span></p>
<ul>
<li><span style="font-size: 10pt; font-family: Arial;">Easy access of all relevant data, including new or rapidly changing data sources</span></li>
<li><span style="font-size: 10pt; font-family: Arial;">Processing of data as batch, CDC or real-time, including handling large volumes of large data sets</span></li>
<li><span style="font-size: 10pt; font-family: Arial;">Proactive identification and resolution of data inaccuracies and inconsistencies</span></li>
<li><span style="font-size: 10pt; font-family: Arial;">Application of complex data transformations on the data</span></li>
<li><span style="font-size: 10pt; font-family: Arial;">Delivery of data, exactly when it is needed, as a standards-based data service</span></li>
</ul>
<p class="MsoNormal" style="margin: 0in 0in 0pt;">
<p class="MsoNormal" style="margin: 0in 0in 0pt;"><span style="font-size: 10pt; font-family: Arial;">In my next blog, I will dig deeper into each of these requirements.</span></p>
<img src="http://feeds.feedburner.com/~r/InformaticaPerspectivesDataServices/~4/2dzfcHmDa7o" height="1" width="1"/>]]></content:encoded>
			<wfw:commentRss>http://blogs.informatica.com/perspectives/index.php/2009/10/13/to-successfully-service-orient-data-orient-first-2/feed/</wfw:commentRss>
		<feedburner:origLink>http://blogs.informatica.com/perspectives/index.php/2009/10/13/to-successfully-service-orient-data-orient-first-2/</feedburner:origLink></item>
		<item>
		<title>The Right Way To Do Data Integration For Applications</title>
		<link>http://feedproxy.google.com/~r/InformaticaPerspectivesDataServices/~3/2EbETo5H02g/</link>
		<comments>http://blogs.informatica.com/perspectives/index.php/2009/10/08/the-right-way-to-do-data-integration-for-applications/#comments</comments>
		<pubDate>Thu, 08 Oct 2009 08:00:01 +0000</pubDate>
		<dc:creator>Bertrand Cariou</dc:creator>
		
		<category><![CDATA[Data Governance]]></category>

		<category><![CDATA[Data Integration]]></category>

		<category><![CDATA[Data Integration Platform]]></category>

		<category><![CDATA[Data Quality]]></category>

		<category><![CDATA[Data Services]]></category>

		<category><![CDATA[Data Synchronization]]></category>

		<category><![CDATA[Enterprise Data Management]]></category>

		<category><![CDATA[Pervasive Data Quality]]></category>

		<category><![CDATA[SOA]]></category>

		<category><![CDATA[Application Integration]]></category>

		<category><![CDATA[Data Integration for Applications]]></category>

		<category><![CDATA[Data Quality Firewall]]></category>

		<category><![CDATA[EAI]]></category>

		<category><![CDATA[ESB]]></category>

		<category><![CDATA[Integration Patterns]]></category>

		<category><![CDATA[Transaction]]></category>

		<guid isPermaLink="false">http://blogs.informatica.com/perspectives/?p=518</guid>
		<description><![CDATA[ On the 1st October 2009, I participated in a webinar “The Right Way to Do Data Integration for Applications,” hosted by David S. Linthicum, a recognized expert in SOA, Cloud computing and Enterprise Application Integration. It was an event that was very well attended and generated a lot of interest from the attendees judging [...]]]></description>
			<content:encoded><![CDATA[<p><a title="Informatica 9" href="http://www.informatica.com/9" target="_blank" onclick="pageTracker._trackPageview('/outgoing/www.informatica.com/9?referer=');"><img src="http://www.informatica.com/blogs/bloginfa9.jpg" border="0" alt="Informatica 9" width="50" height="63" /></a> <img src="http://www.informatica.com/blogs/bertrand_cariou.jpg" border="0" alt="Bertrand Cariou" width="50" height="63" />On the 1<sup>st</sup> October 2009, I participated in a webinar “<a href="http://www.ebizq.net/webinars/11666.html" onclick="pageTracker._trackPageview('/outgoing/www.ebizq.net/webinars/11666.html?referer=');"><span style="arial;">The Right Way to Do Data Integration for Applications</span></a><span style="arial;">,”</span><span style="Arial;"> </span><span style="small;"><span style="arial;">hosted by David S. Linthicum, a recognized expert in SOA, Cloud computing and Enterprise Application Integration. It was an event that was very well attended and generated a lot of interest from the attendees judging by the large number and quality of questions that were submitted. I recommend that you listen to the replay and download the associated white paper he wrote on that subject.</span></span></p>
<p class="MsoNormal" style="justify;"><span style="small;"><span style="arial;">David covered some of the limitations he has encountered over the years with the way Enterprise Integration Application (EAI) and Enterprise Service Bus (ESB) technologies deal with the integration of data, deployed in a SOA initiative.<span id="more-518"></span></span></span></p>
<p class="MsoNormal" style="justify;"><span style="small;"><span style="arial;">I found the content covered by Dave to be very interesting as it fully related to some of the real-world experience I had gained over the years working with customers. Based on my experience, EAI and ESB technologies typically manage process integration and transactional event-based message movements in a publish/subscribe environment. But when it comes to the manipulation of the data itself, these technologies quickly reach their limits leading to a hand coded approach or at best, abusing the capabilities of the EAI/ESB.</span></span></p>
<p class="MsoNormal" style="justify;"><span style="arial;">Fortunately enough, some of these companies were able to leverage the data integration capabilities of the </span><a href="http://www.informatica.com/products_services/Pages/index.aspx" onclick="pageTracker._trackPageview('/outgoing/www.informatica.com/products_services/Pages/index.aspx?referer=');"><span style="arial;">Informatica Platform</span></a><span style="small;"><span style="arial;"> to enable a number of key capabilities that were missing in EAI/ESB.</span></span></p>
<p class="MsoNormal" style="justify;"><span style="small;"><span style="arial;">Here are the key capabilities that the Informatica Platform can seamlessly address with respect to the limitations of EAI/ESB:</span></span><span style="small;"><span style="arial;">Bulk data movement scalability</span></span></p>
<ul>
<li>
<div class="MsoNormal" style="justify;"><span style="small;"><span style="Calibri;">Rich metadata capabilities</span></span></div>
</li>
<li>
<div class="MsoNormal" style="justify;"><span style="small;"><span style="Calibri;">Set-oriented data transformations</span></span></div>
</li>
<li>
<div class="MsoNormal" style="justify;"><span style="small;"><span style="Calibri;">Codeless environment</span></span></div>
</li>
<li>
<div class="MsoNormal" style="justify;"><span style="small;"><span style="Calibri;">Non-intrusive database transaction detections</span></span></div>
</li>
<li>
<div class="MsoNormal" style="justify;"><span style="small;"><span style="Calibri;">Ease of deployment and modification </span></span></div>
</li>
</ul>
<p><span style="small;"><span style="Calibri;">These valuable capabilities, from an IT perspective, provide immediate return on investment to the SOA initiative by providing the right way to enable data integration development and reduce the costs of maintenance.</span></span></p>
<p class="MsoNormal"><span style="small;"><span style="Calibri;">But it is the second round of capabilities that brings the most value. EAI or ESB technologies are meant to propagate transactions over queues in the quickest way possible. In other words, if the data associated with a transaction is corrupt, then this same corrupt data will get propagated to all the applications, having significant impact to the business process. </span></span></p>
<p class="MsoNormal" style="justify;"><span style="small;"><span style="Calibri;">The Informatica Platform can provide a data quality firewall to the company, ensuring that corrupted information does not enter the business transactions. Or, it can provide data quality checks as a service to the applications (also known as Data Quality point of entry) so that the information is verified in the earliest step of the process.</span></span></p>
<p class="MsoNormal" style="justify;"><span style="small;"><span style="Calibri;">Finally, all these data integration patterns such as bulk processing, transaction capture, set-oriented transformations, or data quality certification can all be delivered as a standards-based service to the EAI/ESB. This is a great starting point for implementing a data services foundation in an SOA strategy. </span></span></p>
<p class="MsoNormal" style="justify;"><span style="Calibri;">I strongly recommend you take a look at this </span><a href="http://www.ebizq.net/webinars/11666.html" onclick="pageTracker._trackPageview('/outgoing/www.ebizq.net/webinars/11666.html?referer=');"><span style="Calibri;">webinar</span></a><span style="small;"><span style="Calibri;">.</span></span></p>
<img src="http://feeds.feedburner.com/~r/InformaticaPerspectivesDataServices/~4/2EbETo5H02g" height="1" width="1"/>]]></content:encoded>
			<wfw:commentRss>http://blogs.informatica.com/perspectives/index.php/2009/10/08/the-right-way-to-do-data-integration-for-applications/feed/</wfw:commentRss>
		<feedburner:origLink>http://blogs.informatica.com/perspectives/index.php/2009/10/08/the-right-way-to-do-data-integration-for-applications/</feedburner:origLink></item>
		<item>
		<title>Understanding Data Services In Context Of SOA</title>
		<link>http://feedproxy.google.com/~r/InformaticaPerspectivesDataServices/~3/N-2Lrq_M0zc/</link>
		<comments>http://blogs.informatica.com/perspectives/index.php/2009/10/07/understanding-data-services-in-context-of-soa-2/#comments</comments>
		<pubDate>Wed, 07 Oct 2009 13:47:32 +0000</pubDate>
		<dc:creator>David Linthicum</dc:creator>
		
		<category><![CDATA[Data Integration Platform]]></category>

		<category><![CDATA[Data Services]]></category>

		<category><![CDATA[SOA]]></category>

		<category><![CDATA[Data Service]]></category>

		<guid isPermaLink="false">http://blogs.informatica.com/perspectives/?p=517</guid>
		<description><![CDATA[ Those moving toward SOA seem a bit confused by the use of data within a SOA. While most consider data as…well, data, those in the know understand that data needs to be a strategic part of the SOA for SOA to succeed as a project, or as an overall architectural strategy.
The trouble comes in [...]]]></description>
			<content:encoded><![CDATA[<p><a title="Informatica 9" href="http://www.informatica.com/9" target="_blank" onclick="pageTracker._trackPageview('/outgoing/www.informatica.com/9?referer=');"><img src="http://www.informatica.com/blogs/bloginfa9.jpg" border="0" alt="Informatica 9" width="50" height="63" /></a> <img class="alignleft" style="left;" src="http://www.informatica.com/blogs/dave_linthicum.gif" border="0" alt="David Linthicum" width="50" height="63" />Those moving toward SOA seem a bit confused by the use of data within a SOA. While most consider data as…well, data, those in the know understand that data needs to be a strategic part of the SOA for SOA to succeed as a project, or as an overall architectural strategy.</p>
<p>The trouble comes in when attention is centered on the “S” in SOA, which stands for services. Those charged with building architectures and systems, who focus on the notion of a service as delivering functional behavior, neglect the need to manage the underlying data. In many cases, data quality and consistency issues quickly arise, and the agility that SOA should provide is limited by the need to alter services directly after the underlying data has changed. <span id="more-517"></span></p>
<p>Most in the SOA community understand that data services provide controlled interfaces to underlying data, but typically don’t understand the strategic value of data services to the SOA. Data services, if created and leveraged correctly within the context of a SOA, should provide a wide variety of features including data quality assurance, data governance, and, most importantly, the ability to support data abstractions.</p>
<p>Data abstraction is the key. It allows you to fix issues with the existing physical databases within the data service itself. Moreover, you can combine many different databases, and even unstructured information, into a single unified view of the data that is more representative of the business. Done right, this provides a huge strategic advantage to business and enterprise IT, including the ability to change the underlying databases without driving changes to the applications that leverage the data services. Volatility exists within a single domain, and thus provides agility. Agility is the core value of a SOA.</p>
<p>However, moving to data services is not an easy path. You need to consider the design, implementation, and the right enabling technology.</p>
<p>The best practices around data services design are about moving from the top down. I suggest that you understand the data model at a logical level first, focusing on the business entities such as Customer, Sales, Inventory, etc., and then on the best physical/virtual structure that binds into those entities. Once that occurs, then you can link that physical/virtual structure to the physical database or databases.</p>
<p>Moving from the logical to the physical provides a few major advantages:</p>
<ul type="disc">
<li class="MsoNormal">You’re not constricted by the limitations of the existing physical database, or databases.</li>
<li class="MsoNormal">You’re focused on the business purpose first, and then on the technology implementation.</li>
<li class="MsoNormal">The logical design is durable over a long period of time, where the physical design typically exists within many instances of the database structure, and is where the changes typically take place.</li>
</ul>
<p>What’s surprising to me is the number of people working on SOAs who don’t understand the value of data services. Working from the data up to the services within SOA is clearly a best practice, and what I see repeatedly in the successful use of SOA. We’ve been at this for awhile now. We need to get a clue.</p>
<img src="http://feeds.feedburner.com/~r/InformaticaPerspectivesDataServices/~4/N-2Lrq_M0zc" height="1" width="1"/>]]></content:encoded>
			<wfw:commentRss>http://blogs.informatica.com/perspectives/index.php/2009/10/07/understanding-data-services-in-context-of-soa-2/feed/</wfw:commentRss>
		<feedburner:origLink>http://blogs.informatica.com/perspectives/index.php/2009/10/07/understanding-data-services-in-context-of-soa-2/</feedburner:origLink></item>
		<item>
		<title>What Is SOA? And, If You Are Doing It, Is Your SOA Going To Die Before It Has A Chance To Live?</title>
		<link>http://feedproxy.google.com/~r/InformaticaPerspectivesDataServices/~3/vl8tDa-FPqg/</link>
		<comments>http://blogs.informatica.com/perspectives/index.php/2009/09/28/what-is-soa-and-if-you-are-doing-it-is-your-soa-going-to-die-before-it-has-a-chance-to-live/#comments</comments>
		<pubDate>Mon, 28 Sep 2009 16:55:51 +0000</pubDate>
		<dc:creator>Ash Parikh</dc:creator>
		
		<category><![CDATA[CIO]]></category>

		<category><![CDATA[Data Integration]]></category>

		<category><![CDATA[Data Quality]]></category>

		<category><![CDATA[Data Services]]></category>

		<category><![CDATA[Real-Time]]></category>

		<category><![CDATA[Application Integration]]></category>

		<category><![CDATA[Information-As-A-Service]]></category>

		<category><![CDATA[SOA]]></category>

		<guid isPermaLink="false">http://blogs.informatica.com/perspectives/?p=509</guid>
		<description><![CDATA[






Before I start on this extremely polarizing topic, I really want to ask the question – do you want your SOA to be ineffective or die before it has a chance to live?
As I mentioned in an earlier blog, SOA does have a significantly big &#034;blind spot,&#034; which so often gets ignored due to the [...]]]></description>
			<content:encoded><![CDATA[<table border="0" cellspacing="0" cellpadding="4" align="left">
<tbody>
<tr>
<td><img src="http://www.informatica.com/blogs/ds_ash_parikh.jpg" alt="Ash Parikh" width="50" height="63" /></td>
</tr>
</tbody>
</table>
<p>Before I start on this extremely polarizing topic, I really want to ask the question – do you want your SOA to be ineffective or die before it has a chance to live?</p>
<p>As I mentioned in an earlier <a href="http://blogs.informatica.com/perspectives/index.php/2009/07/18/enough-already-about-what-is-soa-lets-discuss-some-real-world-myths-about-soa/">blog</a>, SOA does have a significantly big &#034;blind spot,&#034; which so often gets ignored due to the sheer size of the vehicle you are riding in – which I define as – the complexity of your enterprise infrastructure, the various avatars or stakeholders that are directly or indirectly impacted by integration challenges, departmental divides and ownership issues, debates around modernization, and of course, budget, time and resources.</p>
<p>Hopefully you answered the question with an emphatic NO!</p>
<p><span id="more-509"></span></p>
<p>I am not sure that anybody out there wants all their good money to go to waste after investing it in anything and everything that even remotely sounds like SOA. Such is the power of this paradigm called SOA, so rich in its roots and its promise that it is usually very difficult to &#034;stick to&#034; making a case against it, because on paper it promises you the agility that you are after.</p>
<p>But, the real question is whether your SOA is doing all that it promised it would. Is it able to round-up all its knights in shining armor, the EAI, ESB, BPM products of the world to ensure that it will deliver the most fresh, the most consistent and the most accurate information to its end users – the web portals, the composite applications, the business intelligence tools of this world?</p>
<p>As David Linthicum says in <a href="http://www.ebizq.net/blogs/linthicum/2009/07/lack_of_focus_on_data_killing.php" onclick="pageTracker._trackPageview('/outgoing/www.ebizq.net/blogs/linthicum/2009/07/lack_of_focus_on_data_killing.php?referer=');"><em>&#034;Lack of Focus on Data Killing SOA&#034;</em></a> his recent blog post, What&#039;s missing within most typical SOA projects is the focus on the data, and that is killing SOA. Since the &#034;S&#034; in SOA, means service, most architects focus on the service definition, abstracting the existing data into collections of services, but don&#039;t pay much attention to the data within the architecture. Not good.&#034;</p>
<p>I couldn’t agree with Dave more – although SOA is about &#034;architecture,&#034; most of us get caught up in handling the &#034;service&#034; piece of it and forget that the key to a good architecture is its foundation – the &#034;data.&#034;</p>
<p>In his blog, Dave goes on to say: &#034;The truth is that most failed SOA projects can be traced to the lack of a data level understanding&#8230;&#034;</p>
<p>What we don’t need is for SOA, which has so much promise, to die before it has a chance to live. Instead, what we need is a way to enable SOA to achieve its full potential by co-existing with its components and offering some much needed help around the integration of data.</p>
<p>I mentioned this in an earlier blog, <em><a href="http://blogs.informatica.com/perspectives/index.php/2009/07/18/enough-already-about-what-is-soa-lets-discuss-some-real-world-myths-about-soa/">Enough Already About What is SOA? Let’s Discuss Some Real-world Myths About SOA …</a></em> that by taking away all the headache that comes with integrating heterogeneous data sources spread all across the enterprise and beyond; by proactively ensuring that the data that flows through the pipes is of the greatest quality; by seamlessly handling all the complex transformations and structure conversions that are needed and then processing this data the way it needs to be processed, be it for processing large data sets, or capturing changes as they occur or in real-time - you can then easily and seamlessly deliver this data as a standards-based service or a data service.</p>
<p>This is what SOA needs – a solid foundation of timely and trusted data delivered as a data service – so that it does not die before it has a chance to live!</p>
<img src="http://feeds.feedburner.com/~r/InformaticaPerspectivesDataServices/~4/vl8tDa-FPqg" height="1" width="1"/>]]></content:encoded>
			<wfw:commentRss>http://blogs.informatica.com/perspectives/index.php/2009/09/28/what-is-soa-and-if-you-are-doing-it-is-your-soa-going-to-die-before-it-has-a-chance-to-live/feed/</wfw:commentRss>
		<feedburner:origLink>http://blogs.informatica.com/perspectives/index.php/2009/09/28/what-is-soa-and-if-you-are-doing-it-is-your-soa-going-to-die-before-it-has-a-chance-to-live/</feedburner:origLink></item>
	</channel>
</rss>
