Major Challenge in Data Migration

1. The Structure of the system you are migrating from be different than dynamics CRM.
2. Users of the old system may played games with the user of fields -Generally due to limitions in the system
3. Fields that must be separated may lead to "Column Drift"
4. Lack of unique identifiers can cause imports to fail

Data Migration Tools

Select a Tool to Use


When planning your data migration, you should select how the data will be transferred. In order to move data, there must be some way of connecting the two systems. Writing directly to the Microsoft Dynamics CRM database is not supported and highly discouraged.  Using one of the Microsoft Dynamics CRM data migration tools below will help ensure you are using a recommended process:

1. Import Wizard
2. Dynamics to CRM adapter
3. Scribe
4. SSIS

Import Wizard

The Import Wizard is the simplest way to get data into CRM, and it recommended for moving small batches of records (5,000 at a time). Data from the source needs to be put into a flat file (.xml, .csv, or .xls format). The import wizard then allows the user to select the columns of the flat file and map it to the specific entity and fields within CRM. It can be used to update existing or create new records. An option is available for Microsoft Dynamics CRM 2011 UR 13 and before to utilize duplicate detection while importing.

For more information on importing, see the data management chapter.

Dynamics to CRM Adapter

This is meant for connecting other Dynamics products with your Microsoft Dynamics CRM instance. The dynamics suite includes such products as:

Microsoft Dynamics AX (formerly Axapta)
https://mbs.microsoft.com/customersource/northamerica/AX/downloads/service-packs/mdax_dynamicsconnector

Microsoft Dynamics GP (formerly Great Plains)
https://mbs.microsoft.com/customersource/northamerica/GP/downloads/service-packs/mdgp_dynamicsconnector

Microsoft Dynamics NAV (formerly Navision)
https://mbs.microsoft.com/customersource/northamerica/NAV/downloads/service-packs/mdnav_dynamicsconnector

Microsoft Dynamics SL (formerly Solomon)
https://mbs.microsoft.com/customersource/northamerica/SL/downloads/service-packs/mdsl_dynamicsconnector

These products are available free of charge from Microsoft.  Each product has a standard template for integration points.  The image below lists the standard integration points that come out of the box for each ERP to CRM integration.  Additional integration points can be added and Connector does support custom entities in CRM.

CRM data migration tools - connector

Scribe
For more complex migrations and integrations that include scheduled jobs and data transformation Scribe should be considered. Scribe is a Microsoft supported tool that is a SAS tool with many different packages for different levels of service. This tool is great when trying to integrate with other databases that might not have an adapter built. The file format that is preferred if flat is .csv. Knowledge for Scribe would include knowledge of the tool and SQL scripting. The benefit of this tool is that it is easier to use because of a user friendly UI.

SSIS
When there is a tremendous amount of data to be moved, millions of records, an SSIS package might be necessary. This realm of an SSIS package would require a developer who has both C# and SQL knowledge. SSIS is able to do the same functionality as Scribe but it is a package being coded instead of the use of a UI. SSIS packages are more robust and transfers large amounts of data faster but could take more time to develop then building a Scribe job.

Choosing the right tool for your organization depends on your unique needs.  If you are just importing Accounts and Contacts or Leads, the Import Wizard is clearly the right choice.  However if you have more data to move, or numerous records linked together, then you may need to use Scribe.  If you have multiple integrations to complete, you might consider developing an expertise in Scribe or SSIS.  Also, look at your internal skillsets.  Most organizations use Scribe because it has less of a learning curve. If you already have a technical person who can do SSIS, then that is the way to go.

Business Unit ,Security Role,Privilege and Access Level

Business Unit :
A scoping mechanism that defines a grouping of users for security modeling purposes.
Business units are hierarchical in nature.
Business Units are framework upon which a security model is built.

Security Role :

A collection of privileges that reflect common roles of your organization or business units.

Privilege (Access Rights)
The definition of specific type of data access or action that can be granted as a right;
Privileges are granted through a security role and are cumulative
The following privileges that can be assigned :

1. Create 2.Read 3. Write 4.Delete 5.Append 6.Append To 7. Access 8.Share

Access Level :
The Access Level defines exactly to which records the privileges apply.

 1. None 2. User 3.Business Unit 4.Parent : Childs Business Unit 5 Organizations

Fetch Xml has Limitation

Fetch Xml has Limitation

1. Right Outer and full outer join not supported
2. Exists /in with Sub Query
3. No Union Selects
4. FetchXml reports cannot use Non- CRM online data sources
5. Max Records -50 k
6. Very different from SQL

Integration

Two main types of integrations :

1. System Integration
ADFS , Single Sign on , MS- Office
2. Data Integration
Exchange of for example customer data between systems

Integration Scenarios

1. Office 365 (Exchange online , sharepoint online ,SSO)
2. Web sites/Intranet
3. ERP
4. Service
=> Address Validation
=> Postcode Checks
=> Maps (Bing/ Soical Maps)
5. Social Media (Twitter , facebook, linkedin, yammer)


Integration Basics

1. Integration Basics
* Point to Point (Event based example create , update , delete)
* loosely coupled (Publisher -Subscriber)
2. Integration Technique
* Message based (MSMQ)
* Web Service
* Enterprise Service bus


Integration Patterns (Data)

1. One Time (Migrations)
a.Initial data
b.Static data
2. Batch Integration
a.Scheduled
b.Results seen later
3. Near to real time integrations
a. Continouse
b. (Almost) direct results

Cloud vs On Premise

1.Cloud
a. CRM Online
b. Partner Hosted (Shared & Private)
2. On Premise

a.ERP
b.Security

Software 

1. Dynamics Connector
2. Excel
3. Sql Server
a.Integration Service
b.Reporting Service
4. Scribe Insight
5. Biztalk
6. Tailor made solutions (Programming)


Success Factor 

1. Analyze /Design
2. Build
3. Test
=> Technical
4. Test
=> Functional
5. Test , more Testing
6. Go- Live

https://www.youtube.com/watch?v=OFezT58_gUM&spfreload=10