Answers.Body: <p>It is INCREDIBLY difficult to migrate data from Raiser's Edge.  You will definitely want to use an ETL tool, as suggested in another answer.  </p>
  
  <p>I have made my documentation available <a href="https://hq.megaphonetech.com/projects/commons/wiki/Exporting_Raisers_Edge_for_CiviCRM" rel="nofollow noreferrer">here</a>.  I also have my Raiser's Edge to CiviCRM transforms available <a href="https://github.com/PalanteJon/civicrm_kettle_transforms" rel="nofollow noreferrer">here</a>.  There's also a video available <a href="https://vimeo.com/65286095" rel="nofollow noreferrer">here</a>.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2016-02-26T02:26:23.877Z
Answers.LastActivityDate: 2018-06-11T14:41:38.620Z
Answers.LastEditDate: 2018-06-11T14:41:38.620Z
Answers.UserDisplayName: Jon G - Megaphone Tech
Answers.Body: <p>I've recently done this myself with around 6800 contacts and 860 activities, when a new member organisation (who were previously using their own Raiser's Edge installation) joined and wanted to move their data to our platform. They provided various CSV files exported from Raiser's Edge.</p>
  
  <p>I wrote some scripts, to load the CSV files and translate each line into the parameters to a chained API request. There was extra work in differentiating e-mail addresses from phone numbers, checking for invalid input, the different parts of postal addresses, date formatting, and things that were given as text in the data provided but are stored as IDs in Civi. We also needed to add several new titles/prefixes.</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-02-23T10:21:04.553Z
Answers.LastActivityDate: 2016-02-23T10:21:04.553Z
Answers.UserDisplayName: DaveFF
Answers.Body: <p>To migrate you will need some kind of ETL process (Extraction, Transformation, and Loading).</p>
  
  <p>If you have experience with Pentaho, it has an adapter for civicrm and might be faster.</p>
  
  <p>If you don't, it's probably faster to write a php-cli script that goes through the data exported and re-create it using CiviCRM API.</p>
  
  <p>This being said, the harder in that kind of job it to find for each row for each entity in the source system where to put it in the destination one. And how to deal with "impedence mismatch". As an example, CiviCRM expects to have the first and last name separated, but some other system have the name in a single field. Is the first "word" mostly the first name or last name? What to do when you have 3 words, is this two first names and one last name or the other way around?</p>
  
  <p>Erik's suggestion of reaching to someone that has already done that work and done the mistakes you always do the first time is a wise answer IMO, but nothing is impossible, just time consuming ;)</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-02-23T08:23:56.700Z
Answers.LastActivityDate: 2016-02-23T19:34:35.470Z
Answers.LastEditDate: 2016-02-23T19:34:35.470Z
Answers.UserDisplayName: Xavier
Answers.Body: <p>Just to add to the mix, we did a migration using the <a href="http://www.fuzion.co.nz/content/migrate-2-civicrm-api-3-civimigrate" rel="nofollow">Migrate approach</a> that Eileen has favoured. Agree about the difficulty of making RE data 'fit' in to a civicrm structure.</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-02-26T02:39:48.987Z
Answers.LastActivityDate: 2016-02-26T02:39:48.987Z
Answers.UserDisplayName: petednz - fuzion
Answers.Body: <p>There are several not-so straight forward table mappings between Raiser's Edge (RE) and CiviCRM that require a lot of hand-holding and tweaking. Most of the basic contact information is easily transferred, but the constituent codes, prefixes, RE appeals, etc. don't map cleanly to a standard CiviCRM install.</p>
  
  <p>For large Raiser's Edge databases that contain more than 200k records these types of migrations using the API v3 can take days to complete. We use a RAMdisk mapped MySQL instance to speed up the import and have migrated 500k contacts in under less than 6 hours (compared to 96 hours per migration iteration if using disk based MySQL.)</p>
  
  <p>For these types of migrations from Raiser's Edge to CiviCRM it's important to be able to add new data mappings incrementally to the ETL and a flexible tool like Pentaho Data Integration is key.</p>
  
  <p>Emphanos has an existing ETL process that can take a Raiser's Edge SQL Server .BAK file backup and creates a CiviCRM migrated instance that maps about 85% of all fields and performs a full migration with sub-sampling of about 2000 contact records in less than 1 hour.</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-03-22T21:48:13.697Z
Answers.LastActivityDate: 2017-03-22T21:48:13.697Z
Answers.UserDisplayName: Young-Jin Kim
Body: <p>We have large data in Raisers edge.We need to migrate Raisers edge data to CiviCRM.</p>
  
  <p>How to migrate Raisers edge data to CiviCRM?</p>
  
Comments.ContentLicense: CC BY-SA 3.0
Comments.CreationDate: 2016-02-18T09:03:58.817Z
Comments.Text: I know the CiviCRM partner Emphanos has experience in migrating data from Raisers Edge to CiviCRM?
Comments.UserDisplayName: ErikH - CiviCooP
Comments.ContentLicense: CC BY-SA 3.0
Comments.CreationDate: 2016-02-18T19:00:21.460Z
Comments.Text: I suspect this question might be too wide ranging for Stack Exchange! From my reading it looks a complex topic. Jon Goldberg from Palante Tech gave a talk on it at CiviCon last year, I think the talks in that room were recorded so maybe try tracking it down? That plus Erik's reply below indicates there's more than one team in the CiviCRM community who can help you with this project - I can't recommend from experience with RE but here you have two names and there are more at https://civicrm.org/experts
Comments.UserDisplayName: Chris Burgess
Tags: <import><evaluating-civicrm>
Title: How to migrate Raisers edge data to CiviCRM?
ThreadText: # How to migrate Raisers edge data to CiviCRM?
  
  (Asked by: username_0 on 2016-02-18)
  
  We have large data in Raisers edge.We need to migrate Raisers edge data to CiviCRM.
  
  How to migrate Raisers edge data to CiviCRM?
  
  **Tags:** import, evaluating-civicrm
  
  > **Comments:**
  > **username_1**: I know the CiviCRM partner Emphanos has experience in migrating data from Raisers Edge to CiviCRM?  
  > **username_2**: I suspect this question might be too wide ranging for Stack Exchange! From my reading it looks a complex topic. Jon Goldberg from Palante Tech gave a talk on it at CiviCon last year, I think the talks in that room were recorded so maybe try tracking it down? That plus Erik's reply below indicates there's more than one team in the CiviCRM community who can help you with this project - I can't recommend from experience with RE but here you have two names and there are more at https://civicrm.org/experts  
  
  ---
  
  ## 5 answers
  
  ### Answer by username_3 on 2016-02-26. Score: 5
  
  It is INCREDIBLY difficult to migrate data from Raiser's Edge. You will definitely want to use an ETL tool, as suggested in another answer.
  
  I have made my documentation available [here](https://hq.megaphonetech.com/projects/commons/wiki/Exporting_Raisers_Edge_for_CiviCRM). I also have my Raiser's Edge to CiviCRM transforms available [here](https://github.com/PalanteJon/civicrm_kettle_transforms). There's also a video available [here](https://vimeo.com/65286095).
  
  
  ---
  
  ### Answer by username_4 on 2016-02-23. Score: 2
  
  I've recently done this myself with around 6800 contacts and 860 activities, when a new member organisation (who were previously using their own Raiser's Edge installation) joined and wanted to move their data to our platform. They provided various CSV files exported from Raiser's Edge.
  
  I wrote some scripts, to load the CSV files and translate each line into the parameters to a chained API request. There was extra work in differentiating e-mail addresses from phone numbers, checking for invalid input, the different parts of postal addresses, date formatting, and things that were given as text in the data provided but are stored as IDs in Civi. We also needed to add several new titles/prefixes.
  
  
  ---
  
  ### Answer by username_5 on 2016-02-23. Score: 2
  
  To migrate you will need some kind of ETL process (Extraction, Transformation, and Loading).
  
  If you have experience with Pentaho, it has an adapter for civicrm and might be faster.
  
  If you don't, it's probably faster to write a php-cli script that goes through the data exported and re-create it using CiviCRM API.
  
  This being said, the harder in that kind of job it to find for each row for each entity in the source system where to put it in the destination one. And how to deal with "impedence mismatch". As an example, CiviCRM expects to have the first and last name separated, but some other system have the name in a single field. Is the first "word" mostly the first name or last name? What to do when you have 3 words, is this two first names and one last name or the other way around?
  
  Erik's suggestion of reaching to someone that has already done that work and done the mistakes you always do the first time is a wise answer IMO, but nothing is impossible, just time consuming ;)
  
  
  ---
  
  ### Answer by username_6 on 2016-02-26. Score: 1
  
  Just to add to the mix, we did a migration using the [Migrate approach](http://www.fuzion.co.nz/content/migrate-2-civicrm-api-3-civimigrate) that Eileen has favoured. Agree about the difficulty of making RE data 'fit' in to a civicrm structure.
  
  
  ---
  
  ### Answer by username_7 on 2017-03-22. Score: 1
  
  There are several not-so straight forward table mappings between Raiser's Edge (RE) and CiviCRM that require a lot of hand-holding and tweaking. Most of the basic contact information is easily transferred, but the constituent codes, prefixes, RE appeals, etc. don't map cleanly to a standard CiviCRM install.
  
  For large Raiser's Edge databases that contain more than 200k records these types of migrations using the API v3 can take days to complete. We use a RAMdisk mapped MySQL instance to speed up the import and have migrated 500k contacts in under less than 6 hours (compared to 96 hours per migration iteration if using disk based MySQL.)
  
  For these types of migrations from Raiser's Edge to CiviCRM it's important to be able to add new data mappings incrementally to the ETL and a flexible tool like Pentaho Data Integration is key.
  
  Emphanos has an existing ETL process that can take a Raiser's Edge SQL Server .BAK file backup and creates a CiviCRM migrated instance that maps about 85% of all fields and performs a full migration with sub-sampling of about 2000 contact records in less than 1 hour.
  
  
  ---
  
  