Answers.Body: <p>You have several options, which I detail below - but I think the most important thing to do is check your <a href="https://civicrm.stackexchange.com/a/15932/12">CiviCRM log</a>.  It's likely to tell you what your problem is.</p>
  
  <p>Past that:</p>
  
  <p>One option is to adjust your php.ini settings to change the <a href="http://php.net/manual/en/info.configuration.php#ini.max-execution-time" rel="nofollow noreferrer">max_execution_time</a> to zero.  You can also do this in <code>civicrm.settings.php</code> if you prefer.</p>
  
  <p>Another is to import your data on the command line using the <a href="https://civicrm.stackexchange.com/a/4724/12">API CSV import tool</a> - but this requires breaking up your data into separate entities (e.g. Contact, Address, Email, etc.).  This is very efficient on large imports but not worth it unless you can script it (e.g. with <a href="https://www.hitachivantara.com/en-us/products/big-data-integration-analytics/pentaho-data-integration.html" rel="nofollow noreferrer">Pentaho Data Integration</a>).</p>
  
  <p>I agree that it's very likely that either geocoding or USPS address validation is likely a culprit - but the easiest way to test that is to disable, do a test import and check the result.</p>
  
  <p>If you're a programmer and don't like using Pentaho, you could also try writing an importer that uses the <a href="https://lab.civicrm.org/extensions/advimport" rel="nofollow noreferrer">advimport</a> extension.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2018-12-31T03:32:36.217Z
Answers.LastActivityDate: 2018-12-31T03:32:36.217Z
Answers.UserDisplayName: Jon G - Megaphone Tech
Body: <p>I am importing CSV files, about 7000 contacts per import, about 20 fields per contact, about 800kb sile size.  DB size is about 55k, issue arose at about 20k.  Since then, it times out after 2000ish records.  The importation ultimately executes with fields and data appearing to correctly function thus far through testing.</p>
  
  <p>Issue is the importation process freezes.  It seems to run about 4 to 5 minutes, then apparently times out.  Server demonstrates mysql processes, usually about 6-10, in sleep state when "time out" occurs.  Checking table in phpmyadmin, I can quickly see where to edit csv file to continue.  </p>
  
  <p>I am not deduping, though I am validating address data.  I suspect the address validation is causing the issue.   Does the USPS address validator have a "counter" on it that is now limiting my "per day/then/per session" usage?</p>
  
  <p>I verified the processor, free memory, file size, etc are all way under utilized.  </p>
  
  <p>Rememdy is kill all user/application processes, repair database and continue forward.  </p>
  
  <p>But, if I can adjust a setting to enable better processing, without sacrificing security, pls share.</p>
  
  <p>Thx </p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2018-12-31T19:00:55.097Z
Comments.Text: I've rarely had good luck importing more than 500-800 contacts in one shot with CiviCRM.  Have you tried splitting your import into smaller batches?
Comments.UserDisplayName: Lesley Carter - BackOffice
Tags: <import>
Title: Import Contact Issue
ThreadText: # Import Contact Issue
  
  (Asked by: username_0 on 2018-12-31)
  
  I am importing CSV files, about 7000 contacts per import, about 20 fields per contact, about 800kb sile size. DB size is about 55k, issue arose at about 20k. Since then, it times out after 2000ish records. The importation ultimately executes with fields and data appearing to correctly function thus far through testing.
  
  Issue is the importation process freezes. It seems to run about 4 to 5 minutes, then apparently times out. Server demonstrates mysql processes, usually about 6-10, in sleep state when "time out" occurs. Checking table in phpmyadmin, I can quickly see where to edit csv file to continue.
  
  I am not deduping, though I am validating address data. I suspect the address validation is causing the issue. Does the USPS address validator have a "counter" on it that is now limiting my "per day/then/per session" usage?
  
  I verified the processor, free memory, file size, etc are all way under utilized.
  
  Rememdy is kill all user/application processes, repair database and continue forward.
  
  But, if I can adjust a setting to enable better processing, without sacrificing security, pls share.
  
  Thx
  
  **Tags:** import
  
  > **Comments:**
  > **username_1**: I've rarely had good luck importing more than 500-800 contacts in one shot with CiviCRM.  Have you tried splitting your import into smaller batches?  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_2 on 2018-12-31. Score: 2
  
  You have several options, which I detail below - but I think the most important thing to do is check your [CiviCRM log](https://civicrm.stackexchange.com/a/15932/12). It's likely to tell you what your problem is.
  
  Past that:
  
  One option is to adjust your php.ini settings to change the [max\_execution\_time](http://php.net/manual/en/info.configuration.php#ini.max-execution-time) to zero. You can also do this in `civicrm.settings.php` if you prefer.
  
  Another is to import your data on the command line using the [API CSV import tool](https://civicrm.stackexchange.com/a/4724/12) - but this requires breaking up your data into separate entities (e.g. Contact, Address, Email, etc.). This is very efficient on large imports but not worth it unless you can script it (e.g. with [Pentaho Data Integration](https://www.hitachivantara.com/en-us/products/big-data-integration-analytics/pentaho-data-integration.html)).
  
  I agree that it's very likely that either geocoding or USPS address validation is likely a culprit - but the easiest way to test that is to disable, do a test import and check the result.
  
  If you're a programmer and don't like using Pentaho, you could also try writing an importer that uses the [advimport](https://lab.civicrm.org/extensions/advimport) extension.
  
  
  ---
  
  