<p dir="auto">Hi,</p>
<p dir="auto">We are having issues with duplication in the result set in one of our instances running 2.1.3.</p>
<p dir="auto">The topology is (task:Task)-[:HAS_STATE]-&gt;(state:TaskState) where the task has a unique ID, and the cardinality of the HAS_STATE is 1:1 (one state connected to the task via HAS_STATE):</p>
<p dir="auto"><a target="_blank" rel="noopener noreferrer nofollow" href="https://cloud.githubusercontent.com/assets/398184/4893303/d3fc4176-63bf-11e4-8159-847b877652b3.png"><img src="https://cloud.githubusercontent.com/assets/398184/4893303/d3fc4176-63bf-11e4-8159-847b877652b3.png" alt="single-result" style="max-width: 100%;"></a></p>
<p dir="auto">However, when queried for the state, it returns two exact duplicate rows. You can see that the id() of the relationship is the same:</p>
<p dir="auto"><a target="_blank" rel="noopener noreferrer nofollow" href="https://cloud.githubusercontent.com/assets/398184/4893312/dd0c36b8-63bf-11e4-9c2a-9a6f7ee4d390.png"><img src="https://cloud.githubusercontent.com/assets/398184/4893312/dd0c36b8-63bf-11e4-9c2a-9a6f7ee4d390.png" alt="duplicate-row-rel-id" style="max-width: 100%;"></a></p>
<p dir="auto">Doing a distinct brings it to the correct result of one row.</p>
<p dir="auto"><a target="_blank" rel="noopener noreferrer nofollow" href="https://cloud.githubusercontent.com/assets/398184/4893314/e220422a-63bf-11e4-94c7-9f1ffc98fba4.png"><img src="https://cloud.githubusercontent.com/assets/398184/4893314/e220422a-63bf-11e4-94c7-9f1ffc98fba4.png" alt="results-with-distinct" style="max-width: 100%;"></a></p>
<p dir="auto">However the weirdest part is that once the instance is restarted, the problem goes away:</p>
<p dir="auto"><a target="_blank" rel="noopener noreferrer nofollow" href="https://cloud.githubusercontent.com/assets/398184/4893315/e7922098-63bf-11e4-9c6a-506665330660.png"><img src="https://cloud.githubusercontent.com/assets/398184/4893315/e7922098-63bf-11e4-9c6a-506665330660.png" alt="after-restart" style="max-width: 100%;"></a></p>
<p dir="auto">I'm thinking this might be an issue with the cache, but there is no sure way in which we can reproduce it. Any input that might help for reproducing the issue or have you ever experienced this issue before?</p>
<p dir="auto">Thanks</p>
<p dir="auto">This is similar to a closed issue for 4.4.0 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1082179033" data-permission-text="Title is private" data-url="https://github.com/neo4j/neo4j/issues/12800" data-hovercard-type="issue" data-hovercard-url="/neo4j/neo4j/issues/12800/hovercard" href="https://github.com/neo4j/neo4j/issues/12800">#12800</a>), which indicated the problem was fixed in the next version. I suspect 4.4.14 qualifies as the next version, so perhaps the cause of this issue is different. Perhaps also relevant: I'm attempting to create the database on an external 5 TB HDD, and the source files (~670 GB of .tsv's) are on an internal 2 TB HDD. I previously attempted to create the database on a separate internal SDD, but the drive filled all-the-way up, so I wanted to use the largest storage device available.</p>
<p dir="auto">To help us understand your issue, please specify important details, primarily:</p>
<ul dir="auto">
<li>
<p dir="auto">Neo4j version: 4.4.14</p>
</li>
<li>
<p dir="auto">Operating system: Ubuntu 20.04</p>
</li>
<li>
<p dir="auto">API/Driver: neo4j-admin import</p>
</li>
<li>
<p dir="auto"><strong>Steps to reproduce</strong></p>
</li>
<li>
<ol dir="auto">
<li>Execute the import command:</li>
</ol>
</li>
</ul>
<div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="./bin/neo4j-admin import --skip-bad-relationships=true \
--database=oaone \
--skip-duplicate-nodes \
--ignore-empty-strings=true \
--verbose --delimiter='\t' \
--nodes=author=import/../../../neo4jdata/import/header_files/header_ent_auth.tsv,&quot;import/../../../neo4jdata/import/.*authors_\d.*tsv&quot; \
--nodes=concept=import/../../../neo4jdata/import/header_files/header_ent_cncpt.tsv,&quot;import/../../../neo4jdata/import/.*concept_\d.*tsv&quot; \
--nodes=institution=import/../../../neo4jdata/import/header_files/header_ent_inst.tsv,&quot;import/../../../neo4jdata/import/.*\d_institutions_\d+.*tsv&quot; \
--nodes=work=import/../../../neo4jdata/import/header_files/header_ent_wrks.tsv,&quot;import/../../../neo4jdata/import/.*\d_works_\d.*tsv&quot; \
--relationships=affiliation=import/../../../neo4jdata/import/header_files/header_rel_affil.tsv,&quot;import/../../../neo4jdata/import/.*affiliations_\d.*tsv&quot; \
--relationships=authorship=import/../../../neo4jdata/import/header_files/header_rel_authshps.tsv,&quot;import/../../../neo4jdata/import/.*authorships_\d.*tsv&quot; \
--relationships=similar=import/../../../neo4jdata/import/header_files/header_rel_ancest-cncpt.tsv,&quot;import/../../../neo4jdata/import/.*ancestor-concepts_\d.*tsv&quot; \
--relationships=similar=import/../../../neo4jdata/import/header_files/header_rel_auth_cncpt.tsv,&quot;import/../../../neo4jdata/import/.*authors_concepts_\d.*tsv&quot; \
--relationships=similar=import/../../../neo4jdata/import/header_files/header_rel_inst_cncpt.tsv,&quot;import/../../../neo4jdata/import/.*institutions_concepts_\d+.*tsv&quot; \
--relationships=similar=import/../../../neo4jdata/import/header_files/header_rel_rel_cncpts.tsv,&quot;import/../../../neo4jdata/import/.*related-concepts_\d.*tsv&quot; \
--relationships=similar=import/../../../neo4jdata/import/header_files/header_rel_insts.tsv,&quot;import/../../../neo4jdata/import/.*related_institutions_\d.*tsv&quot; \
--relationships=similar=import/../../../neo4jdata/import/header_files/header_rel_wrks.tsv,&quot;import/../../../neo4jdata/import/.*related_works_\d+.*tsv&quot; \
--relationships=similar=import/../../../neo4jdata/import/header_files/header_rel_wrks_cncpts.tsv,&quot;import/../../../neo4jdata/import/.*work_concepts_\d.*tsv&quot;"><pre class="notranslate"><code class="notranslate">./bin/neo4j-admin import --skip-bad-relationships=true \
--database=oaone \
--skip-duplicate-nodes \
--ignore-empty-strings=true \
--verbose --delimiter='\t' \
--nodes=author=import/../../../neo4jdata/import/header_files/header_ent_auth.tsv,"import/../../../neo4jdata/import/.*authors_\d.*tsv" \
--nodes=concept=import/../../../neo4jdata/import/header_files/header_ent_cncpt.tsv,"import/../../../neo4jdata/import/.*concept_\d.*tsv" \
--nodes=institution=import/../../../neo4jdata/import/header_files/header_ent_inst.tsv,"import/../../../neo4jdata/import/.*\d_institutions_\d+.*tsv" \
--nodes=work=import/../../../neo4jdata/import/header_files/header_ent_wrks.tsv,"import/../../../neo4jdata/import/.*\d_works_\d.*tsv" \
--relationships=affiliation=import/../../../neo4jdata/import/header_files/header_rel_affil.tsv,"import/../../../neo4jdata/import/.*affiliations_\d.*tsv" \
--relationships=authorship=import/../../../neo4jdata/import/header_files/header_rel_authshps.tsv,"import/../../../neo4jdata/import/.*authorships_\d.*tsv" \
--relationships=similar=import/../../../neo4jdata/import/header_files/header_rel_ancest-cncpt.tsv,"import/../../../neo4jdata/import/.*ancestor-concepts_\d.*tsv" \
--relationships=similar=import/../../../neo4jdata/import/header_files/header_rel_auth_cncpt.tsv,"import/../../../neo4jdata/import/.*authors_concepts_\d.*tsv" \
--relationships=similar=import/../../../neo4jdata/import/header_files/header_rel_inst_cncpt.tsv,"import/../../../neo4jdata/import/.*institutions_concepts_\d+.*tsv" \
--relationships=similar=import/../../../neo4jdata/import/header_files/header_rel_rel_cncpts.tsv,"import/../../../neo4jdata/import/.*related-concepts_\d.*tsv" \
--relationships=similar=import/../../../neo4jdata/import/header_files/header_rel_insts.tsv,"import/../../../neo4jdata/import/.*related_institutions_\d.*tsv" \
--relationships=similar=import/../../../neo4jdata/import/header_files/header_rel_wrks.tsv,"import/../../../neo4jdata/import/.*related_works_\d+.*tsv" \
--relationships=similar=import/../../../neo4jdata/import/header_files/header_rel_wrks_cncpts.tsv,"import/../../../neo4jdata/import/.*work_concepts_\d.*tsv"
</code></pre></div>
<ul dir="auto">
<li>
<p dir="auto">Expected behavior<br>
Creation of database</p>
</li>
<li>
<p dir="auto">Actual behavior<br>
Import failed</p>
</li>
</ul>
<p dir="auto">BASH PRINTOUTS:</p>
<div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="Available resources:                                 
  Total machine memory: 755.8GiB                                                                                           
  Free machine memory: 654.9GiB                        
  Max heap memory : 29.97GiB                                                                                                                                                                                                                           
  Processors: 72                                                                                                           
  Configured max memory: 653.2GiB                                                                                          
  High-IO: false                                                                                                           
                                                             
Type normalization:                                         
  Property type of 'latitude' normalized from 'float' --&gt; 'double' in /media/neo4j_5TB/neo4j-community-4.4.14/import/../../../neo4jdata/import/header_files/header_ent_inst.tsv
  Property type of 'longitude' normalized from 'float' --&gt; 'double' in /media/neo4j_5TB/neo4j-community-4.4.14/import/../../../neo4jdata/import/header_files/header_ent_inst.tsv
  Property type of 'cited_by_count' normalized from 'int' --&gt; 'long' in /media/neo4j_5TB/neo4j-community-4.4.14/import/../../../neo4jdata/import/header_files/header_ent_inst.tsv
  Property type of 'cited_by_count' normalized from 'int' --&gt; 'long' in /media/neo4j_5TB/neo4j-community-4.4.14/import/../../../neo4jdata/import/header_files/header_ent_wrks.tsv
  Property type of 'cited_by_count' normalized from 'int' --&gt; 'long' in /media/neo4j_5TB/neo4j-community-4.4.14/import/../../../neo4jdata/import/header_files/header_ent_auth.tsv
  Property type of 'level' normalized from 'int' --&gt; 'long' in /media/neo4j_5TB/neo4j-community-4.4.14/import/../../../neo4jdata/import/header_files/header_ent_cncpt.tsv
  Property type of 'score' normalized from 'float' --&gt; 'double' in /media/neo4j_5TB/neo4j-community-4.4.14/import/../../../neo4jdata/import/header_files/header_rel_auth_cncpt.tsv
  Property type of 'score' normalized from 'float' --&gt; 'double' in /media/neo4j_5TB/neo4j-community-4.4.14/import/../../../neo4jdata/import/header_files/header_rel_inst_cncpt.tsv
  Property type of 'score' normalized from 'float' --&gt; 'double' in /media/neo4j_5TB/neo4j-community-4.4.14/import/../../../neo4jdata/import/header_files/header_rel_rel_cncpts.tsv
Nodes, started 2022-11-21 13:18:07.041+0000                                                                                
[*Nodes:0B/s 2.792GiB-------------------------------------------------------------------------] 239M ∆80.0KCritical error occurred! Shutting down the import...
[*Nodes:0B/s 2.799GiB-------------------------------------------------------------------------] 241M ∆ 300K
IMPORT FAILED in 14m 25s 379ms. 
Data statistics is not available.
Peak memory usage: 0B"><pre class="notranslate"><code class="notranslate">Available resources:                                 
  Total machine memory: 755.8GiB                                                                                           
  Free machine memory: 654.9GiB                        
  Max heap memory : 29.97GiB                                                                                                                                                                                                                           
  Processors: 72                                                                                                           
  Configured max memory: 653.2GiB                                                                                          
  High-IO: false                                                                                                           
                                                             
Type normalization:                                         
  Property type of 'latitude' normalized from 'float' --&gt; 'double' in /media/neo4j_5TB/neo4j-community-4.4.14/import/../../../neo4jdata/import/header_files/header_ent_inst.tsv
  Property type of 'longitude' normalized from 'float' --&gt; 'double' in /media/neo4j_5TB/neo4j-community-4.4.14/import/../../../neo4jdata/import/header_files/header_ent_inst.tsv
  Property type of 'cited_by_count' normalized from 'int' --&gt; 'long' in /media/neo4j_5TB/neo4j-community-4.4.14/import/../../../neo4jdata/import/header_files/header_ent_inst.tsv
  Property type of 'cited_by_count' normalized from 'int' --&gt; 'long' in /media/neo4j_5TB/neo4j-community-4.4.14/import/../../../neo4jdata/import/header_files/header_ent_wrks.tsv
  Property type of 'cited_by_count' normalized from 'int' --&gt; 'long' in /media/neo4j_5TB/neo4j-community-4.4.14/import/../../../neo4jdata/import/header_files/header_ent_auth.tsv
  Property type of 'level' normalized from 'int' --&gt; 'long' in /media/neo4j_5TB/neo4j-community-4.4.14/import/../../../neo4jdata/import/header_files/header_ent_cncpt.tsv
  Property type of 'score' normalized from 'float' --&gt; 'double' in /media/neo4j_5TB/neo4j-community-4.4.14/import/../../../neo4jdata/import/header_files/header_rel_auth_cncpt.tsv
  Property type of 'score' normalized from 'float' --&gt; 'double' in /media/neo4j_5TB/neo4j-community-4.4.14/import/../../../neo4jdata/import/header_files/header_rel_inst_cncpt.tsv
  Property type of 'score' normalized from 'float' --&gt; 'double' in /media/neo4j_5TB/neo4j-community-4.4.14/import/../../../neo4jdata/import/header_files/header_rel_rel_cncpts.tsv
Nodes, started 2022-11-21 13:18:07.041+0000                                                                                
[*Nodes:0B/s 2.792GiB-------------------------------------------------------------------------] 239M ∆80.0KCritical error occurred! Shutting down the import...
[*Nodes:0B/s 2.799GiB-------------------------------------------------------------------------] 241M ∆ 300K
IMPORT FAILED in 14m 25s 379ms. 
Data statistics is not available.
Peak memory usage: 0B
</code></pre></div>
<p dir="auto">Additionally, include (as appropriate) log-files, stacktraces, and other debug output.</p>
<p dir="auto">DEBUG.LOG CONTENTS</p>
<div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="2022-11-21 12:53:18.089+0000 INFO  [o.n.k.i.s.f.RecordFormatSelector] Record format not configured, selected default: RecordFormat:PageAlignedV4_3[AF4.3.0]
2022-11-21 12:53:19.056+0000 INFO  [o.n.i.b.ImportLogic] Import starting
2022-11-21 13:09:11.234+0000 INFO  [o.n.k.i.s.f.RecordFormatSelector] Record format not configured, selected default: RecordFormat:PageAlignedV4_3[AF4.3.0]
2022-11-21 13:09:11.960+0000 INFO  [o.n.i.b.ImportLogic] Import starting
2022-11-21 13:09:38.811+0000 INFO  [o.n.k.i.s.f.RecordFormatSelector] Record format not configured, selected default: RecordFormat:PageAlignedV4_3[AF4.3.0]
2022-11-21 13:16:23.601+0000 INFO  [o.n.k.i.s.f.RecordFormatSelector] Record format not configured, selected default: RecordFormat:PageAlignedV4_3[AF4.3.0]
2022-11-21 13:16:24.324+0000 INFO  [o.n.i.b.ImportLogic] Import starting
2022-11-21 13:30:49.720+0000 INFO  [o.n.i.b.ImportLogic] Import failed, took 14m 25s 379ms. Data statistics is not available."><pre class="notranslate"><code class="notranslate">2022-11-21 12:53:18.089+0000 INFO  [o.n.k.i.s.f.RecordFormatSelector] Record format not configured, selected default: RecordFormat:PageAlignedV4_3[AF4.3.0]
2022-11-21 12:53:19.056+0000 INFO  [o.n.i.b.ImportLogic] Import starting
2022-11-21 13:09:11.234+0000 INFO  [o.n.k.i.s.f.RecordFormatSelector] Record format not configured, selected default: RecordFormat:PageAlignedV4_3[AF4.3.0]
2022-11-21 13:09:11.960+0000 INFO  [o.n.i.b.ImportLogic] Import starting
2022-11-21 13:09:38.811+0000 INFO  [o.n.k.i.s.f.RecordFormatSelector] Record format not configured, selected default: RecordFormat:PageAlignedV4_3[AF4.3.0]
2022-11-21 13:16:23.601+0000 INFO  [o.n.k.i.s.f.RecordFormatSelector] Record format not configured, selected default: RecordFormat:PageAlignedV4_3[AF4.3.0]
2022-11-21 13:16:24.324+0000 INFO  [o.n.i.b.ImportLogic] Import starting
2022-11-21 13:30:49.720+0000 INFO  [o.n.i.b.ImportLogic] Import failed, took 14m 25s 379ms. Data statistics is not available.
</code></pre></div>