Answers.Body: <h2>The first issue is formally defining when two web pages are similar.</h2>
  <p>For example, using different CSS style sheets on the (otherwise) same HTML page will give very different appearance for web pages.</p>
  <p>And web browsers like <a href="https://dillo.org/" rel="nofollow noreferrer">dillo</a>, or <a href="http://links.twibright.com/" rel="nofollow noreferrer">links</a>, or firefox will have different behavior. Since some of them have a Javascript interpreter, and others don't (and since JavaScript has different and incompatible implementations the behavior would be different).</p>
  <p>PS. Very probably your problem can be proved equivalent to the <a href="https://en.wikipedia.org/wiki/Halting_problem" rel="nofollow noreferrer">Halting Problem</a>.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2024-09-25T14:32:40.393Z
Answers.LastActivityDate: 2024-09-25T14:32:40.393Z
Answers.UserDisplayName: Basile Starynkevitch
Body: <p>My task is to create a redirect map from old to the new site, based on matched similarity of urls, titles, descriptions and content embeddings.</p>
  <p>What algorithm would you recommend for such task?</p>
  
Tags: <similarity>
Title: What algorithms for matching webpage similarity?
UserDisplayName: Evgeniy
ThreadText: # What algorithms for matching webpage similarity?
  
  (Asked by: username_0 on 2024-09-25)
  
  My task is to create a redirect map from old to the new site, based on matched similarity of urls, titles, descriptions and content embeddings.
  
  What algorithm would you recommend for such task?
  
  **Tags:** similarity
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2024-09-25. Score: 1
  
  ## The first issue is formally defining when two web pages are similar.
  
  For example, using different CSS style sheets on the (otherwise) same HTML page will give very different appearance for web pages.
  
  And web browsers like [dillo](https://dillo.org/), or [links](http://links.twibright.com/), or firefox will have different behavior. Since some of them have a Javascript interpreter, and others don't (and since JavaScript has different and incompatible implementations the behavior would be different).
  
  PS. Very probably your problem can be proved equivalent to the [Halting Problem](https://en.wikipedia.org/wiki/Halting_problem).
  
  
  ---
  
  