Is it not conceit when you compare yourself to other people? Are we not thinking of ourselves as either you're better than they are, or equal to them, or worse that they are?
From the Buddhist viewpoint, conceit is a delusion that convinces us that we are the sum of our experiences. When we compare ourselves to others, we create a sense of self in our minds. then that sense of self is involved in comparison to others that generates "self" inflicted suffering, which is where the concept of no-self comes into Buddhist thought as an antidote to that particular suffering. 

According to the Buddha, there are three conceits. The first conceit, I am better that others, leads to pride and arrogance. The second, I am worse than others, leads to envy or resentment. The third, I am the same as others, generates complacency.

"And what are the three kinds of conceit that are to be abandoned? (1) Conceit, (2) the inferiority complex, and (3) arrogance: these are the three kinds of conceit that are to be abandoned."
from AN 6.106, translated by Bhikkhu Bodhi

Conceit is among that which defiles the mind, and can generate several of the others on that list.

"Imperfections that defile the mind:
(1) covetousness and unrighteous greed
(2) ill will
(3) anger
(4) revenge
(5) contempt
(6) a domineering attitude
(7) envy
(8) avarice
(9) deceit
(10) fraud
(11) obstinacy
(12) presumption
(13) conceit (mana)
(14) arrogance
(15) vanity
(16) negligence"
from MN7, translated by Bhikkhu Nanamoli and Bhikkhu Bodhi

Lastly, the short answer to your question is...Yes.