The UK-based Syrian Observatory for Human Rights reported that six women and a child were among those who died in the raids on al-Heisha overnight.
The IS-held village has been the target of a US-backed alliance of Kurdish and Arab fighters seeking to capture Raqqa.
A coalition spokesman confirmed that it had conducted strikes in the area.
But Col John Dorrian told the AFP news agency that "more specific information is needed to conclusively determine responsibility" for any civilian casualties.
A coalition statement said seven strikes near the town of Ain Issa, about 14km (9 miles) west of al-Heisha, on Tuesday had engaged six IS tactical units and destroyed three fighting positions, a vehicle, and a car bomb facility.
A spokeswoman for the Kurdish-Arab alliance, the Syria Democratic Forces (SDF), dismissed the reports of civilian casualties as "IS news".
On Sunday, the SDF announced that it had begun a campaign to isolate and ultimately take control of Raqqa, which IS has controlled for almost three years.
The initial report of the air strike on al-Heisha, about 40km (25 miles) north of Raqqa, came from the anti-IS activist group, Raqqa is Being Slaughtered Silently.
It said 23 people had been killed and identified all but four of them.
On Wednesday, the Syrian Observatory said 20 had been killed and about 30 others wounded in the attack.
The SDF said some 200 families had fled al-Heisha. One of the residents who escaped, Saada al-Aboud, told AFP: "[IS] fighters brought heavy weapons to our village and stayed among us so that if there were strikes they would hit us."
"They wouldn't let us leave. We had to escape by running out into the fields, with our children and old people. What else could we do? We left everything behind."
The Syrian Observatory says at least 680 civilians, including 169 children, have been killed since coalition air strikes began in Syria two years ago.
However, the coalition has admitted responsibility for only 55 civilian deaths in both Syria and neighbouring Iraq between August 2014 and July 2016.
Last month, Amnesty International said some 100 civilians appeared to have been killed in three coalition air strikes in June and July 2016 around Manbij, north-west of Raqqa, during an SDF operation to drive IS militants out of the town.

"I pay homage to the women of Paraguay, who were able to rebuild a country destroyed by an unequal war," he said.
Most of Paraguay's male population died in a devastating war against Brazil, Argentina and Uruguay between 1865 and 1870.
"God protect Paraguayan women, the most glorious of the Americas," he said.
Hundreds of thousands of people went for the Mass at the Shrine of Caacupe, some 50 Km (30 miles) from the capital Asuncion.
Many of them came from neighbouring Argentina and waved the blue-and-white flags of Pope Francis's native country.
"Argentina is his homeland. He is not coming home yet, so we brought it to him," Carmen Mesa, 56, told the Associated Press (AP) news agency.
Pope Francis said the visit to Caacupe would be an emotional occasion to him.
Before becoming a Pope, he travelled many times to the city, known as the spiritual capital of Paraguay.
"I feel at home, here. I came here many times to renew my wishes of living according to the Gospel," he said during Mass.
The Pope's religious order, the Jesuits, evangelised the region in the 1600s.
Pope Francis said the Lord's Prayer in Guarani, the indigenous language spoken by most of the population.
Guarani is an official language along with Spanish in Paraguay.
"I would like to remind you that we are all brothers and sisters," Pope Francis said.
Paraguay is the last stop on the Pope's eight-day tour of South America, which also took him to Ecuador and Bolivia.
The Vatican said the Pope had chosen some of the poorer countries of the region for his visit to reflected his interest in the "peripheries".
Pope Francis is the first leader of the Roman Catholic Church to come from South America.
"Progress and development must ensure a better future for all," Pope Francis said in a speech on the Quito airport runway on Monday after he was welcomed by Ecuadorean President Rafael Correa.
A US-led coalition air strike killed at least 20 civilians in a village north of so-called Islamic State's Syrian stronghold of Raqqa, activists say.
[NEXT_CONCEPT]
Pope Francis has paid a tribute to Paraguay's women and mothers during Mass celebrated at the country's main pilgrimage site, Caacupe,