The topic of violence against women and girls dominated First Minister's Questions on Thursday.
It comes following a pledge by Mr Swinney during his programme for government to tackle the serious issue - which includes plans to bring forward a misogyny bill and launch a public health campaign to challenge misogynistic attitudes in boys and young men.
The recent murder cases of Vikki Soloman and Stacy Hunter were highlighted at Holyrood by Scottish Liberal Democrats leader Alex Cole-Hamilton.
Mr Cole-Hamilton previously worked closely with aesthetician Ms Soloman as new laws governing the beauty sector passed through the parliament in March.
He said to Mr Swinney: "In our last exchange before the summer recess, I asked the first minister about protecting women and girls from male violence.
"In the following month, three Scottish women died at the hands of men.
"I went to the funeral of one of them. Vikki Soloman was 44. She was a mum, a passionate advocate for the beauty industry, and she was known to several of us here in this chamber.
"She called the police asking for help following an assault by the man who hours later would go on to kill her.
"The police did not attend.
"Stacy Hunter was murdered by an ex-partner out on bail, who should have been nowhere near her.
"Can the first minister see that there is a pattern here of women being let down by the system, horrifically let down, and with fatal consequences?"
In response, Mr Swinney said "women must be given the ability to raise their concerns, make their complaints, and to have those taken seriously by the police and by the Crown".
Lee Greenan, 46, is believed to have murdered mum-of-two Ms Soloman, 44, at a house in Edinburgh's Craigievar Square on 20 July.
Greenan was facing charges of assault to injury, murder and assault when he was found dead at HMP Edinburgh on 26 July.
Police Scotland's actions in the lead-up to the murder are currently under investigation by the Police Investigations and Review Commissioner (PIRC) following instruction from the Crown Office and Procurator Fiscal Service (COPFS).
Ms Hunter, 35, was found dead at a cottage in Houston, Renfrewshire, on 27 July.
Her husband, Jim Mair, 43, was also found dead at the property.
Police Scotland said it was treating Ms Hunter's death as murder, while Mair's was classified as "unexplained".
The force said there was "nothing to suggest" anyone else was involved.
It later emerged Mair had been granted bail after appearing in court on 6 July charged with assaulting his wife.
Scottish Conservative leader Russell Findlay highlighted the case of Samantha Lee, 54, who was murdered by partner Joseph Greer, 40, in a violent claw hammer attack in Aberdeen in January.
Greer - who last month received a life sentence with at least 22 years behind bars - had earlier been accused of assaulting Ms Lee and was out on bail at the time of the fatal attack with an order not to approach her.
Mr Findlay called on Mr Swinney to roll back on bail laws that were changed in 2023.
The Bail and Release from Custody (Scotland) Act 2023 made holding people in jail before trial a last resort.
Acting Scottish Labour leader Dame Jackie Baillie also highlighted the murder of Claire Inglis.
Christopher McGowan beat and strangled Ms Inglis, 28, at her flat in Stirling in November 2021.
The mother-of-one suffered 76 injuries in the attack, which included being burned with a lighter and having a wet wipe pushed down her throat.
Serial offender McGowan - who received a life sentence with a minimum of 23 years behind bars in October 2023 - had been bailed multiple times to Ms Inglis' home in the months leading up to her death.
Ms Baillie said Ms Hunter's family are calling for GPS tracking for violent offenders to be implemented.
She said: "Women are being failed even after abusers are known to the justice system.
"Stacy's family has demanded that the SNP government catch up with other countries and roll out GPS tracking of violent offenders on bail, but the justice secretary has been unable to say when this will be in place."
Mr Swinney said pilot work is under way to eventually roll out GPS tracking of criminals on bail.
He said: "I don't think I could have been more open about the sense of shock I feel about what we've experienced in Scotland over the summer about the violence against women and girls.
"And for all the involvement I've had in areas of policy in the past, I am determined to make sure this has got the strongest possible and emphatic leadership from the first minister.
"I am a male first minister. At the heart of all of this is the behaviour of men and boys, and there has to be a cultural effort."
Mr Swinney added: "The government's communication is important.
"These exchanges are important as well, because it gives me an opportunity to say to parliament - and to the country - that male violence against women is absolutely and completely unacceptable, and every aspect of the state is going to be deployed to root it out."