Jayne Ozanne quit the panel, along with two other advisers, claiming delays in banning conversion therapy.

She told the BBC Ms Badenoch did not understand the LGBT+ community and should stand aside for someone who "had more heart for the work".

The government vowed to produce a plan to "end" conversion therapy "shortly".

Campaigners want legislation banning the controversial practice, which aims to change sexual orientation or gender identity.

Downing Street said it was considering "both legislative and non-legislative options" to "bring an end to" it.

But, asked if that meant it could end up with measures short of a ban, a spokesman refused to go further.

In July last year, the prime minister said the practice was "absolutely abhorrent" and said plans to ban it would be brought forward.

In a debate in Parliament on Monday, Ms Badenoch said conversion therapy had "no place in a civilised society", but added that "robust" laws were already in place to deal with the most troubling examples, involving violence and sexual assault.

She said the government did not "intend to stop those who wish to seek spiritual counselling as they explore their sexual orientation."

But she added: "There will also be cases where a line is crossed, where someone is actively seeking to change another's sexual orientation."

"The government will be exercising great care when considering what constitutes conversion therapy, what does not and therefore how the government should intervene," Ms Badenoch said.

Ms Ozanne told the BBC she thought it had been an "appalling speech" and that she was "increasingly concerned about what seems to be anti-LGBT rhetoric" from the government.

She said she did not believe that Ms Badenoch and Liz Truss - who is also an equalities minister - "had the best interests of the LGBTQ community" in their minds, adding: "I don't think they understand us."

"I do think there are others more suited to this role who have more time to engage, and more heart for the work", she said.

A government spokesperson said: "Earlier this week the minister set out the government's desire to end conversion therapy, making it clear that the practice has no place in a civilised society. We are working to bring forward plans to do so shortly."

An awkward issue for Boris Johnson

There have been rumblings for a while about a growing unease among some panel members which are now playing out in a very public way.

The advisory group was first set up under Theresa May but hasn't met for some time - I'm told at least six months.

And now we've heard claims that, even when it did meet, panellists didn't necessarily feel listened to.

If the group does appear increasingly defunct (and we'll have to see what happens) it may be seen, by some, as symbolic of a fading commitment to LGBT+ equality under this administration.

Ministers would reject that and, during a debate on Monday, Kemi Badenoch said the government had a "proud record" of championing equal opportunity.

But it was her response overall that seems to have sparked these resignations.

Among concerns was her refusal to commit to a legislative "ban" on so-called conversion therapy, promising instead only to "end" the practice.

The equalities minister described the legal landscape as "complex". But it's an awkward one for Boris Johnson who did, last summer, use the word "ban" during a TV interview.

When she resigned from her advisory role on Monday, Jayne Ozanne accused ministers of creating a "hostile environment" for LGBT+ people.

Two others who then also quit the panel, James Morton, and Ellen Murray, said they also had concerns about the government's approach to conversion therapy and trans rights.

Labour Leader Sir Keir Starmer said the government "has a blind" spot in the issue.

"The PM needs to address what is obviously a problem in his government," he said at his party's local election campaign launch.

Asked if he would ban conversion therapy if he were prime minister, Sir Keir replied: "Yes, absolutely."

The LGBT Advisory Council was set up in 2019, with the term of current panel members set to end on 31 March.