KABUL, Afghanistan (AP) — U.S. Defense Secretary Lloyd Austin, on his first visit to Afghanistan as Pentagon chief, said Sunday that the Biden administration wants to see “a responsible end” to America’s longest war, but the level of violence must decrease for “fruitful” diplomacy to have a chance.

With questions swirling about how long U.S. troops will remain in the country, Austin said that “in terms of an end date or setting a specific date for withdrawal, that’s the domain of my boss.” He said his stop in Kabul, the capital, where he met with military commanders and senior Afghan government officials, including President Ashraf Ghani, was intended to let him “listen and learn” and “inform my participation” in reviewing the future of the American force.

President Joe Biden said last week in an ABC News interview that it will be “tough” for the U.S. to meet a May 1 deadline to withdraw troops from Afghanistan. But Biden said that if the deadline, which is laid out in an agreement between the Trump administration and the Taliban, is extended, it wouldn’t be by a “lot longer.”

Austin, who arrived after a visit to India, said: “There’s always going to be concerns about things one way or the other, but I think there’s a lot of energy focused on, you know, doing what’s necessary to bring about a responsible end, a negotiated settlement to the war.”

The Taliban on Friday warned of consequences if the United States doesn’t meet the deadline. Suhail Shaheen, a member of the Taliban negotiation team, told reporters that if American troops were to stay beyond May 1, “it will be a kind of violation of the agreement. That violation would not be from our side. … Their violation will have a reaction.”

A statement released by the presidential palace on the Ghani-Austin meeting said both sides condemned the increase in violence in Afghanistan. There was no mention of the May 1 deadline. Washington is reviewing the agreement the Trump administration signed with the Taliban last year and has been stepping up pressure on both sides in the protracted conflict to find a swift route to a peace agreement.

“It’s obvious that the level of violence remains pretty high in the country,” Austin said. “We’d really like to see that violence come down and I think if it does come down, it can begin to set the conditions for, you know, some really fruitful diplomatic work.”

In a sharply worded letter to Ghani earlier this month, U.S. Secretary of State Antony Blinken said it was urgent to make peace in Afghanistan and that all options remained on the table. He also warned that it was likely the Taliban would make swift territorial gains if U.S. and NATO troops withdrew. The United States spends $4 billion a year to sustain Afghanistan’s National Security Forces

The Taliban warned America against defying the May 1 deadline, at a news conference in Moscow, the day after meeting with senior Afghan government negotiators and international observers to try to jumpstart a stalled peace process to end Afghanistan’s decades of war.