Donald Trump can’t bear for people to think he’s not calling his own shots—during the campaign, he boasted to me that he was his own strategist. When his staff has tried to manage him, he has seemed to take it as a point of pride to thwart them. So it’s only natural that his relationship with Chief of Staff John Kelly, who is attempting to impose discipline on Trump’s freewheeling West Wing by starkly curtailing access to Trump, would be fraught. But now there are signs that the rift between Kelly and his boss may be irreparable. The beginning of the fall season at Mar-a-Lago, later this month, is liable to be a crucial period in the relationship. The White House declined to comment on the record, but privately an official disputed these characterizations.

According to conversations with four prominent Republicans close to the White House, Trump has grown frustrated with Kelly in recent weeks at what he sees as Kelly’s highhandedness. “They’re fighting a lot,” one source explained. The most recent flashpoint was Kelly’s decision late last month to reassign Peter Navarro, Trump’s nationalist trade adviser, to report to Gary Cohn, without first clearing it with Trump. According to two sources familiar with the matter, Navarro bumped into Trump in the West Wing and explained that Kelly had reassigned him to work for Cohn, which was news to the president. “Trump was like, what the fuck? He told Navarro, ‘You’re my guy and hang in there,’” said a source briefed on the conversation. The source said Trump has taken up the matter with Kelly.

For his part, Kelly’s patience is being tested by Trump almost daily. In September, Kelly was photographed face-palming when Trump threatened to wipe out North Korea during a U.N. speech in which the president called Kim Jong Un “Rocket Man.” Last week, Kelly struggled to contain Trump’s rage after it was reported that Secretary of State Rex Tillerson had called his boss a “moron” during a national security meeting. How long Kelly lasts in the job has become a topic of speculation in the West Wing. “He doesn’t love this job. He’s doing it as a duty for the country,” one person close to Kelly said. According to two sources, one name being floated as a possible replacement is real-estate developer and Trump’s longtime friend Tom Barrack. But Trump has moved to quiet the talk. He told a Republican yesterday during a phone conversation that it is “nonsense” that Barrack would replace Kelly. Trump is said to fear the optics of losing Kelly at a time when other officials, from Tillerson to Cohn, have contemplated resigning.

Video: Breaking Through “Scandal Fatigue” In the Era of Trump

The next few weeks will surely test Trump and Kelly’s relationship. As Kelly seeks to revive Trump’s stalled tax plan, prevent the Iran nuclear deal from falling apart, and avoid war with North Korea, he’ll also face the challenge of having to manage Trump at Mar-a-Lago. According to two sources, Kelly has developed a Mar-a-Lago strategy to prevent Trump from soliciting advice from members and friends. (In February, Trump turned his dinner table into an open-air Situation Room when North Korea test-fired a ballistic missile.) Sources briefed on Kelly’s plans said he will attempt to keep Trump “out of the dining room.”

The plan looks sound on paper—but, to his staff, Trump can be a formidable adversary.