Tom Brady and Roger Goodell in court for 'Deflategate'

NEW YORK (AP) -- A federal judge put the NFL on the defensive over its four-game suspension of New England Patriots quarterback Tom Brady on Wednesday, demanding to know what evidence directly links Brady to deflating footballs and belittling the drama of the controversy.

"What is the direct evidence that implicates Mr. Brady?" Judge Richard M. Berman in Manhattan repeatedly asked NFL lawyer Daniel L. Nash at the first hearing in the civil case in federal court in Manhattan, which was attended by both Brady and Commissioner Roger Goodell.

Photos from outside the courthouse:

Nash responded there was "considerable evidence Mr. Brady clearly knew about this," including records of text messages and phone calls between the quarterback and one of two Patriots employees implicated in the scandal known as "Deflategate." But he also said there was no "smoking gun" showing Brady had direct knowledge that the balls were deflated for the first half of the Patriots' 45-7 defeat of the Indianapolis Colts in the Jan. 18 AFC championship.

Brady and Goodell didn't speak during the hearing, except to introduce themselves to Berman. Brady, his head lowered, looked dour throughout a hearing that lasted about 1 hour, 20 minutes. Immediately afterward, Brady smiled slightly as he signed sketches for two court artists. Berman than began meeting individually with each side to continue settlement discussions in private.

The NFL sued two weeks ago asking for Berman to declare that its punishment of Brady was properly carried out. The players' union countersued, asking him to nullify the suspension. The judge has signaled from the start that he wants the parties to reach a swift settlement.

%shareLinks-quote="What is the direct evidence that implicates Mr. Brady?" type="quote" author="Judge Richard M. Berman" authordesc="" isquoteoftheday="false"%

On Wednesday, Berman called it "ironic" that Brady's statistics were better in the second half of the AFC championship game, after the balls were re-inflated.

"You might say (Brady) got no better advantage from the under-inflation," the judge said.

At one point, the judge also seemed to try to defuse the controversy, saying: "This Deflategate. I'm not sure where the `gate' comes from."

See more photos from the Deflategate saga:

When the union got its chance to argue, the judge asked attorney Jeffrey L. Kessler why one of the Patriots employees would deflate balls without Brady's knowledge. Kessler said the union does not believe the balls were deflated but, if they were, the employee did it on his own because he "thought it would be good for his quarterback."

The judge also questioned why Brady destroyed his cellphone in the midst of the inquiry - a move that the league argues was further proof of his deception. Kessler claimed that the quarterback got rid of the phone on the advice of his agent to protect his privacy but had otherwise cooperated with the inquiry.

However, in hindsight, "You're right, it could have been done a different way," the lawyer said of the phone.

Both sides are scheduled to return to court next week.

As Goodell arrived at the courthouse, he was greeted by a smattering of boos as he walked inside. Four minutes later, Brady arrived flanked by four security guards. Both men went through a security sweep like everyone else going to court.

Dozens of fans and journalists waited for two of the NFL's most famous faces at the front entrance of the courthouse, including some fans wearing deflated football hats they were hoping to sell.

Goodell suspended Brady after concluding he "knew about, approved of, consented to, and provided inducements and rewards" to support a scheme in which a Patriots employee deflated balls on game day. Brady insists he knew nothing about it.

In a July 28 decision upholding the suspension, Goodell heavily criticized Brady for having an aide destroy a cellphone containing nearly 10,000 text messages from a four-month stretch including the AFC championship game. He accused him of obstructing the NFL probe about a controversy that represented "conduct detrimental to the integrity of, and public confidence in, the game of professional football."

In court documents, the union's lawyers said the suspension was unfair and violates the labor contract and complained that it would cause irreparable harm to Brady by forcing him to miss games.

They called a June appeal hearing before Goodell "a kangaroo court proceeding, bereft of fundamentally fair procedures."

---

Associated Press Writer Jake Pearson and AP Sports Writer Jimmy Golen in Boston contributed to this report.

See photos of the Patriots' training camp:

More on AOL.com:
Video in Cincinnati cop's fatal shooting now with prosecutor
Pennsylvania beauty queen jailed on fake cancer charges
Maine murder suspect surrenders after two-month manhunt