Nvidia shares fell more than 6% in premarket trading on Thursday after the company's board met on Wednesday to discuss whether to remove Jensen Huang as chief executive, CNBC reported. CNBC confirmed the board meeting.

The report follows allegations of extramarital relationships involving Huang. On Sunday, Huang admitted to having an affair, according to the source. The Financial Times reported that the relationship was with Alice Huang, an executive at cloud company Megaspeed. The Financial Times reported that U.S. intelligence officials believe she is a spy for China. The source does not state whether that belief has been confirmed.

The New York Times reported on Wednesday that Huang had another extramarital relationship, with Kimberly Powell, Nvidia's vice president of health care. The Times reported that Powell reports to Huang.

Shares of rivals AMD and Broadcom rose 3.9% and 3%, respectively, in premarket trading. Intel, Marvell, Arm and Qualcomm traded lower. Nvidia's stock was already down more than 20% over the past month.

Several Wall Street analysts told CNBC that the stock could fall 20% if Huang is removed, given his central role in the company's success. Bernstein cut its price target on Nvidia from $400 to $200. Stacy Rasgon, a Bernstein senior analyst, said the alleged affair with a direct report makes it "much tougher for the board to leave him in position."

U.S. lawmakers have called for Huang to resign, according to the report. Richard Reyle, chief investment officer at Questar Capital Partners, said Nvidia's lack of a succession plan makes the stock "uninvestable." He said the company faces either months of congressional scrutiny if Huang stays or an uninvestable stock if he leaves.