Google was not informed of the change until late February, the company spokesperson told CNBC, adding that the panel's new topic was outside of the employee's role and experience.
"We had a couple different panelists back out because this conversation, which is so important, has become kind of nuclear at this point, which is wild," said Diana Ransom, Inc. Magazine executive editor and the panel's moderator, at the event.
Gramajo said he doesn't begrudge any of the panelists or companies that pulled out of the panel.
"They are, as we all are, navigating an incredibly complex and uncertain time, where the rules are not clear," he said.