That was not something I would do,” he remembered