Rai is a former comptroller and auditor general of India and is the first chairman of Bank Boards Bureau. He was also the chairman of the UN Panel of External Auditors.