PM Narendra Modi said, 'An ordinary person like me asked to buy less gold; the countrymen bought less gold, and gold prices fell'