Spot gold was 0.5% down at $1,784.35 per ounce by 0859 GMT, while U.S. gold futures also fell 0.5% to $1,785.10.
The dollar index rose 0.2% , increasing the cost of purchasing bullion for those holding other currencies. [USD/]
The Federal Open Market Committee is due to meet on Sept. 21-22. A growing number of policymakers have expressed their support for a reduction in the central bank's asset purchases this year.
"There are a lot of members in the FOMC who are in favour of commencing tapering this year and therefore the outlook for gold is not positive," said Quantitative Commodity Research analyst Peter Fertig, adding recent data showing U.S. inflation slowed last month was unlikely to postpone tapering.
Reduced central bank stimulus tends to lift bond yields, which raises the opportunity cost of holding non-interest bearing gold. It also helps boost the dollar, further weighing on bullion.
But "tapering stimulus will not be favourable for stocks and gold could be one of the beneficiaries from money exiting the stock market", said Vincent Tie, sales manager at Singapore dealer, Silver Bullion.
"With the Fed slated to begin tapering by December, we could see higher gold prices in Q4, 2021."
Analysts at ANZ also said in a note that negative real yields and inflation expectations should support investment demand for gold despite the Fed signalling that tapering and rate hikes are around the corner.
Indicative of sentiment, holdings of SPDR Gold Trust, the world's largest gold-backed exchange-traded fund, fell 0.2% to 998.46 tonnes on Wednesday.
Elsewhere, silver fell 1.1% to $23.57 per ounce, while palladium climbed 1.5% to $2,033.61.
Platinum fell 0.7% to $940.86.
(Reporting by Nakul Iyer and Eileen Soreng in Bengaluru; Editing by Emelia Sithole-Matarise)
By Nakul Iyer