(Adds investor quotes and details throughout; updates prices)

* TSX ends up 12.25 points, or 0.06%, at 21,084.45

* Posts a decline of 0.65% for the week

* Technology falls for 5th straight day, down 1.4%

* Energy climbs 0.9%

TORONTO, Jan 7 (Reuters) - Canada's main stock index closed slightly higher on Friday but was still down for the first week of the year as the potential for faster-than-expected U.S. interest rate hikes weighed on investor sentiment.

The Toronto Stock Exchange's S&P/TSX composite index ended up 12.25 points, or 0.06%, at 21,084.45 on Friday. For the week, it was down 0.65% after the Federal Reserve on Wednesday struck a hawkish note in minutes from its latest meeting.

"The story is still tied to the Fed and rising interest rates coming sooner than expected," said Sadiq Adatia, chief investment officer at BMO Asset Management.

Wall Street extended its weekly decline as investors remained worried about the U.S. interest rate outlook even after a weaker-than-expected December payrolls report.

Domestic data showed the Canadian economy adding twice as many jobs as expected in December, supporting expectations for the Bank of Canada to begin hiking rates in the coming months.

"What you have been seeing is a bit of rotation going on ... the high-flying tech names have been selling off," Adatia said.

Higher interest rates reduce the value to investors of the future cash flows that technology and other high growth sectors are expected to produce.

The Toronto market's technology group fell for a fifth straight session, down 1.4%, but that was offset by gains for the heavily weighted financials group and energy stocks.

Financials ended 0.4% higher, while energy climbed 0.9% as oil held on to much of this week's rally.

U.S. crude prices settled 0.7% lower at $78.90 a barrel on Friday but were up nearly 5% for the week as the market weighed unrest in Kazakhstan and outages in Libya.

Apparel manufacturer Canada Goose Holdings Inc was among the biggest decliners, falling 6.3% after UBS slashed its target price on the stock. (Reporting by Fergal Smith; Additional reporting by Anisha Sircarl Editing by Cynthia Osterman)