If you have decided not to retire, you can join the growing club. Two out of three between the ages of 45 and 60 plan to delay retirement, according to a report from the Conference Board.

Flickr User Tax Credits

The economic think tank's Ken Goldstein says the army of older Americans putting retirement on the back burner is on the move.

Two years ago four in ten 45 to 60's were planning to put off retirement. Financial losses during the recent recession, job and income stagnation and layoffs are given as the main reasons. Goldstein says there is a underside of this.

"There are a number of folks, 20, 30, 40, 50-something, who can't find a job, or are stuck in a low-paying job. And unfortunately for them, this is an economy, even though it is improving, it has and it is and it will continue to pass them by."

He says we all are going to pay a price for that.

The report is based on a 2012 survey of 15,000 individuals. The labor force has been getting older for decades for reasons that range from longer life spans and better health to companies' replacement of defined-benefit pensions with higher-risk 401(k) plans.