If we do have whole life insurance now, should we cancel and buy term insurance to save premium costs?

Do a calculation and honestly with inflation the surrender value etc. Is not going to be worth much in future. Most of all, evaluate your needs. If you're focusing on retirement, get a good retirement plan. If you're focusing on protection (disability) then get the right term insurance. It will be cheaper in the long term.