Suggestion on passives respec

In order to balance the need for encouraging experimenting with nodes and some level of punishment for doing so and regretting it, you could give the option to respec freely any point, but making it unable to be selected again.

Is it dumb?