Early game and using gem/orbs

I have heard that it may be a good idea to use the different gems/orbs to upgrade and craft gear but I'm just starting out and currently on level 20 as a Merc. Since I don't get a lot of these crafting and upgrading items, at what level does it make sense to start using the gems and orbs to upgrade?

My concern is that if I do it at to low a level than I won't really get the value out of them as I quickly level and find stronger equipment faster than I can upgrade.