When you are starting out with gardening, don´t buy the most expensive tools. You may find that you don't really like gardening and if that is indeed the case, you will not have lost a large investment. The time you spend using those tools in the garden should be enjoyable that means the tools should be comfortable to use for you and every other person in the household.
You don't need to spend a lot to start a garden, but you do need some basic tools. You can always find tools at yard sales or cheaper markets that helps to keep the budget low.
The most important gardening tool would be a spading fork. You will have to open and improve the soil with that gardening tool. It is used to break up the ground and looks a bit like a pitchfork. A hoe is also needed. It helps the nutrients and water to penetrate into the ground for example for weeding.
The one gardening tool we all know from our childhood would be a watering can. Choose one with a detachable spray head and a gentle flow rate. This way the water stream is not damaging the young seeding. Also a must-have is a round-ended shovel. This is mostly used for planting shrubs and trees and will help to improve your garden even more.