Keeping the builder away from the landscape is perfect advice. LOL!! Truly have to see a picture of your entire lawn area/site. Dealing with buried concrete and bricks is tricky. Depends on how much was dumped, and if there was decomposable material like wood involved. If there is wood beneath when it decomposes it will cause sinking of the surface to fill the new space.
If you find when you dig a 'test hole' that it appears to be a large, deep hole filled with big chunks the original builders have created for you a 'perched water table". Simply, all the small pore spaces of the topsoil will have to be completely saturated before any downward drainage can make its way into the chunks of stuff. (Same with rocks at the bottom of potting soil in a potted plant, a no-no).
No lawn should be perfectly flat. Ideally, 1-2% slope is indicated for lawns. You don't want water sitting on top of your lawn. Because of the perched water table situation this slope will be even more important to manage drainage. You can dig dry well 'trenches' along the easiest side of your lawn to catch and allow water to slowly filter through the soil or use Perforated drain pipe to carry the water to an area that with a single dry well. You do not want water draining off your site onto your neighbors. Big no-no for all kinds of reasons.
I'd pull up all the shallow concrete and bricks for sure. Are you able to talk with the original builder (don't tell him I said he was an idiot) grins! He could tell you how deep, the type of debris he threw in the hole, otherwise get ready to dig a deep hole (no more than 3') to get an idea of how deep this mess is. Below 2-3 feet the debris will no longer be an issue unless you've got decomposing wood. A few chunks here and there within this man made soil profile of 2-3' below the surface is no big deal, but if it is solid, bummers.
There will be suitable drainage if you can clear at least 12 -18" of debris from the surface AND your is lawn sloped (Rise/Run=Slope). It used to be 1% was enough when people erroneously insisted on having a 'putting green' of short grass. Now we know that 3" (cool season grasses) is as short as residential lawns should be mowed. Seriously, not 2 1/2" but 3"!! Critical for a healthy, vibrant, weed free lawn.
Bring in good topsoil already mixed with decomposed organic matter. Square footage of area divided by 81 gives you yardage of soil for that area to make 4" deep. You should need only 2" on top of your existing 12-18" if soil... so divide yardage by 2. Grade (try to rent a grading rake which is 3' wide, much easier and better to grade soil), then roll baby roll! (rent a water filled roller)...you'll easily see the lumps and divets. Go grade some more and roll again. If there are still lumps and holes, grade and roll again.
My advice is to use sod (once laid roll one more time, you can fix any depressions at the same time). The next best is to hire a spray seeding company. They've the best seed mixes and includes water retention mulch/proper fertilizer for baby grass. The worst way to start a lawn is from owner seeding. Grass will compete with weeds from the beginning. If you chose this you need to use a mechanical spreader. Do not throw seed by hand! All that work and to throw seed or fertilizer by hand is just sad.
An established grass crop mowed no shorter than 3" is able to out compete as well as shade the soil to discourage weed seed germination. Once the sod has put roots down into your ROLLED soil you can then start mowing (less than a week, test by pulling up on the sod and it should resist). Once your lawn is established (2 or 3 mowings for sod) you will then be able to start training the roots to grow deep to be drought tolerant and save on the water bills! Water deeply and allow to dry before watering again. We've got lots of lawn advice on this site and you should read all of them to understand this creature you want to create that is called a lawn. And don't use fast release fertilizers by Scott's or Ortho. There are incredible organic fertilizers these days that are slow release and last longer and are far better for the health of your lawn. We can help save you money and have the best lawn on your block!