Remove bricks before they reach your miner. Throw your pickaxe at groups of 2 or more of the same bricks.