Two more minutes and I would have found my answer. For anyone using Boost and wanting to pull the Add a Block out of the Nav drawer and into the blocks column do the following:
Open up the theme config.php file and change this:
$THEME->addblockposition = BLOCK_ADDBLOCK_POSITION_FLATNAV;
to this:
$THEME->addblockposition = BLOCK_ADDBLOCK_POSITION_DEFAULT;
Save the file.
Turn editing on in a course the the Add A Block block will appear with the rest of the blocks.