Yes you need to cut/paste the pieces of your site into each template page in WordPress. For example, the code for your header will be placed in the header.php file. The code for your footer will be placed in the footer.php code, etc.
Here's a
tutorial to help you understand the process.