In this research, parallel computing capabilities of MATLAB and the capabilities for the finite element method were analyzed. A program for solving a heat transfer problem by the finite element method was implemented. Three different parallel algorithms using CPU and GPU for solving steady state and transient heat transfer problems were proposed and implemented. A maximal speedup of around 2.3 times for steady state and 2 times for transient problem solving time was achieved by using a quad-core CPU.