In this paper, we investigate the performance of an uplink SC-FDMA-based massive MIMO system, which consists of single-antenna-equipped users and base station (BS) employing a large antenna array, in the presence of phase noise. Both transmitter and BS receiver phase noises are considered, while at the BS receiver, two scenarios, namely the synchronous and non-synchronous oscillators, are studied. Using a maximum-ratio-combining (MRC) receiver and a simplified phase noise model assuming perfect channel estimates, we analytically show that the multiple access interference and inter-carrier interference diminish as the number of BS receive antennas grows extremely large, while a common phase error (CPE) affects the desired signals in the distributed-mapping-based SC-FDMA system. Simulations show the performance of the synchronous and non-synchronous scenario for both the localized and distributed mapping. It is also shown that the distributed mapping and non-synchronous scenario demonstrate significant improvement when phase noise compensation is applied to correct the CPE component.