The purpose of this study is to find out which elements pedestrians watch for a long time and frequently when pedestrian evaluates pedestrian safety in pedestrian environment. Pedestrian safety, pedestrian’s perception of individual elements and visual activities were identified in the pedestrian-priority street and the shared street. In addition, it was investigated whether there is a difference in observation characteristic for negative elements according to pedestrian characteristics such as sex and experience of car accident. To this end, a questionnaire survey and Eye-tracking experiment were conducted on two pedestrian-priority streets and two shared streets. The results of this study are as follows. 1) Pedestrians felt safer in pedestrian-priority street than shared street. 2) The perception of illegally parked vehicles and motorcycles in pedestrian environment was generally very negative. 3) Pedestrians watched the elements that were evaluated as being negative for a long time and more frequently. 4) There is a difference in the fixation time of illegally parked vehicles and motorcycles depending on sex. 5) There is also a difference in the fixation count for illegally parked vehicles on the shared street depending on the past experience of traffic accident damage.