Yup, the PSP can play Playstation One games natively.
You can download official ones from the Sony PSP gamestore or use custom firmware and play the lot, although some games won't work properly. I went through and played FF VII all the way through on my PSP, it was great!