RePEc data is popular for various purposes, but web scraping is not the best way to get it.

https://ideas.repec.org/getdata.html

#dailyRePEc #economics

RePEc: getting the metadata

IDEAS is a central index of economics research, including working papers, articles and software code