CGI/Perl Guide | Learning Center | Forums | Advertise | Login
Site Search: in

  Main Index MAIN
Search Posts SEARCH
Who's Online WHO'S
Log in LOG

Home: Need a Custom or Prewritten Perl Program?: I need a program that...: Re: [ochez] Google Scholar Scraper and Excel Parser: Edit Log


Jul 8, 2009, 11:49 AM

Views: 8026
Re: [ochez] Google Scholar Scraper and Excel Parser


This is fairly simple using biterscripting. Let's say your search term is "Prof. XYZ". The google URL will be "".


# Script scholar.txt
var str page ; cat "" > $page
# Keep collecting and printing the string between "cited by " and "<".
while ( { sen -c -r "^cited by &<^" $page } > 0 )
var str match ; stex -c -r "^cited by &<^" $page > $match
stex -c -r "^cited by ^]" $match > null ; stex -c -r "[^<^" $match > null
# $match now has only the number following "cited by ". Print it.
echo $match

I tested this script. It works. Try it now. Download biterscripting ( ). Save the script as C:\Scripts\scholar.txt. Call it as

  script scholar.txt

You can also call it from a perl program. Or, you can translate the functionality to perl. If you make the script better, please post it. I think a lot of people can benefit from your better script.

I use biterscripting to parse/scrape our own web pages.


(This post was edited by JenniC on Jul 8, 2009, 11:50 AM)

Edit Log:
Post edited by JenniC (Novice) on Jul 8, 2009, 11:50 AM

Search for (options) Powered by Gossamer Forum v.1.2.0

Web Applications & Managed Hosting Powered by Gossamer Threads
Visit our Mailing List Archives