/media/bill/PROJECTS/System_maintenance/internet & wifi/web downloads - nips-grab & BeautifulSoup.txt



***************************
# 13Feb2018  nips-grab to download papers 
(until I figure out how to do it with QNial)
see "/media/bill/PROJECTS/System_maintenance/internet & wifi/web downloads - nips-grab & BeautifulSoup.txt"



#	host link 'rsync >>"$p_log0"  2>&1  --stats  -aru  --exclude-from="$p_excl"  "$d_src"  "$d_out" '  ;  

# from command line :
$ cd "/media/bill/PROJECTS/2017 NIPS Long Beach, California/" 
$ rsync -au  "https://papers.nips.cc/paper/6606-wider-and-deeper-cheaper-and-faster-tensorized-lstms-for-sequence-learning.pdf"  "6606-wider-and-deeper-cheaper-and-faster-tensorized-lstms-for-sequence-learning.pdf" 

# Just look at ftp!!??
https://papers.nips.cc/paper/6606-wider-and-deeper-cheaper-and-faster-tensorized-lstms-for-sequence-learning.pdf
Can't seem to connect, need [login, username]

# Try git-clone from https://github.com/meyerd/nips-grab
$ git-clone "https://github.com/meyerd/nips-grab.git"
git-clone: command not found
# I already have git - why not git-clone?
$ git clone "https://github.com/meyerd/nips-grab.git"
Cloning into 'nips-grab'...
remote: Counting objects: 21, done.
remote: Total 21 (delta 0), reused 0 (delta 0), pack-reused 21
Unpacking objects: 100% (21/21), done.
Checking connectivity... done.

# Now, how to run the python programs?  Try README.md
$ cd nips-grab
$ python grab-proceedings.py 2017
Traceback (most recent call last):
  File "grab-proceedings.py", line 3, in <module>
    import sys, re, os, errno, requests, urllib
ImportError: No module named requests
# Uses: Beautiful Soup http://www.crummy.com/software/BeautifulSoup/
# look at this 
# I installed via Linux Software Manager python3-bs4
$ python grab-proceedings.py 2017
# man python
SYNOPSIS
       python [ -B ] [ -d ] [ -E ] [ -h ] [ -i ] [ -m module-name ]
              [ -O ] [ -OO ] [ -R ] [ -Q argument ] [ -s ] [ -S ] [ -t ] [ -u ]
              [ -v ] [ -V ] [ -W argument ] [ -x ] [ -3 ] [ -?  ]
              [ -c command | script | - ] [ arguments ]
#
# search "python and ImportError: No module named requests" 
https://stackoverflow.com/questions/17309288/importerror-no-module-named-requests
Requests is not a built in module (does not come with the default python installation), so you will have to install it:
OSX/Linux
Use $ sudo pip install requests if you have pip installed
Alternatively you can also use sudo easy_install -U requests if you have easy_install installed.
...
edited Oct 30 '17 at 17:52
answered Jun 25 '13 at 23:36,  TheoretiCAL
>> I installed via Software Manager
# Also https://github.com/JasonBenn/nips-scraper ( I didn't use this )
$ python grab-proceedings.py 2017
Downloading from 2017 proceedings all papers
 downloading 6606-wider-and-deeper-cheaper-and-faster-tensorized-lstms-for-sequence-learning ... pdf bib.
 downloading 6607-concentration-of-multilinear-functions-of-the-ising-model-with-applications-to-network-data ... pdf bib.
 downloading 6608-deep-subspace-clustering-networks ... pdf bib.
 downloading 6609-attentional-pooling-for-action-recognition ... pdf bib.
>> It worked perfectly!! 

# Move the [pdf,tx] files - nemo choked on this real bad!!
$ cd nips-grab
$ mv -it "/media/bill/PROJECTS/2017 NIPS Long Beach, California"  7034-faster-and-non-ergodic-o1k-stochastic-alternating-direction-method-of-multipliers.pdf  
$ mv -it "/media/bill/PROJECTS/2017 NIPS Long Beach, California"  *.pdf
$ mv -it "/media/bill/PROJECTS/2017 NIPS Long Beach, California"  *.bib




# enddoc