Download HTML, parse JavaScript, wget -qO-

I like to use wget -qO- to output html into screen, but sometimes the content do not satisfy me cause the content is javascript generated.

This is quite a workaround:

Install Python Mechanize:

apt-get install python-mechanize python-requests

To install parsejs on raspberry execute:

cat > /usr/bin/parsejs << EOF
#!/usr/bin/env python
from mechanize import Browser
import sys
import requests
br = Browser()

br.set_handle_robots( False )
br.addheaders = [('User-agent', 'Firefox')]

try:
 r = br.open(sys.argv[1])
 html = r.read()
 print html
except
 print("url do not exist")
EOF
chmod 755 /usr/bin/parsejs

Usage:

parsejs https://distrowatch.com