/Python/List files in http directory python

List files in http directory python

import requests
from bs4 import BeautifulSoup

def get_url_paths(url, ext='', params={}):
    response = requests.get(url, params=params)
    if response.ok:
        response_text = response.text
    else:
        return response.raise_for_status()
    soup = BeautifulSoup(response_text, 'html.parser')
    parent = [url + node.get('href') for node in soup.find_all('a') if node.get('href').endswith(ext)]
    return parent

url = 'http://cdimage.debian.org/debian-cd/8.2.0-live/i386/iso-hybrid'
ext = 'iso'
result = get_url_paths(url, ext)
print(result)

Source: stackoverflow.com

Similar codes

1 vote125 views1 answer
Add age categories pandas dataframe
Python
0 vote176 views1 answer
Django template add numbers
Python Django
0 vote131 views1 answer
Add row in db django
Python
1 vote137 views2 answers
Set recursion limit python
Python
138 votes127 views5 answers
Python rename
Python
-1 vote126 views1 answer
Turtle write function in turtle package python
Python
133 votes139 views6 answers
Input function in python
Python
0 vote120 views1 answer
Solve system of linear equations numpy
Python
2 votes175 views2 answers
'flask' is not recognized as an internal or external command, operable program or batch file.
Python Flask
0 vote274 views1 answer
Python adx indicator
Python