/Python/How to know google index of a page using python

How to know google index of a page using python

import requests
import pandas as pd
import time
from bs4 import BeautifulSoup
from urllib.parse import urlencode

seconds = 3
proxies = {
    'https' : 'https://localhost:8123',
    'http' : 'http://localhost:8123'
    }

user_agent = 'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/48.0.2564.116 Safari/537.36'
headers = { 'User-Agent' : user_agent}

df = pd.read_excel('url_links.xlsx')
for i in range(0, len(df)):
    line = df.loc[i,'links']
    #print(line)
    if line:
        query = {'q': 'site:' + line}
        google = "https://www.google.com/search?" + urlencode(query)
        data = requests.get(google, headers=headers)
        data.encoding = 'ISO-8859-1'
        soup = BeautifulSoup(str(data.content), "html.parser")
        try:
            check = soup.find(id="rso").find("div").find("div").find("div").find("div").find("div").find("a")["href"]
            print("URL is Index ")
        except AttributeError:
            print("URL Not Index")
        time.sleep(float(seconds))
    else:
        print("Invalid Url")

Source: stackoverflow.com

Similar codes

0 vote133 views1 answer
Standard noramlization
Python
1 vote129 views1 answer
Get int64 column pandas
Python
2 votes168 views4 answers
Streamlit install
Python
9 votes134 views4 answers
Python numpy array
Python
7 votes151 views1 answer
Python title case
Python
0 vote140 views1 answer
Deezer python download
Python
61 votes138 views6 answers
Get date and time python
Python
5 votes153 views2 answers
Python train test val split
Python
0 vote141 views2 answers
Make virtual environment wrapper python 3
Python
0 vote128 views1 answer
Pandas load dataframe without header
Python