[python] google検索結果をbeautifulsoupでスクレイピングして、タイトルとURLをセットで取得する

pythonでGoogle検索の結果をbeautifulsoupでスクレイピングして、

タイトルとURLのセットを取得して表示させてみます。

import requests
import bs4

# キーワードを使って検索してhtmlを取得する
keyword = 'python'
response = requests.get('https://www.google.co.jp/search?q=' + keyword)

# ステータスコードが200以外なら例外を発生させる
response.raise_for_status()

# 取得したHTMLをパースする
bs = bs4.BeautifulSoup(response.text, "html.parser")

# 検索結果のタイトルとリンクを取得
element = bs.select('.r > a')

title_list = []
url_list = []

for i in range(len(element)):
    # タイトルのテキスト部分のみ取得
    title = element[i].get_text()    
    # リンクのみを取得し、余分な部分を削除する
    url = element[i].get('href').replace('/url?q=','')

    title_list.append(title)
    url_list.append(url)

# 出力
for i in range(len(title_list)):
    print(title_list[i])
    print('['+ url_list[i] +']')
    print('')

import requests

import bs4

# キーワードを使って検索してhtmlを取得する

keyword = 'python'

response = requests.get('https://www.google.co.jp/search?q=' + keyword)

# ステータスコードが200以外なら例外を発生させる

response.raise_for_status()

# 取得したHTMLをパースする

bs = bs4.BeautifulSoup(response.text, "html.parser")

# 検索結果のタイトルとリンクを取得

element = bs.select('.r > a')

title_list = []

url_list = []

for i in range(len(element)):

# タイトルのテキスト部分のみ取得

title = element[i].get_text()

# リンクのみを取得し、余分な部分を削除する

url = element[i].get('href').replace('/url?q=','')

title_list.append(title)

url_list.append(url)

# 出力

for i in range(len(title_list)):

print(title_list[i])

print('['+ url_list[i] +']')

print('')

実行結果

Welcome to Python.org
<a href="https://www.python.org/&sa=U&ved=0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFggUMAA&usg=AOvVaw1-NvLH6Tv0rGldN36ibIt4" title="https://www.python.org/&sa=U&ved=0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFggUMAA&usg=AOvVaw1-NvLH6Tv0rGldN36ibIt4" class="blogcard-wrap external-blogcard-wrap a-wrap cf" target="_blank" rel="nofollow"><div class="blogcard external-blogcard eb-left cf"><figure class="blogcard-thumbnail external-blogcard-thumbnail"><img src="https://s0.wordpress.com/mshots/v1/https%3A%2F%2Fwww.python.org%2F%26sa%3DU%26ved%3D0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFggUMAA%26usg%3DAOvVaw1-NvLH6Tv0rGldN36ibIt4?w=160&h=90" alt="" class="blogcard-thumb-image external-blogcard-thumb-image" width="160" height="90" /></figure><div class="blogcard-content external-blogcard-content"><div class="blogcard-title external-blogcard-title">https://www.python.org/&sa=U&ved=0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFggUMAA&usg=AOvVaw1-NvLH6Tv0rGldN36ibIt4</div><div class="blogcard-snipet external-blogcard-snipet"></div></div><div class="blogcard-footer external-blogcard-footer cf"><div class="blogcard-site external-blogcard-site"><div class="blogcard-favicon external-blogcard-favicon"><img src="//www.google.com/s2/favicons?domain=www.python.org" class="blogcard-favicon-image" alt="" width="16" height="16" /></div><div class="blogcard-domain external-blogcard-domain">www.python.org</div></div></div></div></a>

Python - ウィキペディア
<a href="https://ja.wikipedia.org/wiki/Python&sa=U&ved=0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFggfMAE&usg=AOvVaw3jLHvUDBY5ke7FmiuKTMrN" title="https://ja.wikipedia.org/wiki/Python&sa=U&ved=0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFggfMAE&usg=AOvVaw3jLHvUDBY5ke7FmiuKTMrN" class="blogcard-wrap external-blogcard-wrap a-wrap cf" target="_blank" rel="nofollow"><div class="blogcard external-blogcard eb-left cf"><figure class="blogcard-thumbnail external-blogcard-thumbnail"><img src="https://s0.wordpress.com/mshots/v1/https%3A%2F%2Fja.wikipedia.org%2Fwiki%2FPython%26sa%3DU%26ved%3D0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFggfMAE%26usg%3DAOvVaw3jLHvUDBY5ke7FmiuKTMrN?w=160&h=90" alt="" class="blogcard-thumb-image external-blogcard-thumb-image" width="160" height="90" /></figure><div class="blogcard-content external-blogcard-content"><div class="blogcard-title external-blogcard-title">https://ja.wikipedia.org/wiki/Python&sa=U&ved=0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFggfMAE&usg=AOvVaw3jLHvUDBY5ke7FmiuKTMrN</div><div class="blogcard-snipet external-blogcard-snipet"></div></div><div class="blogcard-footer external-blogcard-footer cf"><div class="blogcard-site external-blogcard-site"><div class="blogcard-favicon external-blogcard-favicon"><img src="//www.google.com/s2/favicons?domain=ja.wikipedia.org" class="blogcard-favicon-image" alt="" width="16" height="16" /></div><div class="blogcard-domain external-blogcard-domain">ja.wikipedia.org</div></div></div></div></a>

プログラミング言語 Python
<a href="https://www.python.jp/&sa=U&ved=0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFggqMAI&usg=AOvVaw06P95T7nZTSygJ2-EpDffd" title="https://www.python.jp/&sa=U&ved=0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFggqMAI&usg=AOvVaw06P95T7nZTSygJ2-EpDffd" class="blogcard-wrap external-blogcard-wrap a-wrap cf" target="_blank" rel="nofollow"><div class="blogcard external-blogcard eb-left cf"><figure class="blogcard-thumbnail external-blogcard-thumbnail"><img src="https://s0.wordpress.com/mshots/v1/https%3A%2F%2Fwww.python.jp%2F%26sa%3DU%26ved%3D0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFggqMAI%26usg%3DAOvVaw06P95T7nZTSygJ2-EpDffd?w=160&h=90" alt="" class="blogcard-thumb-image external-blogcard-thumb-image" width="160" height="90" /></figure><div class="blogcard-content external-blogcard-content"><div class="blogcard-title external-blogcard-title">https://www.python.jp/&sa=U&ved=0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFggqMAI&usg=AOvVaw06P95T7nZTSygJ2-EpDffd</div><div class="blogcard-snipet external-blogcard-snipet"></div></div><div class="blogcard-footer external-blogcard-footer cf"><div class="blogcard-site external-blogcard-site"><div class="blogcard-favicon external-blogcard-favicon"><img src="//www.google.com/s2/favicons?domain=www.python.jp" class="blogcard-favicon-image" alt="" width="16" height="16" /></div><div class="blogcard-domain external-blogcard-domain">www.python.jp</div></div></div></div></a>

Python チュートリアル — Python 3.6.5 ドキュメント
<a href="https://docs.python.jp/3/tutorial/&sa=U&ved=0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFggwMAM&usg=AOvVaw2Bttil2dSmCfYeWcmif2bl" title="https://docs.python.jp/3/tutorial/&sa=U&ved=0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFggwMAM&usg=AOvVaw2Bttil2dSmCfYeWcmif2bl" class="blogcard-wrap external-blogcard-wrap a-wrap cf" target="_blank" rel="nofollow"><div class="blogcard external-blogcard eb-left cf"><figure class="blogcard-thumbnail external-blogcard-thumbnail"><img src="https://s0.wordpress.com/mshots/v1/https%3A%2F%2Fdocs.python.jp%2F3%2Ftutorial%2F%26sa%3DU%26ved%3D0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFggwMAM%26usg%3DAOvVaw2Bttil2dSmCfYeWcmif2bl?w=160&h=90" alt="" class="blogcard-thumb-image external-blogcard-thumb-image" width="160" height="90" /></figure><div class="blogcard-content external-blogcard-content"><div class="blogcard-title external-blogcard-title">https://docs.python.jp/3/tutorial/&sa=U&ved=0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFggwMAM&usg=AOvVaw2Bttil2dSmCfYeWcmif2bl</div><div class="blogcard-snipet external-blogcard-snipet"></div></div><div class="blogcard-footer external-blogcard-footer cf"><div class="blogcard-site external-blogcard-site"><div class="blogcard-favicon external-blogcard-favicon"><img src="//www.google.com/s2/favicons?domain=docs.python.jp" class="blogcard-favicon-image" alt="" width="16" height="16" /></div><div class="blogcard-domain external-blogcard-domain">docs.python.jp</div></div></div></div></a>

Python - Qiita
<a href="https://qiita.com/tags/python&sa=U&ved=0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFgg1MAQ&usg=AOvVaw3L-sup0JFT78vblWvgBcfG" title="https://qiita.com/tags/python&sa=U&ved=0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFgg1MAQ&usg=AOvVaw3L-sup0JFT78vblWvgBcfG" class="blogcard-wrap external-blogcard-wrap a-wrap cf" target="_blank" rel="nofollow"><div class="blogcard external-blogcard eb-left cf"><figure class="blogcard-thumbnail external-blogcard-thumbnail"><img src="https://s0.wordpress.com/mshots/v1/https%3A%2F%2Fqiita.com%2Ftags%2Fpython%26sa%3DU%26ved%3D0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFgg1MAQ%26usg%3DAOvVaw3L-sup0JFT78vblWvgBcfG?w=160&h=90" alt="" class="blogcard-thumb-image external-blogcard-thumb-image" width="160" height="90" /></figure><div class="blogcard-content external-blogcard-content"><div class="blogcard-title external-blogcard-title">https://qiita.com/tags/python&sa=U&ved=0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFgg1MAQ&usg=AOvVaw3L-sup0JFT78vblWvgBcfG</div><div class="blogcard-snipet external-blogcard-snipet"></div></div><div class="blogcard-footer external-blogcard-footer cf"><div class="blogcard-site external-blogcard-site"><div class="blogcard-favicon external-blogcard-favicon"><img src="//www.google.com/s2/favicons?domain=qiita.com" class="blogcard-favicon-image" alt="" width="16" height="16" /></div><div class="blogcard-domain external-blogcard-domain">qiita.com</div></div></div></div></a>

Python本まとめ・2019年版 - Webとデータ分析を初心者が仕事にするまで
<a href="https://shinyorke.hatenablog.com/entry/python2019&sa=U&ved=0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFgg6MAU&usg=AOvVaw1ELsMxxkPoVJG0uOdGmjE6" title="https://shinyorke.hatenablog.com/entry/python2019&sa=U&ved=0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFgg6MAU&usg=AOvVaw1ELsMxxkPoVJG0uOdGmjE6" class="blogcard-wrap external-blogcard-wrap a-wrap cf" target="_blank" rel="nofollow"><div class="blogcard external-blogcard eb-left cf"><figure class="blogcard-thumbnail external-blogcard-thumbnail"><img src="https://s0.wordpress.com/mshots/v1/https%3A%2F%2Fshinyorke.hatenablog.com%2Fentry%2Fpython2019%26sa%3DU%26ved%3D0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFgg6MAU%26usg%3DAOvVaw1ELsMxxkPoVJG0uOdGmjE6?w=160&h=90" alt="" class="blogcard-thumb-image external-blogcard-thumb-image" width="160" height="90" /></figure><div class="blogcard-content external-blogcard-content"><div class="blogcard-title external-blogcard-title">https://shinyorke.hatenablog.com/entry/python2019&sa=U&ved=0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFgg6MAU&usg=AOvVaw1ELsMxxkPoVJG0uOdGmjE6</div><div class="blogcard-snipet external-blogcard-snipet"></div></div><div class="blogcard-footer external-blogcard-footer cf"><div class="blogcard-site external-blogcard-site"><div class="blogcard-favicon external-blogcard-favicon"><img src="//www.google.com/s2/favicons?domain=shinyorke.hatenablog.com" class="blogcard-favicon-image" alt="" width="16" height="16" /></div><div class="blogcard-domain external-blogcard-domain">shinyorke.hatenablog.com</div></div></div></div></a>

今さら聞けない！Pythonとは【初心者向け】 | TechAcademyマガジン
<a href="https://techacademy.jp/magazine/15507&sa=U&ved=0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFghAMAY&usg=AOvVaw0fVmLNJwwaIVhocz5YDYJF" title="https://techacademy.jp/magazine/15507&sa=U&ved=0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFghAMAY&usg=AOvVaw0fVmLNJwwaIVhocz5YDYJF" class="blogcard-wrap external-blogcard-wrap a-wrap cf" target="_blank" rel="nofollow"><div class="blogcard external-blogcard eb-left cf"><figure class="blogcard-thumbnail external-blogcard-thumbnail"><img src="https://s0.wordpress.com/mshots/v1/https%3A%2F%2Ftechacademy.jp%2Fmagazine%2F15507%26sa%3DU%26ved%3D0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFghAMAY%26usg%3DAOvVaw0fVmLNJwwaIVhocz5YDYJF?w=160&h=90" alt="" class="blogcard-thumb-image external-blogcard-thumb-image" width="160" height="90" /></figure><div class="blogcard-content external-blogcard-content"><div class="blogcard-title external-blogcard-title">https://techacademy.jp/magazine/15507&sa=U&ved=0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFghAMAY&usg=AOvVaw0fVmLNJwwaIVhocz5YDYJF</div><div class="blogcard-snipet external-blogcard-snipet"></div></div><div class="blogcard-footer external-blogcard-footer cf"><div class="blogcard-site external-blogcard-site"><div class="blogcard-favicon external-blogcard-favicon"><img src="//www.google.com/s2/favicons?domain=techacademy.jp" class="blogcard-favicon-image" alt="" width="16" height="16" /></div><div class="blogcard-domain external-blogcard-domain">techacademy.jp</div></div></div></div></a>

なぜPythonはこんなにも遅いのか？ | POSTD
<a href="https://postd.cc/why-is-python-so-slow/&sa=U&ved=0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFghGMAc&usg=AOvVaw1eLP-ojZgYvvWiP6fAViJ-" title="https://postd.cc/why-is-python-so-slow/&sa=U&ved=0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFghGMAc&usg=AOvVaw1eLP-ojZgYvvWiP6fAViJ-" class="blogcard-wrap external-blogcard-wrap a-wrap cf" target="_blank" rel="nofollow"><div class="blogcard external-blogcard eb-left cf"><figure class="blogcard-thumbnail external-blogcard-thumbnail"><img src="https://s0.wordpress.com/mshots/v1/https%3A%2F%2Fpostd.cc%2Fwhy-is-python-so-slow%2F%26sa%3DU%26ved%3D0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFghGMAc%26usg%3DAOvVaw1eLP-ojZgYvvWiP6fAViJ-?w=160&h=90" alt="" class="blogcard-thumb-image external-blogcard-thumb-image" width="160" height="90" /></figure><div class="blogcard-content external-blogcard-content"><div class="blogcard-title external-blogcard-title">https://postd.cc/why-is-python-so-slow/&sa=U&ved=0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFghGMAc&usg=AOvVaw1eLP-ojZgYvvWiP6fAViJ-</div><div class="blogcard-snipet external-blogcard-snipet"></div></div><div class="blogcard-footer external-blogcard-footer cf"><div class="blogcard-site external-blogcard-site"><div class="blogcard-favicon external-blogcard-favicon"><img src="//www.google.com/s2/favicons?domain=postd.cc" class="blogcard-favicon-image" alt="" width="16" height="16" /></div><div class="blogcard-domain external-blogcard-domain">postd.cc</div></div></div></div></a>

専門知識いらず！Pythonとは何かを言語の特徴から網羅的に徹底解説 ...
<a href="https://www.sejuku.net/blog/7720&sa=U&ved=0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFghMMAg&usg=AOvVaw27dx8bUci7ExM5SqwkjRp6" title="https://www.sejuku.net/blog/7720&sa=U&ved=0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFghMMAg&usg=AOvVaw27dx8bUci7ExM5SqwkjRp6" class="blogcard-wrap external-blogcard-wrap a-wrap cf" target="_blank" rel="nofollow"><div class="blogcard external-blogcard eb-left cf"><figure class="blogcard-thumbnail external-blogcard-thumbnail"><img src="https://s0.wordpress.com/mshots/v1/https%3A%2F%2Fwww.sejuku.net%2Fblog%2F7720%26sa%3DU%26ved%3D0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFghMMAg%26usg%3DAOvVaw27dx8bUci7ExM5SqwkjRp6?w=160&h=90" alt="" class="blogcard-thumb-image external-blogcard-thumb-image" width="160" height="90" /></figure><div class="blogcard-content external-blogcard-content"><div class="blogcard-title external-blogcard-title">https://www.sejuku.net/blog/7720&sa=U&ved=0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFghMMAg&usg=AOvVaw27dx8bUci7ExM5SqwkjRp6</div><div class="blogcard-snipet external-blogcard-snipet"></div></div><div class="blogcard-footer external-blogcard-footer cf"><div class="blogcard-site external-blogcard-site"><div class="blogcard-favicon external-blogcard-favicon"><img src="//www.google.com/s2/favicons?domain=www.sejuku.net" class="blogcard-favicon-image" alt="" width="16" height="16" /></div><div class="blogcard-domain external-blogcard-domain">www.sejuku.net</div></div></div></div></a>

Python入門 〜Pythonのインストール方法やPythonを使った ...
<a href="https://www.javadrive.jp/python/&sa=U&ved=0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFghSMAk&usg=AOvVaw3GNgQCLVXaUgkQNGN3jHhT" title="https://www.javadrive.jp/python/&sa=U&ved=0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFghSMAk&usg=AOvVaw3GNgQCLVXaUgkQNGN3jHhT" class="blogcard-wrap external-blogcard-wrap a-wrap cf" target="_blank" rel="nofollow"><div class="blogcard external-blogcard eb-left cf"><figure class="blogcard-thumbnail external-blogcard-thumbnail"><img src="https://s0.wordpress.com/mshots/v1/https%3A%2F%2Fwww.javadrive.jp%2Fpython%2F%26sa%3DU%26ved%3D0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFghSMAk%26usg%3DAOvVaw3GNgQCLVXaUgkQNGN3jHhT?w=160&h=90" alt="" class="blogcard-thumb-image external-blogcard-thumb-image" width="160" height="90" /></figure><div class="blogcard-content external-blogcard-content"><div class="blogcard-title external-blogcard-title">https://www.javadrive.jp/python/&sa=U&ved=0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFghSMAk&usg=AOvVaw3GNgQCLVXaUgkQNGN3jHhT</div><div class="blogcard-snipet external-blogcard-snipet"></div></div><div class="blogcard-footer external-blogcard-footer cf"><div class="blogcard-site external-blogcard-site"><div class="blogcard-favicon external-blogcard-favicon"><img src="//www.google.com/s2/favicons?domain=www.javadrive.jp" class="blogcard-favicon-image" alt="" width="16" height="16" /></div><div class="blogcard-domain external-blogcard-domain">www.javadrive.jp</div></div></div></div></a>

Welcome to Python.org

[https://www.python.org/&sa=U&ved=0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFggUMAA&usg=AOvVaw1-NvLH6Tv0rGldN36ibIt4]

Python - ウィキペディア

[https://ja.wikipedia.org/wiki/Python&sa=U&ved=0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFggfMAE&usg=AOvVaw3jLHvUDBY5ke7FmiuKTMrN]

プログラミング言語 Python

[https://www.python.jp/&sa=U&ved=0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFggqMAI&usg=AOvVaw06P95T7nZTSygJ2-EpDffd]

Python チュートリアル — Python 3.6.5 ドキュメント

[https://docs.python.jp/3/tutorial/&sa=U&ved=0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFggwMAM&usg=AOvVaw2Bttil2dSmCfYeWcmif2bl]

Python - Qiita

[https://qiita.com/tags/python&sa=U&ved=0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFgg1MAQ&usg=AOvVaw3L-sup0JFT78vblWvgBcfG]

Python本まとめ・2019年版 - Webとデータ分析を初心者が仕事にするまで

[https://shinyorke.hatenablog.com/entry/python2019&sa=U&ved=0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFgg6MAU&usg=AOvVaw1ELsMxxkPoVJG0uOdGmjE6]

今さら聞けない！Pythonとは【初心者向け】 | TechAcademyマガジン

[https://techacademy.jp/magazine/15507&sa=U&ved=0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFghAMAY&usg=AOvVaw0fVmLNJwwaIVhocz5YDYJF]

なぜPythonはこんなにも遅いのか？ | POSTD

[https://postd.cc/why-is-python-so-slow/&sa=U&ved=0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFghGMAc&usg=AOvVaw1eLP-ojZgYvvWiP6fAViJ-]

専門知識いらず！Pythonとは何かを言語の特徴から網羅的に徹底解説 ...

[https://www.sejuku.net/blog/7720&sa=U&ved=0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFghMMAg&usg=AOvVaw27dx8bUci7ExM5SqwkjRp6]

Python入門〜Pythonのインストール方法やPythonを使った ...

[https://www.javadrive.jp/python/&sa=U&ved=0ahUKEwjFrcXw1bjfAhUS0lQKHdHNAVUQFghSMAk&usg=AOvVaw3GNgQCLVXaUgkQNGN3jHhT]

解説

下記は、class=’r’を使っているタグの内側で使われているaタグで囲まれている内容を取ります。

element = bs.select('.r > a')

1	element = bs.select('.r > a')

element[0]の中身の例

<a href="/url?q=https://www.python.org/&amp;sa=U&amp;ved=0ahUKEwj9nfff17jfAhUICjQIHXerBOkQFggUMAA&amp;usg=AOvVaw2S32M1LB2og9X0Ed6Q3cu1">Welcome to <b>Python</b>.org</a>

1	<a href="/url?q=https://www.python.org/&sa=U&ved=0ahUKEwj9nfff17jfAhUICjQIHXerBOkQFggUMAA&usg=AOvVaw2S32M1LB2og9X0Ed6Q3cu1">Welcome to <b>Python</b>.org</a>

そして下記でタグを除去してタイトルのテキスト部分のみを取得できます。

title = element[i].get_text()

1	title = element[i].get_text()

urlの取得は、get()でhrefの属性のデータを取るように指定して、余計な文字を除去しています。

url = element[i].get('href').replace('/url?q=','')

1	url = element[i].get('href').replace('/url?q=','')

これでタイトルとURLが取得できました

参考

PythonのrequestsとBeautifulSoupでGoogle検索結果から、タイトルとURLと説明文だけを抜き取る

解説
参考

Python 初心者向けの入門から応用・使い方の学習をまとめ

解説

参考

関連記事