[BUG] Google News only return 100 query even if max_results is set at 1000 #208
Description
Describe the bug
When using GNews API as a source you cannot get the query results for more than 100 articles at one time no matter how you set the parameters.
To Reproduce
from obsei.source.google_news_source import GoogleNewsConfig, GoogleNewsSource
source_config = GoogleNewsConfig(
query="bitcoin",
max_results=1000,
fetch_article=True,
lookup_period="365d",
)
source = GoogleNewsSource()
source_response_list = source.lookup(source_config)
len(source_response_list)
Expected behavior
1000 articles should be fetched
Please complete the following information:
- OS: Google Colab (Ubuntu-18.04)