Community / The Reporter / Science News | Daily news articles, blogs and biweekly magazine covering all areas of science - News Headlines

We monitor the news headline from this website which we then use to train our sentiment analysis engine to detect for bad news about publicly traded companies

Domain: sciencenews.org , Associated categories: News

Harvested on CSV JSON HTML

1,279

Your data source is queuing to start getting data. You will get data soon.

An email will be sent to you once we are finished with this batch.

Meanwhile you might be also interested in the 24,848 public data sources
contributed by the rest of our community

Check them out

Data source unique ID

n4835_d28f9b2e9e5842793a66f11a8c2a19fbeses

Privacy

Public

Last ran status

QUEUED

Last ran

2019-06-20 21:00:00 UTC

Crawl Frequency

Hourly

Urls to Crawl

Use default URL in recipe

{
    "engine": "nokogiri",
    "client_version": "4.0.13",
    "origin_url": "https://www.sciencenews.org/",
    "columns": [
        {
            "col_name": "news_headlines",
            "dom_query": "ul li div.views-field.views-field-title span a"
        },
        {
            "col_name": "article_urls",
            "dom_query": "ul li div.views-field.views-field-title span a",
            "required_attribute": "href"
        }
    ],
    "cookies": [
        {
            "domain": "www.sciencenews.org",
            "expirationDate": 1526727703,
            "hostOnly": true,
            "httpOnly": false,
            "name": "__smVID",
            "path": "/article",
            "sameSite": "no_restriction",
            "secure": false,
            "session": false,
            "storeId": "0",
            "value": "ead7d68269ead1f2e4c4a4fdef42f6fe860bb90aeb46693033f7cb9bd6fbe2d6"
        },
        {
            "domain": "www.sciencenews.org",
            "hostOnly": true,
            "httpOnly": false,
            "name": "has_js",
            "path": "/",
            "sameSite": "no_restriction",
            "secure": false,
            "session": true,
            "storeId": "0",
            "value": "1"
        },
        {
            "domain": "www.sciencenews.org",
            "expirationDate": 1555671704,
            "hostOnly": true,
            "httpOnly": false,
            "name": "__smToken",
            "path": "/",
            "sameSite": "no_restriction",
            "secure": false,
            "session": false,
            "storeId": "0",
            "value": "TaI9mcO8UfTfHeYrjsSjt1gB"
        }
    ]
}