• Market Insights
  • Community Data Catalog
  • Integrations
  • API Documentation
    • Documentation Overview
    • Quick start for getting Data
    • Quick start for exporting Data
    • Semantic Query Language
    • Data Source Management API
    • WebHooks API
    • Sentiment Analysis
  • Sign In
  • Sign Up for Free

Sign In

Sign in with Google
Sign in with LinkedIn
Sign in with GitHub
Forgot your password?
Sign up For Free

3 simple steps to get you started

Step 1. Watching this 55 seconds tutorial

Step 2. Get

Your Chrome Extension

Start your 55 seconds tutorial.

Step 3. Get data in a few clicks

Get data from any page you want to get data from.

Need more help?

Need to talk to someone? Contact us—we’d love to help.

3 simple steps to get you started

Step 1. Watching this 55 seconds tutorial

Step 2. Get

Your Chrome Extension

Start your 55 seconds tutorial.

Step 3. Get data in a few clicks

Get data from any page you want to get data from.

Need more help?

Need to talk to someone? Contact us—we’d love to help.

Opps...

We are still busy preparing this batch of data. Please come back in a few minutes.

Hmmm...

Seems like this data source was never ran before...

No changes detected

Changes are only available only when you have ran at least a second time.

Earth calling Mars...?

Nope... guess no Martians around... Maybe set the webhook URL before pressing this button again...

Server response
    

news.ycombinator.com
Hacker News

By
Daniel Weibel
Use for Free
  • Data Set Preview
  • Settings
  • Recipe
  • Collaborators
  • Sample Code
Harvested on
61
--
--
CSV JSON HTML Changes
Articleorigin_patternorigin_urlcreatedAtupdatedAtpingedAt
googleblog.comhttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
A Year Using Matrix and Riothttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
A female engineer's opinion on why there are fewer women in techhttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
Artificial Neural Nets Grow Brainlike Navigation Cellshttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
kapwing.comhttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
quantamagazine.orghttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
github.comhttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
Mara: A lightweight ETL framework, halfway between plain scripts and Airflowhttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
California Votes to Require Rooftop Solar Power on New Homeshttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
Taskwarrior, where have you been all my life?https://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
djy.iohttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
sedimental.orghttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
through-the-interface.typepad.comhttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
Glom Restructured Data for Pythonhttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
The future of AutoCADhttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
raddevon.comhttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
Build a Focus System for Better Work/Life Balance as a Web Developerhttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
Techs Two Philosophieshttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
stratechery.comhttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
How 2 M.T.A. Decisions Pushed the Subway into Crisishttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
Tidal Accused of Falsifying Beyonce and Kanye West Streaming Numbershttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
nytimes.comhttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
bloomberg.comhttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
Apple cracking down on applications that send location data to third-partieshttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
variety.comhttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
9to5mac.comhttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
Firefox 60 releasedhttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
semanticscholar.orghttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
baremetrics.comhttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
Why founders need hobbieshttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
No Thanks, Google. I'll Speak for Myselfhttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
greencarcongress.comhttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
mozilla.orghttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
Design and Evaluation of FPGA-Based Gigabit Ethernet Network Card (2004) [pdf]https://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
Mounting partitions from a dd imagehttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
tomshardware.comhttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
TensorFlow: Machine Learning on Heterogeneous Distributed Systems (2015) [pdf]https://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
My struggle to learn Reacthttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
googleusercontent.comhttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
youtube.comhttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
When banks abandoned American Samoa, the islands found a solution: public bankshttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
bradfrost.comhttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
washingtonpost.comhttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
assafmo.github.iohttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
blockexplorer.comhttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
Apple, Influence, and Ivehttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
Exeter team develops low-cost photoelectrode for water-splitting using sunlighthttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
The Paved PaaS To NodeJS Microservices at Netflix [video]https://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
googleblog.comhttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
huji.ac.ilhttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
Cloud Memorystore: A fully managed in-memory data store service for Redishttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
Google Duplex: An AI System for Accomplishing Real World Tasks Over the Phonehttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
Understanding Machine Learning: From Theory to Algorithmshttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
EasyPost is hiringhttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
Malware Wallet Electrum Pro Stealing Seed Keyshttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
easypost.comhttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
hodinkee.comhttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
itscode.redhttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
Think Youve Got Your Credit Freezes Covered? Think Againhttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
Morehttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
krebsonsecurity.comhttps://news.ycombinator.com/https://news.ycombinator.com/2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC2018-05-09 19:29:43 UTC
Data source unique ID
n5108_f3e4cbce5dccaf886b0b6f02b4d24509eses
Privacy
Public
Last ran status
COMPLETED
Last ran
2018-05-09 19:29:43 UTC
Crawl Frequency
Not scheduled
Urls to Monitor
Use default URL in recipe

Sample code snippets to quickly import data set into your application

For more information on how to automatically trigger an import please reference our WebHook API guide


Integrating with Java

import java.io.BufferedReader;
import java.io.InputStreamReader;
import java.net.URL;
import java.net.URLConnection;
import java.util.Arrays;

public class HelloWorld {
  public static void main(String[] args) {

    try {
      URL urlCSV = new URL(
        "https://cache.getdata.io/n5108_f3e4cbce5dccaf886b0b6f02b4d24509eses/latest_all.csv"
      );

      URLConnection urlConn = urlCSV.openConnection();
      InputStreamReader inputCSV = new InputStreamReader(
        ((URLConnection) urlConn).getInputStream()
      );
      BufferedReader br = new BufferedReader(inputCSV);

      String line;
      String[] fields;
      while ((line = br.readLine()) != null) {
        // Each row
        fields = line.split(",");
        System.out.println(Arrays.toString(fields));

      }
      // clean up buffered reader
      br.close();


    } catch (Exception e) {
      System.out.println(e.getMessage());
    }
  }   
}


Integrating with NodeJs

const csv     = require('csv-parser');
const https   = require('https');
const fs      = require('fs');

const file = fs.createWriteStream("temp_download.csv");
const request = https.get(
  "https://cache.getdata.io/n5108_f3e4cbce5dccaf886b0b6f02b4d24509eses/latest_all.csv", 
  function(response) {
    response.pipe(file);
  }
);

file.on('finish', function() {
  file.close();
  fs.createReadStream('temp_download.csv').pipe(csv()).on('data', (row) => {
    // Each row
    console.log(row);

  }).on('end', () => {
    console.log('CSV file successfully processed');

  });
});



Integrating with PHP

$data = file_get_contents("https://cache.getdata.io/n5108_f3e4cbce5dccaf886b0b6f02b4d24509eses/latest_all.csv");
$rows = explode("\n",$data);
$s = array();
foreach($rows as $row) {

  # Each row
  var_dump( $row);
  
}


Integrating with Python

import csv
import urllib2

url = 'https://cache.getdata.io/n5108_f3e4cbce5dccaf886b0b6f02b4d24509eses/latest_all.csv'
response = urllib2.urlopen(url)
cr = csv.reader(response)

for row in cr:
  # Each row
  print row


Integrating with Ruby

require 'open-uri'
require 'tempfile'
require 'csv'

temp_file = Tempfile.new( "getdata", :encoding => 'ascii-8bit')
temp_file << open("https://cache.getdata.io/n5108_f3e4cbce5dccaf886b0b6f02b4d24509eses/latest_all.csv").read
temp_file.rewind

CSV.foreach( open(uri), :headers => :first_row ).each do |row|      
  # Each row
  puts row
end

Daniel Weibel owner

Categories

News

Related Data Sources

g1.globo.com

https://g1.globo.com/ - News Headlines - Copy - Copy

We monitor the news headline from this website which we then use to train our sentiment analysis e...

News

created on 2024-09-28

Jean Marcos
1
630
moneycontrol.com

MoneyControl.com - News Headlines - Copy

We monitor the news headline from this website which we then use to train our sentiment analysis e...

News

created on 2024-07-13

Nippun Giran
3
1,096
news.google.com

news.google.com - News Headlines - Copy

We monitor the news headline from this website which we then use to train our sentiment analysis e...

News

created on 2024-01-02

nwe n
2
3
news.google.com

news.google.com - News Headlines - Copy

We monitor the news headline from this website which we then use to train our sentiment analysis e...

News

created on 2024-01-01

Karim Afifi
3
3
More related data sources