Get data from any page you want to get data from.
Need to talk to someone? Contact us—we’d love to help.
Get data from any page you want to get data from.
Need to talk to someone? Contact us—we’d love to help.
We are still busy preparing this batch of data. Please come back in a few minutes.
Seems like this data source was never ran before...
Changes are only available only when you have ran at least a second time.
Nope... guess no Martians around... Maybe set the webhook URL before pressing this button again...
Column 1 | origin_pattern | origin_url | createdAt | updatedAt | pingedAt |
---|---|---|---|---|---|
At 1:32 of the video we are told to select categories, but that's not possible. ... | https://www.youtube.com/watch?v=n7fob_XVsbY&t=92s | https://www.youtube.com/watch?v=n7fob_XVsbY&t=92s | 2024-08-24 11:51:57 UTC | 2024-08-24 11:51:57 UTC | 2024-08-24 11:51:57 UTC |
Do you have to re-scrape the website every time f. example prices and stock numbe... | https://www.youtube.com/watch?v=n7fob_XVsbY&t=92s | https://www.youtube.com/watch?v=n7fob_XVsbY&t=92s | 2024-08-24 11:51:57 UTC | 2024-08-24 11:51:57 UTC | 2024-08-24 11:51:57 UTC |
Great tool thank you I just used this! Is there a way to only export certain colu... | https://www.youtube.com/watch?v=n7fob_XVsbY&t=92s | https://www.youtube.com/watch?v=n7fob_XVsbY&t=92s | 2024-08-24 11:51:57 UTC | 2024-08-24 11:51:57 UTC | 2024-08-24 11:51:57 UTC |
Hi! It's a great video! I have an issue with links opening in the new tab I tried... | https://www.youtube.com/watch?v=n7fob_XVsbY&t=92s | https://www.youtube.com/watch?v=n7fob_XVsbY&t=92s | 2024-08-24 11:51:57 UTC | 2024-08-24 11:51:57 UTC | 2024-08-24 11:51:57 UTC |
Hi, I have more than 300 elements on the page but when I set up everything and cl... | https://www.youtube.com/watch?v=n7fob_XVsbY&t=92s | https://www.youtube.com/watch?v=n7fob_XVsbY&t=92s | 2024-08-24 11:51:57 UTC | 2024-08-24 11:51:57 UTC | 2024-08-24 11:51:57 UTC |
How does this scraper handle pagination? I have Primary categories (Multiple) wit... | https://www.youtube.com/watch?v=n7fob_XVsbY&t=92s | https://www.youtube.com/watch?v=n7fob_XVsbY&t=92s | 2024-08-24 11:51:57 UTC | 2024-08-24 11:51:57 UTC | 2024-08-24 11:51:57 UTC |
I have scrap data but my lappy has shutdown, that's why I have scraped half data,... | https://www.youtube.com/watch?v=n7fob_XVsbY&t=92s | https://www.youtube.com/watch?v=n7fob_XVsbY&t=92s | 2024-08-24 11:51:57 UTC | 2024-08-24 11:51:57 UTC | 2024-08-24 11:51:57 UTC |
I'm sorry guys, but this is difficult to follow. | https://www.youtube.com/watch?v=n7fob_XVsbY&t=92s | https://www.youtube.com/watch?v=n7fob_XVsbY&t=92s | 2024-08-24 11:51:57 UTC | 2024-08-24 11:51:57 UTC | 2024-08-24 11:51:57 UTC |
Im trying to scrape the easiest site, it wont let me select links on the page? Ho... | https://www.youtube.com/watch?v=n7fob_XVsbY&t=92s | https://www.youtube.com/watch?v=n7fob_XVsbY&t=92s | 2024-08-24 11:51:57 UTC | 2024-08-24 11:51:57 UTC | 2024-08-24 11:51:57 UTC |
Installed the extension, then that's it. I do not have any options to do anything... | https://www.youtube.com/watch?v=n7fob_XVsbY&t=92s | https://www.youtube.com/watch?v=n7fob_XVsbY&t=92s | 2024-08-24 11:51:57 UTC | 2024-08-24 11:51:57 UTC | 2024-08-24 11:51:57 UTC |
It's a great tool, but I'm facing problem while extracting image in a site . The ... | https://www.youtube.com/watch?v=n7fob_XVsbY&t=92s | https://www.youtube.com/watch?v=n7fob_XVsbY&t=92s | 2024-08-24 11:51:57 UTC | 2024-08-24 11:51:57 UTC | 2024-08-24 11:51:57 UTC |
Keep getting the error "cookie sent in cross-site context will be blocked in futu... | https://www.youtube.com/watch?v=n7fob_XVsbY&t=92s | https://www.youtube.com/watch?v=n7fob_XVsbY&t=92s | 2024-08-24 11:51:57 UTC | 2024-08-24 11:51:57 UTC | 2024-08-24 11:51:57 UTC |
Nice tool. The tutorials show how to scrape: (a) one page of products for multipl... | https://www.youtube.com/watch?v=n7fob_XVsbY&t=92s | https://www.youtube.com/watch?v=n7fob_XVsbY&t=92s | 2024-08-24 11:51:57 UTC | 2024-08-24 11:51:57 UTC | 2024-08-24 11:51:57 UTC |
Nothing happens when I click select and click on the menus. I'm using the same t... | https://www.youtube.com/watch?v=n7fob_XVsbY&t=92s | https://www.youtube.com/watch?v=n7fob_XVsbY&t=92s | 2024-08-24 11:51:57 UTC | 2024-08-24 11:51:57 UTC | 2024-08-24 11:51:57 UTC |
Selectors simply don't work, uninstall :( disapointing | https://www.youtube.com/watch?v=n7fob_XVsbY&t=92s | https://www.youtube.com/watch?v=n7fob_XVsbY&t=92s | 2024-08-24 11:51:57 UTC | 2024-08-24 11:51:57 UTC | 2024-08-24 11:51:57 UTC |
The selector tool didn't show up for me until updating to Chrome 87.0.4280.88 Ho... | https://www.youtube.com/watch?v=n7fob_XVsbY&t=92s | https://www.youtube.com/watch?v=n7fob_XVsbY&t=92s | 2024-08-24 11:51:57 UTC | 2024-08-24 11:51:57 UTC | 2024-08-24 11:51:57 UTC |
What should we do with the long list? For example, Page 1, Page 2, ... The final ... | https://www.youtube.com/watch?v=n7fob_XVsbY&t=92s | https://www.youtube.com/watch?v=n7fob_XVsbY&t=92s | 2024-08-24 11:51:57 UTC | 2024-08-24 11:51:57 UTC | 2024-08-24 11:51:57 UTC |
how do i add pagination link? | https://www.youtube.com/watch?v=n7fob_XVsbY&t=92s | https://www.youtube.com/watch?v=n7fob_XVsbY&t=92s | 2024-08-24 11:51:57 UTC | 2024-08-24 11:51:57 UTC | 2024-08-24 11:51:57 UTC |
is there a work around for if when parent goes away once selected? | https://www.youtube.com/watch?v=n7fob_XVsbY&t=92s | https://www.youtube.com/watch?v=n7fob_XVsbY&t=92s | 2024-08-24 11:51:57 UTC | 2024-08-24 11:51:57 UTC | 2024-08-24 11:51:57 UTC |
this is so useful. thank you for making this extension. | https://www.youtube.com/watch?v=n7fob_XVsbY&t=92s | https://www.youtube.com/watch?v=n7fob_XVsbY&t=92s | 2024-08-24 11:51:57 UTC | 2024-08-24 11:51:57 UTC | 2024-08-24 11:51:57 UTC |
Sample code snippets to quickly import data set into your application
For more information on how to automatically trigger an import please reference our WebHook API guide
Integrating with Java
import java.io.BufferedReader; import java.io.InputStreamReader; import java.net.URL; import java.net.URLConnection; import java.util.Arrays; public class HelloWorld { public static void main(String[] args) { try { URL urlCSV = new URL( "https://cache.getdata.io/n132813_38bfcb8c59c30745edbc2722bdcbdf69eses/latest_all.csv" ); URLConnection urlConn = urlCSV.openConnection(); InputStreamReader inputCSV = new InputStreamReader( ((URLConnection) urlConn).getInputStream() ); BufferedReader br = new BufferedReader(inputCSV); String line; String[] fields; while ((line = br.readLine()) != null) { // Each row fields = line.split(","); System.out.println(Arrays.toString(fields)); } // clean up buffered reader br.close(); } catch (Exception e) { System.out.println(e.getMessage()); } } }
Integrating with NodeJs
const csv = require('csv-parser'); const https = require('https'); const fs = require('fs'); const file = fs.createWriteStream("temp_download.csv"); const request = https.get( "https://cache.getdata.io/n132813_38bfcb8c59c30745edbc2722bdcbdf69eses/latest_all.csv", function(response) { response.pipe(file); } ); file.on('finish', function() { file.close(); fs.createReadStream('temp_download.csv').pipe(csv()).on('data', (row) => { // Each row console.log(row); }).on('end', () => { console.log('CSV file successfully processed'); }); });
Integrating with PHP
$data = file_get_contents("https://cache.getdata.io/n132813_38bfcb8c59c30745edbc2722bdcbdf69eses/latest_all.csv"); $rows = explode("\n",$data); $s = array(); foreach($rows as $row) { # Each row var_dump( $row); }
Integrating with Python
import csv import urllib2 url = 'https://cache.getdata.io/n132813_38bfcb8c59c30745edbc2722bdcbdf69eses/latest_all.csv' response = urllib2.urlopen(url) cr = csv.reader(response) for row in cr: # Each row print row
Integrating with Ruby
require 'open-uri' require 'tempfile' require 'csv' temp_file = Tempfile.new( "getdata", :encoding => 'ascii-8bit') temp_file << open("https://cache.getdata.io/n132813_38bfcb8c59c30745edbc2722bdcbdf69eses/latest_all.csv").read temp_file.rewind CSV.foreach( open(uri), :headers => :first_row ).each do |row| # Each row puts row end