DataExport API

The two supported methods for data exporting are Pagination and Streaming.

Pagination is useful if you would like to use GetData.IO's platform as the backend for your frontend application whereas Streaming is typically useful for syncing a relatively large dataset into your own database.


Paginated Export

Call Structure

 GET http://data.getdata.io/:data_source_unique_id/paginate?format=:format&timestamp=:timestamp&page=:page&per_page=:per_page

Supported Params

data_source_unique_id Required String The unique identified of a data source
format Optional String Supported formats are
  • csv
  • json
  • html
    • Defaults to json when not indicated
timestamp OptionalString The UTC timestamp of the batch of data to export. Can be indicated in either of the following format:
  • UTC Time Stamp - 1492526583
  • ISO Time - 2017-04-18 21:43:03
page Optionalinteger Defaults to 1
per_page Optionalinteger Defaults to 100

Sample JSON Request

 GET http://data.getdata.io/n3647_8e3b0a7ffba377a7eddd5419034adc5feses/paginate?timestamp=1492526583&page=2&per_page=3

Sample JSON Response

{
  "total": 300,
  "timestamp": "2017-04-18 21:43:03",
  "pagination": {
    "current_page": 2,
    "per_page": 3,
    "total_pages": 100,
    "next_page": "http://data.getdata.io/n3647_8e3b0a7ffba377a7eddd5419034adc5feses/paginate?timestamp=1492576983&page=1&per_page=100",
    "prev_page": "http://data.getdata.io/n3647_8e3b0a7ffba377a7eddd5419034adc5feses/paginate?timestamp=1492576983&page=3&per_page=100"
  },
  "results": [{
    "address": "2402 E Esplanade Ln, Phoenix, AZ 85016 ",
    "neighborhood": "Camelback East",
    "origin_pattern": "https://www.zillow.com/homedetails/2402-E-Esplanade-Ln-Phoenix-AZ-85016/59267938_zpid/",
    "createdAt": "2017-04-18 21:43:03",
    "updatedAt": "2017-04-18 21:43:03",
    "pingedAt": "2017-04-18 21:43:03"
  }, {
    "address": "251 E Esplanade Ln, Phoenix, AZ 85016 ",
    "neighborhood": "Camelback East",
    "origin_pattern": "https://www.zillow.com/homedetails/2402-E-Esplanade-Ln-Phoenix-AZ-85016/59267938_zpid/",
    "createdAt": "2017-04-18 21:43:03",
    "updatedAt": "2017-04-18 21:43:03",
    "pingedAt": "2017-04-18 21:43:03"
  }, {
    "address": "300 E Esplanade Ln, Phoenix, AZ 85016 ",
    "neighborhood": "Camelback East",
    "origin_pattern": "https://www.zillow.com/homedetails/2402-E-Esplanade-Ln-Phoenix-AZ-85016/59267938_zpid/",
    "createdAt": "2017-04-18 21:43:03",
    "updatedAt": "2017-04-18 21:43:03",
    "pingedAt": "2017-04-18 21:43:03"
  },
  ...]
}


Streamed Export

Call Structure

 GET http://data.getdata.io/:data_source_unique_id/stream?format=:format&timestamp=:timestamp

Supported Params

data_source_unique_id Required String The unique identified of a data source
timestamp OptionalString The UTC timestamp of the batch of data to export. Can be indicated in either of the following format:
  • UTC Time Stamp - 1492526583
  • ISO Time - 2017-04-18 21:43:03

Sample CSV Request

 GET http://data.getdata.io/n3647_8e3b0a7ffba377a7eddd5419034adc5feses/stream?format=csv&timestamp=1492526583

Sample CSV Response

address,neighborhood,createdAt,updatedAt,pingedAt
"2402 E Esplanade Ln, Phoenix, AZ 85016 ",Bay Area,2017-04-18 21:43:03,2017-04-18 21:43:03,2017-04-18 21:43:03
1101 Valencia Road San Francisco,Bay Area,2017-04-18 21:43:03,2017-04-18 21:43:03,2017-04-18 21:43:03
"333 King Street, New Jersey",Bay Area,2017-04-18 21:43:03,2017-04-18 21:43:03,2017-04-18 21:43:03
"256 Cupertino Road, Cupertino",Bay Area,2017-04-18 21:43:03,2017-04-18 21:43:03,2017-04-18 21:43:03
111 Union Square,Bay Area,2017-04-18 21:43:03,2017-04-18 21:43:03,2017-04-18 21:43:03


Sample JSON Request

 GET http://data.getdata.io/n3647_8e3b0a7ffba377a7eddd5419034adc5feses/stream?format=json&timestamp=1492526583

Sample JSON Response

[{
    "address": "2402 E Esplanade Ln, Phoenix, AZ 85016 ",
    "neighborhood": "Camelback East",
    "origin_pattern": "https://www.zillow.com/homedetails/2402-E-Esplanade-Ln-Phoenix-AZ-85016/59267938_zpid/",
    "createdAt": "2017-04-18 21:43:03",
    "updatedAt": "2017-04-18 21:43:03",
    "pingedAt": "2017-04-18 21:43:03"
}, {
    "address": "251 E Esplanade Ln, Phoenix, AZ 85016 ",
    "neighborhood": "Camelback East",
    "origin_pattern": "https://www.zillow.com/homedetails/2402-E-Esplanade-Ln-Phoenix-AZ-85016/59267938_zpid/",
    "createdAt": "2017-04-18 21:43:03",
    "updatedAt": "2017-04-18 21:43:03",
    "pingedAt": "2017-04-18 21:43:03"
}, {
    "address": "300 E Esplanade Ln, Phoenix, AZ 85016 ",
    "neighborhood": "Camelback East",
    "origin_pattern": "https://www.zillow.com/homedetails/2402-E-Esplanade-Ln-Phoenix-AZ-85016/59267938_zpid/",
    "createdAt": "2017-04-18 21:43:03",
    "updatedAt": "2017-04-18 21:43:03",
    "pingedAt": "2017-04-18 21:43:03"
},
...]