Community / Gary Teh / Zillow.com - Adhoc crawls

Domain: zillow.com , Associated categories: Real Estate

address	neighborhood	zestimate_sale	description	configuration	bedrooms	bathrooms	size	price	year built	transaction_type	home_type	images_page	price_history_page	lister_page	event_date	event_name	event_price	price_history_page_origin_pattern	price_history_page_origin_url	lister_page_origin_pattern	lister_page_origin_url	origin_pattern	origin_url	createdAt	updatedAt	pingedAt
14012 N 38th Pl, Phoenix, AZ 85032	Paradise Valley	235,830	Note: This property is not currently for sale or for rent. The description below ...	-- beds2 baths1,064 sqft	-- beds	2 baths	1,064 sqft	165,000	1970	Sold: $165,000	Single Family	AjaxRender.htm?encparams=2~5459771551921420947~ARlWqjxhZOJ-SoPnmhJF6TsGpm7i4_YfpB...	AjaxRender.htm?encparams=4~3956252761205871155~wFf4_TGK_o5fATgA6IbrlWgtLBNFJ-KMmL...	AjaxRender.htm?encparams=9~2821470925843894436~qVVRYI3qYH0xyL91xM82AhFkqjHgMxbuaa...	05/11/11	Sold	$42,000-6.7%	http://localhost:9807/json_attribute_raw	http://localhost:9807/json_attribute_raw			https://www.zillow.com/homedetails/14012-N-38th-Pl-Phoenix-AZ-85032/8012504_zpid/...	http://www.zillow.com/AjaxRender.htm?encparams=4~3956252761205871155~wFf4_TGK_o5f...	2018-01-10 17:32:10 UTC	2018-01-10 17:32:10 UTC	2018-01-10 17:32:10 UTC
14012 N 38th Pl, Phoenix, AZ 85032	Paradise Valley	235,830	Note: This property is not currently for sale or for rent. The description below ...	-- beds2 baths1,064 sqft	-- beds	2 baths	1,064 sqft	165,000	1970	Sold: $165,000	Single Family	AjaxRender.htm?encparams=2~5459771551921420947~ARlWqjxhZOJ-SoPnmhJF6TsGpm7i4_YfpB...	AjaxRender.htm?encparams=4~3956252761205871155~wFf4_TGK_o5fATgA6IbrlWgtLBNFJ-KMmL...	AjaxRender.htm?encparams=9~2821470925843894436~qVVRYI3qYH0xyL91xM82AhFkqjHgMxbuaa...	03/23/11	Listed for sale	--	http://localhost:9807/json_attribute_raw	http://localhost:9807/json_attribute_raw			https://www.zillow.com/homedetails/14012-N-38th-Pl-Phoenix-AZ-85032/8012504_zpid/...	http://www.zillow.com/AjaxRender.htm?encparams=4~3956252761205871155~wFf4_TGK_o5f...	2018-01-10 17:32:10 UTC	2018-01-10 17:32:10 UTC	2018-01-10 17:32:10 UTC
14012 N 38th Pl, Phoenix, AZ 85032	Paradise Valley	235,830	Note: This property is not currently for sale or for rent. The description below ...	-- beds2 baths1,064 sqft	-- beds	2 baths	1,064 sqft	165,000	1970	Sold: $165,000	Single Family	AjaxRender.htm?encparams=2~5459771551921420947~ARlWqjxhZOJ-SoPnmhJF6TsGpm7i4_YfpB...	AjaxRender.htm?encparams=4~3956252761205871155~wFf4_TGK_o5fATgA6IbrlWgtLBNFJ-KMmL...	AjaxRender.htm?encparams=9~2821470925843894436~qVVRYI3qYH0xyL91xM82AhFkqjHgMxbuaa...	05/01/11	Listing removed	$45,000-23.7%	http://localhost:9807/json_attribute_raw	http://localhost:9807/json_attribute_raw			https://www.zillow.com/homedetails/14012-N-38th-Pl-Phoenix-AZ-85032/8012504_zpid/...	http://www.zillow.com/AjaxRender.htm?encparams=4~3956252761205871155~wFf4_TGK_o5f...	2018-01-10 17:32:10 UTC	2018-01-10 17:32:10 UTC	2018-01-10 17:32:10 UTC
14012 N 38th Pl, Phoenix, AZ 85032	Paradise Valley	235,830	Note: This property is not currently for sale or for rent. The description below ...	-- beds2 baths1,064 sqft	-- beds	2 baths	1,064 sqft	165,000	1970	Sold: $165,000	Single Family	AjaxRender.htm?encparams=2~5459771551921420947~ARlWqjxhZOJ-SoPnmhJF6TsGpm7i4_YfpB...	AjaxRender.htm?encparams=4~3956252761205871155~wFf4_TGK_o5fATgA6IbrlWgtLBNFJ-KMmL...	AjaxRender.htm?encparams=9~2821470925843894436~qVVRYI3qYH0xyL91xM82AhFkqjHgMxbuaa...				http://localhost:9807/json_attribute_raw	http://localhost:9807/json_attribute_raw	http://localhost:9807/json_attribute_raw	http://localhost:9807/json_attribute_raw	https://www.zillow.com/homedetails/14012-N-38th-Pl-Phoenix-AZ-85032/8012504_zpid/...	http://www.zillow.com/AjaxRender.htm?encparams=9~2821470925843894436~qVVRYI3qYH0x...	2018-01-10 17:32:10 UTC	2018-01-10 17:32:10 UTC	2018-01-10 17:32:10 UTC
14012 N 38th Pl, Phoenix, AZ 85032	Paradise Valley	235,830	Note: This property is not currently for sale or for rent. The description below ...	-- beds2 baths1,064 sqft	-- beds	2 baths	1,064 sqft	165,000	1970	Sold: $165,000	Single Family	AjaxRender.htm?encparams=2~5459771551921420947~ARlWqjxhZOJ-SoPnmhJF6TsGpm7i4_YfpB...	AjaxRender.htm?encparams=4~3956252761205871155~wFf4_TGK_o5fATgA6IbrlWgtLBNFJ-KMmL...	AjaxRender.htm?encparams=9~2821470925843894436~qVVRYI3qYH0xyL91xM82AhFkqjHgMxbuaa...	01/19/11	Sold: Foreclosed to lender	$58,958	http://localhost:9807/json_attribute_raw	http://localhost:9807/json_attribute_raw			https://www.zillow.com/homedetails/14012-N-38th-Pl-Phoenix-AZ-85032/8012504_zpid/...	http://www.zillow.com/AjaxRender.htm?encparams=4~3956252761205871155~wFf4_TGK_o5f...	2018-01-10 17:32:10 UTC	2018-01-10 17:32:10 UTC	2018-01-10 17:32:10 UTC
14012 N 38th Pl, Phoenix, AZ 85032	Paradise Valley	235,830	Note: This property is not currently for sale or for rent. The description below ...	-- beds2 baths1,064 sqft	-- beds	2 baths	1,064 sqft	165,000	1970	Sold: $165,000	Single Family	AjaxRender.htm?encparams=2~5459771551921420947~ARlWqjxhZOJ-SoPnmhJF6TsGpm7i4_YfpB...	AjaxRender.htm?encparams=4~3956252761205871155~wFf4_TGK_o5fATgA6IbrlWgtLBNFJ-KMmL...	AjaxRender.htm?encparams=9~2821470925843894436~qVVRYI3qYH0xyL91xM82AhFkqjHgMxbuaa...	12/20/17	Sold	$165,000+293%	http://localhost:9807/json_attribute_raw	http://localhost:9807/json_attribute_raw			https://www.zillow.com/homedetails/14012-N-38th-Pl-Phoenix-AZ-85032/8012504_zpid/...	http://www.zillow.com/AjaxRender.htm?encparams=4~3956252761205871155~wFf4_TGK_o5f...	2018-01-10 17:32:10 UTC	2018-01-10 17:32:10 UTC	2018-01-10 17:32:10 UTC

Data source unique ID

n4455_898dc18e11cfc2ab7d956c50b2b83c64eses

Privacy

Public

Last ran status

COMPLETED

Last ran

2018-01-10 17:32:10 UTC

Crawl Frequency

Not scheduled

Urls to Crawl

Use default URL in recipe

{
  "engine": "sinatra",
  "origin_url": "https://www.zillow.com/homes/for_sale/67788964_zpid/33.444119,-112.150068,33.327731,-112.266626_rect/12_zm/1_fr/",
  "columns": [{
          "col_name": "address",
          "dom_query": "header h1"
        },
        {
          "col_name": "neighborhood",
          "dom_query": "h2:contains('Neighborhood')",
          "regex_pattern": "Neighborhood: (.*)",
          "regex_group": 1
        },
        {
          "col_name": "zestimate_sale",
          "dom_query": ".home-summary-row:contains('Zestimate'):not(:contains('Rent'))",
          "regex_pattern": "[0-9,]+"
        },
        {
          "col_name": "zestimate_rent",
          "dom_query": ".home-summary-row:contains('Zestimate'):contains('Rent')",
          "regex_pattern": "[0-9,]+"
        },
        {
          "col_name": "saves",
          "dom_query": ".zsg-list_square  li:contains('shopper saved this home'):first",
          "regex_pattern": "[0-9]+"
        },
        {
          "col_name": "description",
          "dom_query": ".zsg-lg-2-3.zsg-md-1-1.hdp-header-description #home-description-fav-note + .zsg-content-component:first"
        },
        {
          "col_name": "configuration",
          "dom_query": ".zsg-content-header.addr h3"
        },
        {
          "col_name": "bedrooms",
          "dom_query": ".zsg-content-header.addr h3 .addr_bbs:nth-child(2)"
        },
        {
          "col_name": "bathrooms",
          "dom_query": ".zsg-content-header.addr h3 .addr_bbs:nth-child(4)"
        },
        {
          "col_name": "size",
          "dom_query": ".zsg-content-header.addr h3 .addr_bbs:nth-child(6)"
        },
        {
          "col_name": "lot",
          "dom_query": ".zsg-list_square  li:contains('Lot'):first"
        },
        {
          "col_name": "rooms",
          "dom_query": ".zsg-content-component.fact-group-container:has(h3:contains('Construction')) .zsg-list_square li:contains('Room count')",
          "regex_pattern": "[0-9,]+"
        },
        {
          "col_name": "stories",
          "dom_query": ".zsg-content-component.fact-group-container:has(h3:contains('Construction')) .zsg-list_square li:contains('Stories')",
          "regex_pattern": "[0-9,]+"
        },
        {
          "col_name": "price",
          "dom_query": ".main-row.home-summary-row",
          "regex_pattern": "[0-9,]+"
        },
        {
          "col_name": "parking",
          "dom_query": "h3:contains('Facts') + .zsg-list_square li:contains('Parking:'):first",
          "regex_pattern": "Parking: (.*)",
          "regex_group": 1
        },
        {
          "col_name": "year built",
          "dom_query": "p:contains('built in')",
          "regex_pattern": "built in ([0-9]+)",
          "regex_group": 1
        },
        {
          "col_name": "transaction_type",
          "dom_query": ".status-icon-row"
        },
        {
          "col_name": "bmr",
          "dom_query": ".notranslate:contains('Fair Housing Opportunity'), .notranslate:contains('BMR'):first"
        },
        {
          "col_name": "ccrc",
          "dom_query": ".notranslate:contains('retirement community'), .notranslate:contains('CCRC'):first"
        },
        {
          "col_name": "home_type",
          "dom_query": ".hdp-fact-ataglance-heading:contains('Type') + .hdp-fact-ataglance-value"
        },
        {
          "col_name": "pool",
          "dom_query": ".hdp-fact-category:contains('Spaces') + .hdp-fact-list:contains('Pool') li:contains('Pool')"
        },
        {
          "col_name": "hoa_fees",
          "dom_query": "li:contains('HOA Fee:'):first",
          "regex_pattern": "[0-9,]+"
        },
        {
          "col_name": "images_page",
          "dom_query": "script:contains('hdp-photo-lightbox-photos')",
          "regex_pattern": "{[^{]+photo[^{]+(AjaxRender[^\"]+rhost=1)[^}]+}",
          "regex_group": 1
        },
        {
          "col_name": "price_history_page",
          "dom_query": "script:contains('z-hdp-price-history')",
          "regex_pattern": "{[^{]+(AjaxRender[^\"]+rhost=1)[^}]+z-hdp-price-history[^}]+}",
          "regex_group": 1,
          "options": {
            "method": "post",
            "set_post_cookies": true,
            "post_data": {
              "origin_url": "http://www.zillow.com/@@price_history_page@@",
              "method": "get",
              "attribute": "html"
            },
            "origin_url": "http://localhost:9807/json_attribute_raw",
            "columns": [{
                "col_name": "event_date",
                "dom_query": "tbody tr td:nth-child(1)"
              },
              {
                "col_name": "event_name",
                "dom_query": "tbody tr td:nth-child(2)"
              },
              {
                "col_name": "event_price",
                "dom_query": "tbody tr td:nth-child(3)"
              }
            ]
          } 
        },
        {
          "col_name": "lister_page",
          "dom_query": "script:contains('listing-provided-by-module')",
          "regex_pattern": "{[^{]+(AjaxRender[^\"]+rhost=1)[^}]+listing-provided-by-module[^}]+}",
          "regex_group": 1,
          "options": {
            "method": "post",
            "set_post_cookies": true,
            "post_data": {
              "origin_url": "http://www.zillow.com/@@lister_page@@",
              "method": "get",
              "attribute": "html"
            },
            "origin_url": "http://localhost:9807/json_attribute_raw",
            "columns": [{
                "col_name": "lister_details",
                "dom_query": ".zsg-h2:contains('Listing Provided by') + .notranslate"           
              }
            ]
          }      
        }
    ],
  "cookies": [{
      "domain": ".www.zillow.com",
      "expirationDate": 253402257600,
      "hostOnly": false,
      "httpOnly": false,
      "name": "G_ENABLED_IDPS",
      "path": "/",
      "sameSite": "no_restriction",
      "secure": false,
      "session": false,
      "storeId": "0",
      "value": "google",
      "id": 1
    },
    {
      "domain": ".zillow.com",
      "expirationDate": 1497123072,
      "hostOnly": false,
      "httpOnly": false,
      "name": "_uetsid",
      "path": "/",
      "sameSite": "no_restriction",
      "secure": false,
      "session": false,
      "storeId": "0",
      "value": "_uete1ca00ef",
      "id": 2
    },
    {
      "domain": ".zillow.com",
      "expirationDate": 1812377655.292916,
      "hostOnly": false,
      "httpOnly": false,
      "name": "abtest",
      "path": "/",
      "sameSite": "no_restriction",
      "secure": false,
      "session": false,
      "storeId": "0",
      "value": "3|DEEYsN-5BWG3S23TJw",
      "id": 3
    },
    {
      "domain": ".zillow.com",
      "expirationDate": 1528337663,
      "hostOnly": false,
      "httpOnly": false,
      "name": "fbm_172285552816089",
      "path": "/",
      "sameSite": "no_restriction",
      "secure": false,
      "session": false,
      "storeId": "0",
      "value": "base_domain=.zillow.com",
      "id": 4
    },
    {
      "domain": ".zillow.com",
      "expirationDate": 1497128400,
      "hostOnly": false,
      "httpOnly": false,
      "name": "fbsr_172285552816089",
      "path": "/",
      "sameSite": "no_restriction",
      "secure": false,
      "session": false,
      "storeId": "0",
      "value": "E82exymHARNdhtIHsful-0APIkb1nl1s5TPqZJHG1Es.eyJhbGdvcml0aG0iOiJITUFDLVNIQTI1NiIsImNvZGUiOiJBUUFYNWxGRGNPZGY2YVkzbGN6OVpDSDVscktwdklOTVBBNDk4U0RGYlhzQ1hWTUR5THQ4VnFXQUZvV0JZWWFtU1hQbF9fVHF6M01GWlE0SFVJRkp1V1I2OXg3REVlZ2ZONnlpWURpZlRBa3NHa2gzaTJqSlF3eUVIaEhfa3RDZFo1ZDcxenNDYjA0WWEtT2YzOGRsWEpnWWdVQ0xYU2dHcVh2em1QbVJtX2JuaDU4QVlUZHNaTU5QeWNRa0I4dWhqLXpUMTlmLWI4NDQxakNBcnBVSGFaTmtIWEN0S3g2emlYbHhwOFNhalNoQzZycmpXN3kyUU9hUm54eVR4dUZHMXRsNy1ESGd0V3VQQVpfOHJILWJlakc4eExsTmxUbm1xR0c4c0NNaE5hX2JVQXVhaGVyZ2hZdUFxREVNZG5RWnJxckpHdG55b2ZZdzV3bWZhN3ZjZ2stNCIsImlzc3VlZF9hdCI6MTQ5NzEyMTIxMiwidXNlcl9pZCI6IjEwMTUzODEyNDQ4NjQzMDcyIn0",
      "id": 5
    },
    {
      "domain": ".zillow.com",
      "expirationDate": 1812515314.114355,
      "hostOnly": false,
      "httpOnly": false,
      "name": "search",
      "path": "/",
      "sameSite": "no_restriction",
      "secure": false,
      "session": false,
      "storeId": "0",
      "value": "6|1499531314746%7Crect%3D33.493235%252C-112.207661%252C33.370606%252C-112.392197%26zm%3D12%26disp%3Dmap%26mdm%3Dauto%26p%3D1%26sort%3Ddays%26z%3D1%26fs%3D1%26fr%3D0%26mmm%3D1%26rs%3D0%26ah%3D0%26singlestory%3D0%09%01%09%09%09%092%090%09US_%09",
      "id": 6
    },
    {
      "domain": ".zillow.com",
      "expirationDate": 1812658874.305664,
      "hostOnly": false,
      "httpOnly": true,
      "name": "userid",
      "path": "/",
      "sameSite": "no_restriction",
      "secure": false,
      "session": false,
      "storeId": "0",
      "value": "X|3|579d7a896a136c16%7C1%7Ce8a7MTAeP1ame_21afLnm5VvwPpbTTc7oSIRzQFg83E%3D",
      "id": 7
    },
    {
      "domain": ".zillow.com",
      "expirationDate": 1812377655.293056,
      "hostOnly": false,
      "httpOnly": false,
      "name": "zguid",
      "path": "/",
      "sameSite": "no_restriction",
      "secure": false,
      "session": false,
      "storeId": "0",
      "value": "23|%24ebfd53bf-9c74-4ffa-828d-ad42b01b12a7",
      "id": 8
    },
    {
      "domain": "www.zillow.com",
      "expirationDate": 1497294077,
      "hostOnly": true,
      "httpOnly": false,
      "name": "_px",
      "path": "/",
      "sameSite": "no_restriction",
      "secure": false,
      "session": false,
      "storeId": "0",
      "value": "egSdZNXVfKaoTUpvZKb+K4TH68zkv5pA8QFe1WiN5h9uMDItFc+udaxZfz4uYyRH62BA/uYfRjeiT4SeyxYPOg==:1000:Rkqb19+uBfYvvqnXucmTCL4DtU81yG3ohdA5iHxhd/ZGmDSCXhsw0dy3rJUKtWlOibCiyNUbF0mqGUq7Z7oT3x1R6Hec3eTWvPEvwidv9uwNXp3qWVjBVapLjdGCA0g2tfDe67wh6u9czvxx5VESFgmDc3VZjAWtnTZKLyJsSskMLLRva2hWgvFjDuBqry038P4gdInYjoW0wOEALsR5wTcXbaFhZjMHP0vyGGbAvroAcJ/xoG9S8aChVcwiqnGRw+oKuRYNQWppf+3l4kJc8A==",
      "id": 9
    },
    {
      "domain": "www.zillow.com",
      "expirationDate": 1812161662,
      "hostOnly": true,
      "httpOnly": false,
      "name": "_pxvid",
      "path": "/",
      "sameSite": "no_restriction",
      "secure": false,
      "session": false,
      "storeId": "0",
      "value": "0527c670-4b27-11e7-b73c-ef7a90f16095",
      "id": 10
    },
    {
      "domain": "www.zillow.com",
      "expirationDate": 1497726211.98037,
      "hostOnly": true,
      "httpOnly": false,
      "name": "AWSALB",
      "path": "/",
      "sameSite": "no_restriction",
      "secure": false,
      "session": false,
      "storeId": "0",
      "value": "Ah0ziKXSwOxa88mb+CRt38FEky8TZ1IOkFb5DFtwyBzIvxfz87r1KoIwP05G7VPk4ERXQhlgXpiJdd5FUYKJ3s+4B3BWIYpT5MmR7pI/Slsn+/9WZotyLsOXHyV/",
      "id": 11
    },
    {
      "domain": "www.zillow.com",
      "hostOnly": true,
      "httpOnly": true,
      "name": "JSESSIONID",
      "path": "/",
      "sameSite": "no_restriction",
      "secure": false,
      "session": true,
      "storeId": "0",
      "value": "3BA002F324F7FEB1889386C35FAAB2D5",
      "id": 12
    },
    {
      "domain": "www.zillow.com",
      "hostOnly": true,
      "httpOnly": false,
      "name": "logglytrackingsession",
      "path": "/",
      "sameSite": "no_restriction",
      "secure": false,
      "session": true,
      "storeId": "0",
      "value": "c727e640-b69f-467a-867b-76838e67aca4",
      "id": 13
    }
  ]
}