Omega Owners Forum

Please login or register.

Login with username, password and session length
Advanced search  

News:

Welcome to OOF

Pages: [1]   Go Down

Author Topic: Probably one for an IT geek...  (Read 859 times)

0 Members and 1 Guest are viewing this topic.

Lazydocker

  • Omega Queen
  • *****
  • Offline Offline
  • Gender: Male
  • Woodbridge, Suffolk
  • Posts: 18848
  • Constantly Bullied by a certain Admin
    • View Profile
Probably one for an IT geek...
« on: 30 October 2012, 15:27:32 »

I'm looking for a way to extract the name and address details from search results (on yell/thompson/other listing sites) and dump them into a .csv file for my reference. Anyone know of an easy way to do it?

For a start I'm trying to lift the garage names and addresses from these results:

Thanks in advance
Logged
Whatever it is... I didn't do it

the alarming man

  • Omega Baron
  • *****
  • Offline Offline
  • Gender: Male
  • medway kent
  • Posts: 3641
    • disco V8
    • View Profile
Re: Probably one for an IT geek...
« Reply #1 on: 30 October 2012, 15:58:58 »

paul quite a few of those don't even exsist anymore.. :y
Logged
'the more people i meet...the more i like the dog'

The whole problem with the world is that fools and fanatics are always so certain of themselves, but wiser people so full of doubts.

Lazydocker

  • Omega Queen
  • *****
  • Offline Offline
  • Gender: Male
  • Woodbridge, Suffolk
  • Posts: 18848
  • Constantly Bullied by a certain Admin
    • View Profile
Re: Probably one for an IT geek...
« Reply #2 on: 30 October 2012, 16:02:31 »

paul quite a few of those don't even exsist anymore.. :y
Yep, it's not for a concise list but to give an idea and point the lad in the right direction for the marketing. No mail shots or anything like that :y

That said, I think the idea could potentially breach the T&C's of the site I linked to so it might be dead before it starts ::)
Logged
Whatever it is... I didn't do it

tunnie

  • Get A Life!!
  • *****
  • Offline Offline
  • Gender: Male
  • Surrey
  • Posts: 37526
    • Zafira Tourer & BMW 435i
    • View Profile
Re: Probably one for an IT geek...
« Reply #3 on: 30 October 2012, 16:03:48 »

Humm difficult, as you have to click through pages to get more results.

What do you want to use the search results for?

I'd maybe look at "printing" the results, but print to PDF, then import those....
Logged

Lazydocker

  • Omega Queen
  • *****
  • Offline Offline
  • Gender: Male
  • Woodbridge, Suffolk
  • Posts: 18848
  • Constantly Bullied by a certain Admin
    • View Profile
Re: Probably one for an IT geek...
« Reply #4 on: 30 October 2012, 16:13:20 »

All I want is the garage name and addresses that I can then sort by postcode/town for example.
Logged
Whatever it is... I didn't do it

tunnie

  • Get A Life!!
  • *****
  • Offline Offline
  • Gender: Male
  • Surrey
  • Posts: 37526
    • Zafira Tourer & BMW 435i
    • View Profile
Re: Probably one for an IT geek...
« Reply #5 on: 30 October 2012, 16:17:14 »

I'd say PDF is the way, trouble is you cannot increase the number of search results.

Also might be better using Google Maps:

https://maps.google.co.uk/maps?q=Petrol+Stations+Kent&hl=en&ll=51.256758,0.714111&spn=0.684123,1.234589&sll=51.528642,-0.101599&sspn=0.680074,1.234589&hq=Petrol+Stations&hnear=Kent,+United+Kingdom&t=m&z=10

You can just select the text on the left, could just copy and paste. Might get a bit of RSI though  ;D
Logged

cem_devecioglu

  • Guest
Re: Probably one for an IT geek...
« Reply #6 on: 30 October 2012, 16:41:28 »

if you view the source of html page, its a combination of javascript and html.. a part of the adresses come from variables.. so even if you you write a word tracking script you wont get much data :-\
Logged

Kevin Wood

  • Global Moderator
  • *****
  • Offline Offline
  • Gender: Male
  • Alton, Hampshire
  • Posts: 36285
    • Jaguar XE 25t, Westfield
    • View Profile
Re: Probably one for an IT geek...
« Reply #7 on: 30 October 2012, 17:15:33 »

I would imagine they would have deliberately designed the page to make it awkward for third parties to scrape the results, to be honest. Probably means that if you invest in writing code to do it they will be regularly changing their implementation anyway, so it will quickly become outdated.
Logged
Tech2 services currently available. See TheBoy's price list: http://theboy.omegaowners.com/

Lazydocker

  • Omega Queen
  • *****
  • Offline Offline
  • Gender: Male
  • Woodbridge, Suffolk
  • Posts: 18848
  • Constantly Bullied by a certain Admin
    • View Profile
Re: Probably one for an IT geek...
« Reply #8 on: 30 October 2012, 17:54:12 »

I would imagine they would have deliberately designed the page to make it awkward for third parties to scrape the results, to be honest. Probably means that if you invest in writing code to do it they will be regularly changing their implementation anyway, so it will quickly become outdated.

Not a huge issue. Once he's been round the garages a few times he doesn't need the list any more anyway ;)

Looks like I'll have to do it the way I did the last lot in Central London... Slowly and with Google maps, scrolling across and selecting each garage in turn to copy the address into a spreadsheet I have built :(

It was worth a try though ::)

Having delved a bit deeper it seems that Yell don't look too kindly on it (and I would imagine most directories would be the same) anyway so it's the long, slow process of doing it manually I suppose ::)
Logged
Whatever it is... I didn't do it

TheBoy

  • Administrator
  • *****
  • Offline Offline
  • Gender: Male
  • Brackley, Northants
  • Posts: 105996
  • I Like Lockdown
    • Whatever Starts
    • View Profile
Re: Probably one for an IT geek...
« Reply #9 on: 30 October 2012, 18:56:01 »

You will find these companies would rather sell you a list from their databases....
Logged
Grumpy old man

Lazydocker

  • Omega Queen
  • *****
  • Offline Offline
  • Gender: Male
  • Woodbridge, Suffolk
  • Posts: 18848
  • Constantly Bullied by a certain Admin
    • View Profile
Re: Probably one for an IT geek...
« Reply #10 on: 30 October 2012, 19:04:41 »

You will find these companies would rather sell you a list from their databases....
From what I can find, they don't even do that any more ::)
Logged
Whatever it is... I didn't do it

TheBoy

  • Administrator
  • *****
  • Offline Offline
  • Gender: Male
  • Brackley, Northants
  • Posts: 105996
  • I Like Lockdown
    • Whatever Starts
    • View Profile
Re: Probably one for an IT geek...
« Reply #11 on: 30 October 2012, 19:10:46 »

You will find these companies would rather sell you a list from their databases....
From what I can find, they don't even do that any more ::)
Plenty of companies will. And probably more comprehensive than a subscribed advertiser.
Logged
Grumpy old man

Lazydocker

  • Omega Queen
  • *****
  • Offline Offline
  • Gender: Male
  • Woodbridge, Suffolk
  • Posts: 18848
  • Constantly Bullied by a certain Admin
    • View Profile
Re: Probably one for an IT geek...
« Reply #12 on: 30 October 2012, 19:14:27 »

You will find these companies would rather sell you a list from their databases....
From what I can find, they don't even do that any more ::)
Plenty of companies will. And probably more comprehensive than a subscribed advertiser.
True... But the few I have looked at don't seem to have anywhere near the number of garages I know are there ::)
Logged
Whatever it is... I didn't do it
Pages: [1]   Go Up
 

Page created in 0.017 seconds with 17 queries.