Forum

Notifications
Clear all

URL Creation

4 Posts
2 Users
0 Reactions
96 Views
(@ehab1511)
Posts: 31
Trusted Member
Topic starter
 

Hi,

Could you please help me to create URL as I have many URLs and I want to generate all pages from each URL as below.

I have fixed URL and I know there are multi pages have the same URL but with different Number and I have pages count.

Master URL Pages Count
http://worldofmanufacturers.com/bolts-fasteners/page/ 3

So I want to create all URLs as below.

http://worldofmanufacturers.com/bolts-fasteners/page/3

http://worldofmanufacturers.com/bolts-fasteners/page/2

http://worldofmanufacturers.com/bolts-fasteners/page/1

Please check attached to get more samples.  "Column "C" is the expected macro result.

Thanks;

Ehab

 
Posted : 03/06/2019 4:14 pm
Philip Treacy
(@philipt)
Posts: 1629
Member Admin
 

Hi Ehab,

Before I start working on a solution, can I ask what you are actually trying to do with all of these URL's?

Do you plan on visiting all of them to do some scraping?  If so there's other approaches.

Phil

 
Posted : 03/06/2019 6:49 pm
(@ehab1511)
Posts: 31
Trusted Member
Topic starter
 

Hi Philip,

I have target in my work to get a lot of companies with their websites, I need millions.

So I'm searching to get this and I found http://worldofmanufacturers.com/category/ and I want to extract all companies and websites as below.

Company Name: B.&D. Industries Ltd.
Website: www.db-industriesltd.com

Above data found in this URL  http://worldofmanufacturers.com/company-detail/UXFOjwhmKLE8Qd

So I want to create pages URLs as I have simple tool can be extract this, but it is very slow and have limitation .

Could you please help me about this.

Thanks;

Ehab

 
Posted : 04/06/2019 8:08 am
Philip Treacy
(@philipt)
Posts: 1629
Member Admin
 

Hi Ehab,

We try to help people to learn how to solve problems, so with that in mind, what have you tried as a solution to this?

Have you read these articles and tried to modify the code to do what you want?

https://www.myonlinetraininghub.com/web-scraping-with-vba

https://www.myonlinetraininghub.com/web-scraping-multiple-pages

https://www.myonlinetraininghub.com/web-scraping-filling-forms

 

You may want to look at this tool as it might do what you want, or at least get you part way

https://www.screamingfrog.co.uk/web-scraping/

 

Regards

Phil

 
Posted : 04/06/2019 7:17 pm
Share: