My Online Training Hub

Learn Dashboards, Excel, Power BI, Power Query, Power Pivot

Web scraping/query|Power Query|Excel Forum|My Online Training Hub

You are here: Home / Web scraping/query|Power Query|Excel Forum|My Online Training Hub
Avatar
sp_LogInOut Log In sp_Registration Register
sp_Search Search
Advanced Search|Last Search Results
Search
Forum Scope



Match



Forum Options



Minimum search word length is 3 characters - maximum search word length is 84 characters
sp_Search Search
sp_RankInfo
Lost password?
sp_PrintTopic sp_TopicIcon
Web scraping/query
Avatar
Alex Lecuy

New Member
Members
Level 0
Forum Posts: 1
Member Since:
December 9, 2020
sp_UserOfflineSmall Offline
1
December 9, 2020 - 6:29 pm
sp_Permalink sp_Print
Hi all  ! 
 
So, I have to make a list of the mayors in Calvados, Normandy (528 of them..). 
So there’s this website called AMF (https://www.amf.asso.fr/annuai.....ep_n_id=14) which gives me the list of all the cities in Calvados. However in order to have the name of the mayor you’d have to click individually on the name of the city + there’s one page per letter in the alphabet. 
 
Ideally I’d want the name of the city, the « Insee code », the name of the mayor, and for it to update of the website updates changes. 
 
I have reached out to Mynda who sent me the link to her web scraping video but I can’t seem to understand the « formula » part. I get that the URL is  predictable, but I can’t get it to work + when I do a web query I don’t have the option of creating a table based on an example.   
It’s a lot to ask but I don’t really care for a file to be sent to me without any explanation, I’d love a detailed answer, as I’d like to be able to do it again in the future by myself. 
by the way, intermediate user here, but eager to learn ! 
 
Thank you in advance !
 
Alex
Avatar
Mynda Treacy
Admin
Level 10
Forum Posts: 4619
Member Since:
July 16, 2010
sp_UserOnlineSmall Online
2
December 9, 2020 - 10:20 pm
sp_Permalink sp_Print

Hi Alex,

Since the page doesn't have any tables, you need to drill down on the Document tables until you find the information you want. In the attached file I've created an example using 3 Insee values. You'll notice insee 14003 must have a different page structure because the mayor is in the city column. Not much you can do about this if the source data isn't consistent and you don't want to use Power BI to get the data using 'from examples'.

I hope that points you in the right direction. You will need to create your own list of Insee values for use in the query.

Mynda

sp_Feed
Go to top
Forum Timezone: Australia/Brisbane
Most Users Ever Online: 245
Currently Online: Mynda Treacy, Riny van Eekelen
Guest(s) 10
Currently Browsing this Page:
1 Guest(s)
Top Posters:
SunnyKow: 1432
Anders Sehlstedt: 880
Purfleet: 414
Frans Visser: 346
David_Ng: 306
lea cohen: 237
Jessica Stewart: 219
A.Maurizio: 213
Aye Mu: 201
Hans Hallebeek: 185
Newest Members:
Kwaje Alfred Mogga
thong nguyen
Appiagyei Kofi Frimpong
Hilary Burchfield
Richie Wright
Adel Kock
Barbara Murray
Doug Milne
Siobhan Stringer
Rob Rooth
Forum Stats:
Groups: 3
Forums: 24
Topics: 6544
Posts: 28650

 

Member Stats:
Guest Posters: 49
Members: 32831
Moderators: 2
Admins: 4
Administrators: Mynda Treacy, Philip Treacy, Catalin Bombea, FT
Moderators: Velouria, Riny van Eekelen