My Online Training Hub

Learn Dashboards, Excel, Power BI, Power Query, Power Pivot

Searching very large files|General Excel Questions & Answers|Excel Forum|My Online Training Hub

You are here: Home / Searching very large files|General Excel Questions & Answers|Excel Forum|My Online Training Hub

Avatar
sp_LogInOut Log In sp_Registration Register
sp_Search Search
Advanced Search
Search
Forum Scope



Match



Forum Options



Minimum search word length is 3 characters - maximum search word length is 84 characters
sp_Search Search
sp_RankInfo
Lost password?
sp_PrintTopic sp_TopicIcon
Searching very large files
Avatar
Robert Green
Member
Members
Level 0
Forum Posts: 36
Member Since:
November 9, 2020
sp_UserOfflineSmall Offline
1
January 1, 2022 - 5:45 am
sp_Permalink sp_Print

Hi there Philip and Mynda - Happy New Year!

I have downloaded the UK PAF (Postcode Address File) with 29million rows split into 6 separate files and want to use it to look up several thousand postcodes I have in another workbook and return the street address. If the PAF was (a lot) smaller I would just use XLOOKUP, so what tools do I need in order to achieve this?

Many thanks

Robert

sp_AnswersTopicSeeAnswer See Answer
Avatar
Mynda Treacy
Admin
Level 10
Forum Posts: 4784
Member Since:
July 16, 2010
sp_UserOfflineSmall Offline
2
January 1, 2022 - 10:25 am
sp_Permalink sp_Print

Hi Robert,

I would put all 29 million rows in a single CSV file. Use Power Query to get the CSV file and do the lookup in Power Query using Merge Tables.

Mynda

sp_AnswersTopicAnswer
Answers Post
Avatar
Robert Green
Member
Members
Level 0
Forum Posts: 36
Member Since:
November 9, 2020
sp_UserOfflineSmall Offline
3
January 2, 2022 - 12:07 am
sp_Permalink sp_Print

Thank you, Mynda. I'll give that a try.

All best wishes to you, Philip and your great team.

Avatar
Mynda Treacy
Admin
Level 10
Forum Posts: 4784
Member Since:
July 16, 2010
sp_UserOfflineSmall Offline
4
January 2, 2022 - 11:26 am
sp_Permalink sp_Print

Thanks, Robert! And you to 🙂

Avatar
Robert Green
Member
Members
Level 0
Forum Posts: 36
Member Since:
November 9, 2020
sp_UserOfflineSmall Offline
5
January 12, 2022 - 4:35 am
sp_Permalink sp_Print

Just to confirm that answer regarding the 29 million rows worked a treat. Thanks again.

Avatar
Mynda Treacy
Admin
Level 10
Forum Posts: 4784
Member Since:
July 16, 2010
sp_UserOfflineSmall Offline
6
January 12, 2022 - 9:46 am
sp_Permalink sp_Print

Great to hear! Thanks for letting us know.

sp_Feed
Go to top
Forum Timezone: Australia/Brisbane
Most Users Ever Online: 245
Currently Online: Alan Sidman
Guest(s) 7
Currently Browsing this Page:
1 Guest(s)
Top Posters:
Catalin Bombea: 1945
SunnyKow: 1432
Anders Sehlstedt: 959
Purfleet: 415
Hans Hallebeek: 377
Frans Visser: 351
David_Ng: 318
lea cohen: 248
Jessica Stewart: 219
A.Maurizio: 216
Newest Members:
Jennifer Hull
kris king
Hasanul Karim
Terrie s
Jack Ennis
Gary Day
Michael Wiliams
Jim Collier
Allan Chan
Rik Lelliott
Forum Stats:
Groups: 3
Forums: 25
Topics: 7159
Posts: 31414

 

Member Stats:
Guest Posters: 50
Members: 34674
Moderators: 2
Admins: 3
Administrators: Mynda Treacy, Philip Treacy, Jessica
Moderators: Velouria, Riny van Eekelen