My Online Training Hub

Learn Dashboards, Excel, Power BI, Power Query, Power Pivot

Searching very large files|General Excel Questions & Answers|Excel Forum|My Online Training Hub

You are here: Home / Searching very large files|General Excel Questions & Answers|Excel Forum|My Online Training Hub
Avatar
sp_LogInOut Log In sp_Registration Register
sp_Search Search
Advanced Search
Search
Forum Scope



Match



Forum Options



Minimum search word length is 3 characters - maximum search word length is 84 characters
sp_Search Search
sp_RankInfo
Lost password?
sp_PrintTopic sp_TopicIcon
Searching very large files
Avatar
Robert Green
Member
Members
Level 0
Forum Posts: 25
Member Since:
November 9, 2020
sp_UserOfflineSmall Offline
1
January 1, 2022 - 5:45 am
sp_Permalink sp_Print

Hi there Philip and Mynda - Happy New Year!

I have downloaded the UK PAF (Postcode Address File) with 29million rows split into 6 separate files and want to use it to look up several thousand postcodes I have in another workbook and return the street address. If the PAF was (a lot) smaller I would just use XLOOKUP, so what tools do I need in order to achieve this?

Many thanks

Robert

sp_AnswersTopicSeeAnswer See Answer
Avatar
Mynda Treacy
Admin
Level 10
Forum Posts: 4614
Member Since:
July 16, 2010
sp_UserOfflineSmall Offline
2
January 1, 2022 - 10:25 am
sp_Permalink sp_Print

Hi Robert,

I would put all 29 million rows in a single CSV file. Use Power Query to get the CSV file and do the lookup in Power Query using Merge Tables.

Mynda

sp_AnswersTopicAnswer
Answers Post
Avatar
Robert Green
Member
Members
Level 0
Forum Posts: 25
Member Since:
November 9, 2020
sp_UserOfflineSmall Offline
3
January 2, 2022 - 12:07 am
sp_Permalink sp_Print

Thank you, Mynda. I'll give that a try.

All best wishes to you, Philip and your great team.

Avatar
Mynda Treacy
Admin
Level 10
Forum Posts: 4614
Member Since:
July 16, 2010
sp_UserOfflineSmall Offline
4
January 2, 2022 - 11:26 am
sp_Permalink sp_Print

Thanks, Robert! And you to 🙂

Avatar
Robert Green
Member
Members
Level 0
Forum Posts: 25
Member Since:
November 9, 2020
sp_UserOfflineSmall Offline
5
January 12, 2022 - 4:35 am
sp_Permalink sp_Print

Just to confirm that answer regarding the 29 million rows worked a treat. Thanks again.

Avatar
Mynda Treacy
Admin
Level 10
Forum Posts: 4614
Member Since:
July 16, 2010
sp_UserOfflineSmall Offline
6
January 12, 2022 - 9:46 am
sp_Permalink sp_Print

Great to hear! Thanks for letting us know.

sp_Feed
Go to top
Forum Timezone: Australia/Brisbane
Most Users Ever Online: 245
Currently Online: Philip Treacy
Guest(s) 9
Currently Browsing this Page:
1 Guest(s)
Top Posters:
SunnyKow: 1432
Anders Sehlstedt: 880
Purfleet: 414
Frans Visser: 346
David_Ng: 306
lea cohen: 237
Jessica Stewart: 219
A.Maurizio: 213
Aye Mu: 201
jaryszek: 183
Newest Members:
Ashley Hughes
Herbie Key
Trevor Pindling
Stevan Kanjo
Erin Sheldon
Nikita Bhatia
Sheilah Taylor
Clare Webber
David Jenssen
Dominic Brosnahan
Forum Stats:
Groups: 3
Forums: 24
Topics: 6526
Posts: 28576

 

Member Stats:
Guest Posters: 49
Members: 32810
Moderators: 2
Admins: 4
Administrators: Mynda Treacy, Philip Treacy, Catalin Bombea, FT
Moderators: Velouria, Riny van Eekelen