• Skip to main content
  • Skip to header right navigation
  • Skip to site footer

My Online Training Hub

Learn Dashboards, Excel, Power BI, Power Query, Power Pivot

  • Courses
  • Pricing
    • Free Courses
    • Power BI Course
    • Excel Power Query Course
    • Power Pivot and DAX Course
    • Excel Dashboard Course
    • Excel PivotTable Course – Quick Start
    • Advanced Excel Formulas Course
    • Excel Expert Advanced Excel Training
    • Excel Tables Course
    • Excel, Word, Outlook
    • Financial Modelling Course
    • Excel PivotTable Course
    • Excel for Customer Service Professionals
    • Excel for Operations Management Course
    • Excel for Decision Making Under Uncertainty Course
    • Excel for Finance Course
    • Excel Analysis ToolPak Course
    • Multi-User Pricing
  • Resources
    • Free Downloads
    • Excel Functions Explained
    • Excel Formulas
    • Excel Add-ins
    • IF Function
      • Excel IF Statement Explained
      • Excel IF AND OR Functions
      • IF Formula Builder
    • Time & Dates in Excel
      • Excel Date & Time
      • Calculating Time in Excel
      • Excel Time Calculation Tricks
      • Excel Date and Time Formatting
    • Excel Keyboard Shortcuts
    • Excel Custom Number Format Guide
    • Pivot Tables Guide
    • VLOOKUP Guide
    • ALT Codes
    • Excel VBA & Macros
    • Excel User Forms
    • VBA String Functions
  • Members
    • Login
  • Blog
  • Excel Webinars
  • Excel Forum
    • Register as Forum Member
  • Login

Refresh Power query (again :(|Power Query|Excel Forum|My Online Training Hub

You are here: Home / Refresh Power query (again :(|Power Query|Excel Forum|My Online Training Hub
Avatar
sp_LogInOut Log In sp_Registration Register
sp_Search Search
Advanced Search|Last Search Results
Search
Forum Scope




Match



Forum Options



Minimum search word length is 3 characters - maximum search word length is 84 characters
sp_Search Search
sp_RankInfo
Lost password?
sp_CrumbsHome HomeExcel ForumPower QueryRefresh Power query (again :(
sp_PrintTopic sp_TopicIcon
Refresh Power query (again :(
Avatar
andrea Decandia

New Member
Members
Level 0
Forum Posts: 1
Member Since:
May 28, 2020
sp_UserOfflineSmall Offline
1
May 28, 2020 - 6:51 pm
sp_Permalink sp_Print

Hello,

 

although I am aware it is quite a common issue, I hope you can help me. I have read many posts about this topic, and applied many different approaches, but unsuccessfully.

I have a power query that retrieves the data from around 35 different excel file, each with the same identical table, and I conbine them one below the other.

I can easily see the data in the power query editor mode, and after have filtered the rows with no values, I am ready to refresh the proper excel. However it takes so long and it is really inefficient. Below, the advanced editor code . Hope you can have some smart advice ( I already tried with table.buffer in place of source, unflag "allow data preview to download in the background)

 

Thanks! You can save my life!

...

 

Source = Folder.Files("C:\Users\Hqdecand\Desktop\lease\Roll-forward files 2020"),
#"Filtered Hidden Files1" = Table.SelectRows(Source, each [Attributes]?[Hidden]? <> true),
#"Invoke Custom Function1" = Table.AddColumn(#"Filtered Hidden Files1", "Transform File from Lessee", each #"Transform File from Lessee"([Content])),
#"Renamed Columns1" = Table.RenameColumns(#"Invoke Custom Function1", {"Name", "Source.Name"}),
#"Removed Other Columns1" = Table.SelectColumns(#"Renamed Columns1", {"Source.Name", "Transform File from Lessee"}),
#"Expanded Transform File from Lessee1" = Table.ExpandTableColumn(#"Removed Other Columns1", "Transform File from Lessee", {"Region", "Country", "HFM Entity code", "Entity legal name", and many more columns name )
#"Filtered Rows" = Table.SelectRows(#"Expanded Transform File from Lessee1", each ([Currency] <> null)),
#"Changed Type" = Table.TransformColumnTypes(#"Filtered Rows",{{"Source.Name", type text}, {"Region", type text}, {"Country", type text}, {"HFM Entity code", type text}, {"Entity legal name", type text}, and many more columns name, the same as above})
in
#"Changed Type"

Avatar
Catalin Bombea
Iasi, Romania
Admin
Level 10
Forum Posts: 1845
Member Since:
November 8, 2013
sp_UserOfflineSmall Offline
2
May 29, 2020 - 12:00 am
sp_Permalink sp_Print

Hi Andrea,
I'm not seeing Table.Buffer anywhere.
There is another function: #"Invoke Custom Function1", can you provide the query code for that?

The code looks like the automatic code build using PQ Combiner. This is usually not flexible, many values are hard typed in code. Check this topic, will see there a different way of doing things, without the default file combiner. The functions will combine all files/sheets from a folder, no matter what structure they have.

If you can upload a sample source file, will help you with a new query structure, hopefully more efficient.

sp_Feed
Go to top
Forum Timezone: Australia/Brisbane
Most Users Ever Online: 245
Currently Online: Peter Venkatrao, Lakisha Hall
Guest(s) 9
Currently Browsing this Page:
1 Guest(s)
Top Posters:
SunnyKow: 1432
Anders Sehlstedt: 880
Purfleet: 414
Frans Visser: 346
David_Ng: 306
lea cohen: 237
Jessica Stewart: 219
A.Maurizio: 213
Aye Mu: 201
Hans Hallebeek: 185
Newest Members:
thong nguyen
Appiagyei Kofi Frimpong
Hilary Burchfield
Richie Wright
Adel Kock
Barbara Murray
Doug Milne
Siobhan Stringer
Rob Rooth
Tom Lewis
Forum Stats:
Groups: 3
Forums: 24
Topics: 6542
Posts: 28643

 

Member Stats:
Guest Posters: 49
Members: 32830
Moderators: 2
Admins: 4
Administrators: Mynda Treacy, Philip Treacy, Catalin Bombea, FT
Moderators: Velouria, Riny van Eekelen
© Simple:Press —sp_Information

Sidebar

Blog Categories

  • Excel
  • Excel Charts
  • Excel Dashboard
  • Excel Formulas
  • Excel Office Scripts
  • Excel PivotTables
  • Excel Shortcuts
  • Excel VBA
  • General Tips
  • Online Training
  • Outlook
  • Power Apps
  • Power Automate
  • Power BI
  • Power Pivot
  • Power Query
microsoft mvp logo
trustpilot excellent rating
Secured by Sucuri Badge
MyOnlineTrainingHub on YouTube Mynda Treacy on Linked In Mynda Treacy on Instagram Mynda Treacy on Twitter Mynda Treacy on Pinterest MyOnlineTrainingHub on Facebook

Sign up to our newsletter and join over 400,000
others who learn Excel and Power BI with us.

 

Company

  • About My Online Training Hub
  • Disclosure Statement
  • Frequently Asked Questions
  • Guarantee
  • Privacy Policy
  • Terms & Conditions
  • Testimonials
  • Become an Affiliate
  • Sponsor Our Newsletter

Support

  • Contact
  • Forum
  • Helpdesk - For Technical Issues

Copyright © 2023 · My Online Training Hub · All Rights Reserved. Microsoft and the Microsoft Office logo are trademarks or registered trademarks of Microsoft Corporation in the United States and/or other countries. Product names, logos, brands, and other trademarks featured or referred to within this website are the property of their respective trademark holders.