• Skip to main content
  • Skip to header right navigation
  • Skip to site footer

My Online Training Hub

Learn Dashboards, Excel, Power BI, Power Query, Power Pivot

  • Courses
  • Pricing
    • Free Courses
    • Power BI Course
    • Excel Power Query Course
    • Power Pivot and DAX Course
    • Excel Dashboard Course
    • Excel PivotTable Course – Quick Start
    • Advanced Excel Formulas Course
    • Excel Expert Advanced Excel Training
    • Excel Tables Course
    • Excel, Word, Outlook
    • Financial Modelling Course
    • Excel PivotTable Course
    • Excel for Customer Service Professionals
    • Excel for Operations Management Course
    • Excel for Decision Making Under Uncertainty Course
    • Excel for Finance Course
    • Excel Analysis ToolPak Course
    • Multi-User Pricing
  • Resources
    • Free Downloads
    • Excel Functions Explained
    • Excel Formulas
    • Excel Add-ins
    • IF Function
      • Excel IF Statement Explained
      • Excel IF AND OR Functions
      • IF Formula Builder
    • Time & Dates in Excel
      • Excel Date & Time
      • Calculating Time in Excel
      • Excel Time Calculation Tricks
      • Excel Date and Time Formatting
    • Excel Keyboard Shortcuts
    • Excel Custom Number Format Guide
    • Pivot Tables Guide
    • VLOOKUP Guide
    • ALT Codes
    • Excel VBA & Macros
    • Excel User Forms
    • VBA String Functions
  • Members
    • Login
  • Blog
  • Excel Webinars
  • Excel Forum
    • Register as Forum Member

Import Multi Xlsm files From Folder Into One PowerPivot, but the count of some files is double the original File.|Power Query|Excel Forum|My Online Training Hub

You are here: Home / Import Multi Xlsm files From Folder Into One PowerPivot, but the count of some files is double the original File.|Power Query|Excel Forum|My Online Training Hub

vba course banner

Avatar
sp_LogInOut Log In sp_Registration Register
sp_Search Search
Advanced Search|Last Search Results
Search
Forum Scope




Match



Forum Options



Minimum search word length is 3 characters - maximum search word length is 84 characters
sp_Search Search
sp_RankInfo
Lost password?
sp_CrumbsHome HomeExcel ForumPower QueryImport Multi Xlsm files From Folder…
sp_PrintTopic sp_TopicIcon
Import Multi Xlsm files From Folder Into One PowerPivot, but the count of some files is double the original File.
Avatar
Nawaf H H AlTaher
Riyadh, Saudi Arabia
Member
Members
Level 0
Forum Posts: 18
Member Since:
June 24, 2020
sp_UserOfflineSmall Offline
1
September 25, 2020 - 1:46 am
sp_Permalink sp_Print sp_EditHistory

Hello friends, Hope all is Well & Safe! Please bear with me & please help me because I am losing my mind.

I am (via PowerQuery) combining Xlsm files, but the count of rows of some files that appears on PowerPivot are double the number of rows of the original file, why the # of rows of some are matching the row count, and others not.

Let me please give you the steps that I am taking.

  1. IT Provides me with CSV files, e.g. LA Jan-20 (8,000 rows), LA Feb-20 (3,000 rows), LA Mar-20 (5,000 rows), LA Apr-20 (2,000 rows).
  2. I save each workbook as Xlsm, and place all the workbooks in one folder (Proc DB).
  3. Apply the steps of Power Query: Import Multiple Excel Files From Folder Into One Data Model 
  4. Run a PowerPivot based on the data model, and count the rows based on the combing of PowerQuery.
  5. PowerPivot gives these counts: LA Jan-20 (8,000 rows), LA Feb-20 (6,000 rows), LA Mar-20 (5,000 rows), LA Apr-20 (2,000 rows
  6. You can see that Feb-20 is showing double the row count; should've been 3,000, but instead got 6,000.
    Why the counting was identical with some of the original workbooks, and not with the others? Please remember every file and its contents are unique, i.e. doesn't have duplications (City Month-Year).

Your kind Help is truly appreciated & needed to fix this headache.

All the Best,

sp_AnswersTopicSeeAnswer See Answer
Avatar
Mynda Treacy
Admin
Level 10
Forum Posts: 4524
Member Since:
July 16, 2010
sp_UserOfflineSmall Offline
2
September 25, 2020 - 8:28 am
sp_Permalink sp_Print

Hi Nawaf,

First, I'm not sure why you would re-save each workbook as a .xlsm file when Power Query can get the data from the original CSV files IT provide you with.

The only way Power Query would duplicate data is if it's being referenced again. Is the file containing the query also saved in the same folder as the .xlsm files you're getting? If so, that'll be why it's duplicating the data. Move the Excel file containing the query to another folder.

BTW, I also have a tutorial on how to get files from a folder with Power Query 😉 

Mynda

sp_AnswersTopicAnswer
Answers Post
Avatar
Nawaf H H AlTaher
Riyadh, Saudi Arabia
Member
Members
Level 0
Forum Posts: 18
Member Since:
June 24, 2020
sp_UserOfflineSmall Offline
3
September 27, 2020 - 8:37 pm
sp_Permalink sp_Print

Thank you Mynda! Always Awesome! 

First, I'm not sure why you would re-save each workbook as a .xlsm file when Power Query can get the data from the original CSV files IT provide you with.

Reply: Because CSVs consume too much space.

 

Is the file containing the query also saved in the same folder as the .xlsm files you're getting?

Reply: No, ma'am it is not.

 

BTW, I also have a tutorial on how to get files from a folder with Power Query  

Reply: Will follow your instructions instead and see the outcome. Thank you very much!

Avatar
Mynda Treacy
Admin
Level 10
Forum Posts: 4524
Member Since:
July 16, 2010
sp_UserOfflineSmall Offline
4
September 28, 2020 - 2:06 pm
sp_Permalink sp_Print

Are you sure the .xlsm versions of the .csv files are smaller? Usually it's the other way around i.e. Excel files are bigger than csv files.

sp_Feed
Go to top
Forum Timezone: Australia/Brisbane
Most Users Ever Online: 245
Currently Online: Alan Sidman, Sherry Fox
Guest(s) 9
Currently Browsing this Page:
1 Guest(s)
Top Posters:
SunnyKow: 1432
Anders Sehlstedt: 873
Purfleet: 414
Frans Visser: 346
David_Ng: 306
lea cohen: 222
Jessica Stewart: 218
A.Maurizio: 202
Aye Mu: 201
jaryszek: 183
Newest Members:
Blair Gallagher
Brandi Taylor
Hafiz Ihsan Qadir
Gontran Bage
adolfo casanova
Annestine Johnpulle
Priscila Campbell
Jeff Mikles
Aaron Butler
Maurice Petterlin
Forum Stats:
Groups: 3
Forums: 24
Topics: 6369
Posts: 27852

 

Member Stats:
Guest Posters: 49
Members: 32359
Moderators: 3
Admins: 4
Administrators: Mynda Treacy, Philip Treacy, Catalin Bombea, FT
Moderators: MOTH Support, Velouria, Riny van Eekelen
© Simple:Press —sp_Information

Sidebar

Blog Categories

  • Excel
  • Excel Charts
  • Excel Dashboard
  • Excel Formulas
  • Excel PivotTables
  • Excel Shortcuts
  • Excel VBA
  • General Tips
  • Online Training
  • Outlook
  • Power Apps
  • Power Automate
  • Power BI
  • Power Pivot
  • Power Query
microsoft mvp logo
trustpilot excellent rating
Secured by Sucuri Badge
MyOnlineTrainingHub on YouTube Mynda Treacy on Linked In Mynda Treacy on Instagram Mynda Treacy on Twitter Mynda Treacy on Pinterest MyOnlineTrainingHub on Facebook
 

Company

  • About My Online Training Hub
  • Disclosure Statement
  • Frequently Asked Questions
  • Guarantee
  • Privacy Policy
  • Terms & Conditions
  • Testimonials
  • Become an Affiliate

Support

  • Contact
  • Forum
  • Helpdesk - For Technical Issues

Copyright © 2023 · My Online Training Hub · All Rights Reserved. Microsoft and the Microsoft Office logo are trademarks or registered trademarks of Microsoft Corporation in the United States and/or other countries. Product names, logos, brands, and other trademarks featured or referred to within this website are the property of their respective trademark holders.