• Skip to main content
  • Skip to header right navigation
  • Skip to site footer

My Online Training Hub

Learn Dashboards, Excel, Power BI, Power Query, Power Pivot

  • Courses
  • Pricing
    • Free Courses
    • Power BI Course
    • Excel Power Query Course
    • Power Pivot and DAX Course
    • Excel Dashboard Course
    • Excel PivotTable Course – Quick Start
    • Advanced Excel Formulas Course
    • Excel Expert Advanced Excel Training
    • Excel Tables Course
    • Excel, Word, Outlook
    • Financial Modelling Course
    • Excel PivotTable Course
    • Excel for Customer Service Professionals
    • Excel for Operations Management Course
    • Excel for Decision Making Under Uncertainty Course
    • Excel for Finance Course
    • Excel Analysis ToolPak Course
    • Multi-User Pricing
  • Resources
    • Free Downloads
    • Excel Functions Explained
    • Excel Formulas
    • Excel Add-ins
    • IF Function
      • Excel IF Statement Explained
      • Excel IF AND OR Functions
      • IF Formula Builder
    • Time & Dates in Excel
      • Excel Date & Time
      • Calculating Time in Excel
      • Excel Time Calculation Tricks
      • Excel Date and Time Formatting
    • Excel Keyboard Shortcuts
    • Excel Custom Number Format Guide
    • Pivot Tables Guide
    • VLOOKUP Guide
    • ALT Codes
    • Excel VBA & Macros
    • Excel User Forms
    • VBA String Functions
  • Members
    • Login
    • Password Reset
  • Blog
  • Excel Webinars
  • Excel Forum
    • Register as Forum Member

Power Query doubles my data when appending|Power Query|Excel Forum|My Online Training Hub

You are here: Home / Power Query doubles my data when appending|Power Query|Excel Forum|My Online Training Hub
Avatar
sp_LogInOut Log In sp_Registration Register
sp_Search Search
Advanced Search|Last Search Results
Search
Forum Scope




Match



Forum Options



Minimum search word length is 3 characters - maximum search word length is 84 characters
sp_Search Search
sp_RankInfo
Lost password?
sp_CrumbsHome HomeExcel ForumPower QueryPower Query doubles my data when ap…
sp_PrintTopic sp_TopicIcon
Power Query doubles my data when appending
Avatar
Cmoon13

New Member
Members
Level 0
Forum Posts: 1
Member Since:
June 24, 2016
sp_UserOfflineSmall Offline
1
October 28, 2017 - 1:26 am
sp_Permalink sp_Print

I have an Excel file with 20+tabs that contain the same workbook for different accounts.  I have created named tables for each account and loaded in PQ via "from table" creating connections only.  When I append the data to load into one query all my data is duplicated.  How can I avoid this? I will be revising these tables often, and can manually delete the duplicates from the query, however know I must be doing something wrong.  Any suggestions appreciated!

Avatar
Catalin Bombea
Iasi, Romania
Admin
Level 10
Forum Posts: 1807
Member Since:
November 8, 2013
sp_UserOfflineSmall Offline
2
October 28, 2017 - 2:33 pm
sp_Permalink sp_Print

Hi,

Can you share your query?

Avatar
Mynda Treacy
Admin
Level 10
Forum Posts: 4447
Member Since:
July 16, 2010
sp_UserOfflineSmall Offline
3
October 30, 2017 - 8:20 pm
sp_Permalink sp_Print

Hi,

It sounds like your final query is included in the append?

Mynda

Avatar
Rita Kiss
Member
Members
Level 0
Forum Posts: 10
Member Since:
February 18, 2015
sp_UserOfflineSmall Offline
4
November 1, 2017 - 12:01 am
sp_Permalink sp_Print

If you have multiple sheets and multiple named tables, it might happen that you add the data twice - once from the table and once from the sheet.

Avatar
Dorothy Paladan

Active Member
Members
Level 0
Forum Posts: 3
Member Since:
November 10, 2018
sp_UserOfflineSmall Offline
5
November 10, 2018 - 11:18 am
sp_Permalink sp_Print sp_EditHistory

I have almost the same problem.

I append 2 files that contain only 1 sheet. but the values doubled after I appended. Anyone have an idea on this?

Avatar
Anders Sehlstedt
Eskilstuna, Sweden

VIP
Members


Trusted Members
Level 3
Forum Posts: 870
Member Since:
December 7, 2016
sp_UserOfflineSmall Offline
6
November 11, 2018 - 1:30 am
sp_Permalink sp_Print

Hi Dorothy,

It is always easier to give help if there is a file attached, so we can see the data.
You don't have to have the real data in, just some sample data is good enough to visualize the problem.

My experience with appending data and you get doubles, it is because there are two or more exact data rows from the different sources.

But if this is the case for you or not is hard to tell without a file to check.

Br,
Anders

Avatar
Mynda Treacy
Admin
Level 10
Forum Posts: 4447
Member Since:
July 16, 2010
sp_UserOfflineSmall Offline
7
November 12, 2018 - 9:15 am
sp_Permalink sp_Print

Hi Dorothy,

I suspect the query is getting data from all tables/sheets in the files. You're probably then loading your query into a sheet/table in the same file, it's then getting loaded into Power Query again. This is usually the culprit. If that's not it, please share your file or queries so we can take a closer look.

In future, please start a new thread with your question and sample file.

Thanks,

Mynda

Avatar
Dorothy Paladan

Active Member
Members
Level 0
Forum Posts: 3
Member Since:
November 10, 2018
sp_UserOfflineSmall Offline
8
December 10, 2018 - 6:25 pm
sp_Permalink sp_Print

Hi Mynda,

I think you're right. How can I fix this if both files are being loaded? I just need the appended one.

Thanks,

Dorothy

Avatar
Mynda Treacy
Admin
Level 10
Forum Posts: 4447
Member Since:
July 16, 2010
sp_UserOfflineSmall Offline
9
December 11, 2018 - 10:00 pm
sp_Permalink sp_Print

Hi Dorothy,

Edit the query and after the 'Source' step and add a filter that excludes the name of your query table. Just select the Source step, then apply a filter. It will ask you if you want to insert a step.

I usually try to name my query table something distinctly different to the names of my source data table for this very reason.

Mynda

Avatar
Dorothy Paladan

Active Member
Members
Level 0
Forum Posts: 3
Member Since:
November 10, 2018
sp_UserOfflineSmall Offline
10
December 17, 2018 - 9:30 pm
sp_Permalink sp_Print

Hi everyone, I tried every advise you said but still it doesn't work. What I did as workaround was remove the append of the two files then hit load. That seem worked.

sp_Feed
Go to top
Forum Timezone: Australia/Brisbane
Most Users Ever Online: 245
Currently Online: Velouria, David Eva
Guest(s) 11
Currently Browsing this Page:
1 Guest(s)
Top Posters:
SunnyKow: 1432
Anders Sehlstedt: 870
Purfleet: 412
Frans Visser: 346
David_Ng: 306
lea cohen: 219
A.Maurizio: 202
Jessica Stewart: 202
Aye Mu: 201
jaryszek: 183
Newest Members:
Hayden Hao
Angela chen
Sean Moore
John Chisholm
vexokeb sdfg
John Jack
Malcolm Toy
Ray-Yu Yang
George Shihadeh
Naomi Rumble
Forum Stats:
Groups: 3
Forums: 24
Topics: 6211
Posts: 27238

 

Member Stats:
Guest Posters: 49
Members: 31891
Moderators: 3
Admins: 4
Administrators: Mynda Treacy, Philip Treacy, Catalin Bombea, FT
Moderators: MOTH Support, Velouria, Riny van Eekelen
© Simple:Press —sp_Information

Sidebar

Blog Categories

  • Excel
  • Excel Charts
  • Excel Dashboard
  • Excel Formulas
  • Excel PivotTables
  • Excel Shortcuts
  • Excel VBA
  • General Tips
  • Online Training
  • Outlook
  • Power Apps
  • Power Automate
  • Power BI
  • Power Pivot
  • Power Query
microsoft mvp logo
trustpilot excellent rating
Secured by Sucuri Badge
MyOnlineTrainingHub on YouTube Mynda Treacy on Linked In Mynda Treacy on Instagram Mynda Treacy on Twitter Mynda Treacy on Pinterest MyOnlineTrainingHub on Facebook
 

Company

  • About My Online Training Hub
  • Disclosure Statement
  • Frequently Asked Questions
  • Guarantee
  • Privacy Policy
  • Terms & Conditions
  • Testimonials
  • Become an Affiliate

Support

  • Contact
  • Forum
  • Helpdesk - For Technical Issues

Copyright © 2023 · My Online Training Hub · All Rights Reserved. Microsoft and the Microsoft Office logo are trademarks or registered trademarks of Microsoft Corporation in the United States and/or other countries. Product names, logos, brands, and other trademarks featured or referred to within this website are the property of their respective trademark holders.