• Skip to main content
  • Skip to header right navigation
  • Skip to site footer

My Online Training Hub

Learn Dashboards, Excel, Power BI, Power Query, Power Pivot

  • Courses
  • Pricing
    • Free Courses
    • Power BI Course
    • Excel Power Query Course
    • Power Pivot and DAX Course
    • Excel Dashboard Course
    • Excel PivotTable Course – Quick Start
    • Advanced Excel Formulas Course
    • Excel Expert Advanced Excel Training
    • Excel Tables Course
    • Excel, Word, Outlook
    • Financial Modelling Course
    • Excel PivotTable Course
    • Excel for Customer Service Professionals
    • Excel for Operations Management Course
    • Excel for Decision Making Under Uncertainty Course
    • Excel for Finance Course
    • Excel Analysis ToolPak Course
    • Multi-User Pricing
  • Resources
    • Free Downloads
    • Excel Functions Explained
    • Excel Formulas
    • Excel Add-ins
    • IF Function
      • Excel IF Statement Explained
      • Excel IF AND OR Functions
      • IF Formula Builder
    • Time & Dates in Excel
      • Excel Date & Time
      • Calculating Time in Excel
      • Excel Time Calculation Tricks
      • Excel Date and Time Formatting
    • Excel Keyboard Shortcuts
    • Excel Custom Number Format Guide
    • Pivot Tables Guide
    • VLOOKUP Guide
    • ALT Codes
    • Excel VBA & Macros
    • Excel User Forms
    • VBA String Functions
  • Members
    • Login
    • Password Reset
  • Blog
  • Excel Webinars
  • Excel Forum
    • Register as Forum Member

How do I progressively eliminate redundant data|General Excel Questions & Answers|Excel Forum|My Online Training Hub

You are here: Home / How do I progressively eliminate redundant data|General Excel Questions & Answers|Excel Forum|My Online Training Hub
Avatar
sp_LogInOut Log In sp_Registration Register
sp_Search Search
Advanced Search|Last Search Results
Search
Forum Scope




Match



Forum Options



Minimum search word length is 3 characters - maximum search word length is 84 characters
sp_Search Search
sp_RankInfo
Lost password?
sp_CrumbsHome HomeExcel ForumGeneral Excel Questions & Answe…How do I progressively eliminate re…
sp_PrintTopic sp_TopicIcon
How do I progressively eliminate redundant data
Avatar
MJAO

New Member
Members

Dashboards
Level 0
Forum Posts: 2
Member Since:
February 4, 2020
sp_UserOfflineSmall Offline
1
February 15, 2020 - 5:43 am
sp_Permalink sp_Print sp_EditHistory

Hi!

I am working with about 400k rows of data, each with an individual identity. Tracking jobs.

I have divided the 400k rows into separate tabs based on project IDs.

Every week, some jobs will be completed, and I will need to display what has been completed and what remains outstanding.

So I will receive new data of only what remains outstanding.

How do integrate the new data to show what has been completed, and what is remaining?

Thanks.

sp_AnswersTopicSeeAnswer See Answer
Avatar
Mynda Treacy
Admin
Level 10
Forum Posts: 4449
Member Since:
July 16, 2010
sp_UserOfflineSmall Offline
2
February 15, 2020 - 9:32 pm
sp_Permalink sp_Print

Hi and welcome to our forum!

First of all, you should put all the data back into one tab as this is the way Excel was intended to be used and will make your life much easier because the tools like PivotTables and functions are designed to work with data in a tabular format. You can always split it out into separate tabs later with PivotTables as explained here.

You can use Power Query to compare the data in different tables (this week vs last week etc.) and then extract just those records that are still active. You'll need to decide how you identify such records, as I can't tell from what you've described. Presumably there is a date or other field that marks a project as completed. 

I hope that points you in the right direction.

Mynda

sp_AnswersTopicAnswer
Answers Post
Avatar
MJAO

New Member
Members

Dashboards
Level 0
Forum Posts: 2
Member Since:
February 4, 2020
sp_UserOfflineSmall Offline
3
February 19, 2020 - 12:18 pm
sp_Permalink sp_Print sp_EditHistory

Hi Mynda

Thank you for your prompt response. Now, I have a problem, the power query editor does not give me the option to close and load to, only to close and load. Here is a screenshot. i am not sure how to work around this.

I have office 365

Avatar
Mynda Treacy
Admin
Level 10
Forum Posts: 4449
Member Since:
July 16, 2010
sp_UserOfflineSmall Offline
4
February 19, 2020 - 9:38 pm
sp_Permalink sp_Print

Allow it to Close & Load, then in the Queries pane on the right of the Excel Workbook, right-click the query > Load to. Here you can change the load settings.

Kind regards,

Mynda

sp_Feed
Go to top
Forum Timezone: Australia/Brisbane
Most Users Ever Online: 245
Currently Online: SALLY, Valentyn Kristioglo, Tiffany Kang
Guest(s) 10
Currently Browsing this Page:
1 Guest(s)
Top Posters:
SunnyKow: 1432
Anders Sehlstedt: 871
Purfleet: 412
Frans Visser: 346
David_Ng: 306
lea cohen: 219
Jessica Stewart: 205
A.Maurizio: 202
Aye Mu: 201
jaryszek: 183
Newest Members:
Bruce Tang Nian
Scot C
Othman AL MUTAIRI
Misael Gutierrez Sr.
Attif Ihsan
Kieran Fee
Murat Hasanoglu
Brett Dryland
Saeed Aldousari
Bhuwan Devkota
Forum Stats:
Groups: 3
Forums: 24
Topics: 6223
Posts: 27294

 

Member Stats:
Guest Posters: 49
Members: 31919
Moderators: 3
Admins: 4
Administrators: Mynda Treacy, Philip Treacy, Catalin Bombea, FT
Moderators: MOTH Support, Velouria, Riny van Eekelen
© Simple:Press —sp_Information

Sidebar

Blog Categories

  • Excel
  • Excel Charts
  • Excel Dashboard
  • Excel Formulas
  • Excel PivotTables
  • Excel Shortcuts
  • Excel VBA
  • General Tips
  • Online Training
  • Outlook
  • Power Apps
  • Power Automate
  • Power BI
  • Power Pivot
  • Power Query
microsoft mvp logo
trustpilot excellent rating
Secured by Sucuri Badge
MyOnlineTrainingHub on YouTube Mynda Treacy on Linked In Mynda Treacy on Instagram Mynda Treacy on Twitter Mynda Treacy on Pinterest MyOnlineTrainingHub on Facebook
 

Company

  • About My Online Training Hub
  • Disclosure Statement
  • Frequently Asked Questions
  • Guarantee
  • Privacy Policy
  • Terms & Conditions
  • Testimonials
  • Become an Affiliate

Support

  • Contact
  • Forum
  • Helpdesk - For Technical Issues

Copyright © 2023 · My Online Training Hub · All Rights Reserved. Microsoft and the Microsoft Office logo are trademarks or registered trademarks of Microsoft Corporation in the United States and/or other countries. Product names, logos, brands, and other trademarks featured or referred to within this website are the property of their respective trademark holders.