Forum

only fetch "new" da...
 
Notifications
Clear all

only fetch "new" data (since the previous fetch)

2 Posts
2 Users
0 Reactions
318 Views
(@peterwarburton)
Posts: 17
Eminent Member
Topic starter
 

Hi,

The databases I access are cumulative and contain an ever increasing number of records. They never change after being entered. 

My PowerBI queries download the whole database every time I refresh, when what I would really like is to download only the "new" records since my previous refresh, based on a date/time stamp in each record or simply recording the date/time of the previous refresh. Does anyone know a way to achieve this for sequel databases, excel worksheets etc?

In the same vein of saving download time and filesize, the sequel databases contain many more fields (columns) than I need. Is there a way to request only the fields I need?

I have searched this forum and cannot find any info on this subject.

 

Thanks in advance,

 

Peter

 
Posted : 01/10/2022 9:36 am
(@mynda)
Posts: 4761
Member Admin
 

Hi Peter,

You can use Incremental Refresh.

Mynda

 
Posted : 01/10/2022 6:38 pm
Share: