hi reza, thanks for the content. i got confused at one point. you said import mode isnt very useful for incremental refresh. you also mentioned datasource should have queryfolding which means you need to set that table as hybrid table because directquery dont have incremental refresh. and if we dont have premium workspace or user we cant use hybrid tables as well which makes incremental refresh isnt very useful unless you have premium workspace or premium user. am i missing something? could you help me out?
Dear All, It is said that while using Filters on 'Order date' with 'between' you need to use "is after or equal to" And "is before", to avoid duplicates, is it right or wrong? please suggest. Thanks in advance!! ❤
I have a fact table with start_year (2020) and end_year(2023) parameters in it to limit the number of years worth of data. On top of this I have incremental refresh of last 13 months. I publish this file to web service and change the start_year parameter say from 2020 to 2019. Why does the parameter changes in web service doesn't take into effect? If I change from 2020 to 2021, it does make necessary changes but for the first time only after publishing the file. Any thought on this? My report should only hold only last 5 years of data with last 13 months of incremental refresh.
Thank you for this video. I have a question. I've been triying to do the first load (1 billion rows) from hive throut odbc connector, but is taking too long and I'm getting a 5 hours timeout on pbi service. Do you have any suggestions for this kind of problem? The first load is too painful. Thanks!
I would like to hear how you ended up addressing this issue. For this type of reason, we moved away from Data Flows. Any time we needed to make a change, it took half a day to get it refreshed. I also don't understand why the performance is so slow. In this day and age, partitioning 1 billion rows shouldn't be such a huge undertaking.
Question: I have data that utilizes 4 SQL sources to create the final Table. Each one of those SQL sources has a Date column and the data for each of the 4 SQL sources go back years and years. I only want the past 3 years total and only want the past two days updated. Here's the question. Do I need to apply the 'RangeStart' and 'RangeEnd' to all 4 SQL sources or just the last Table that is Loaded?
Knowing that I need to set up parameters was KEY!! Thank you so much!!!
One of the best explanation, I came through on incremental refresh.
Live demo would be great, I mean modifying the database records and see how it impact the report. Anyway good explanation.
Thank you for the video. What I did not get properly is the setting of RangeStart and RangeEnd. What do I set here? The newest data I want to keep?
Do we have any latest updates like to download the existing dataset having incremental refresh from power BI service to override
hi reza, thanks for the content. i got confused at one point. you said import mode isnt very useful for incremental refresh. you also mentioned datasource should have queryfolding which means you need to set that table as hybrid table because directquery dont have incremental refresh. and if we dont have premium workspace or user we cant use hybrid tables as well which makes incremental refresh isnt very useful unless you have premium workspace or premium user. am i missing something? could you help me out?
Is there a way if we want to update the archive data can we refresh all the dataset ( archive + incremental)?
Dear All, It is said that while using Filters on 'Order date' with 'between' you need to use "is after or equal to" And "is before", to avoid duplicates, is it right or wrong? please suggest. Thanks in advance!! ❤
Hi. yes. Better to remove equal from on end (either from or to), so that it won't double count it.
@@RADACAD thanks a lot!!
Hybrid tables support time intelligence function? Or does it come with direct query disadvantages
I have a fact table with start_year (2020) and end_year(2023) parameters in it to limit the number of years worth of data. On top of this I have incremental refresh of last 13 months. I publish this file to web service and change the start_year parameter say from 2020 to 2019. Why does the parameter changes in web service doesn't take into effect? If I change from 2020 to 2021, it does make necessary changes but for the first time only after publishing the file. Any thought on this? My report should only hold only last 5 years of data with last 13 months of incremental refresh.
Thank you for this video. I have a question.
I've been triying to do the first load (1 billion rows) from hive throut odbc connector, but is taking too long and I'm getting a 5 hours timeout on pbi service.
Do you have any suggestions for this kind of problem? The first load is too painful.
Thanks!
I would like to hear how you ended up addressing this issue. For this type of reason, we moved away from Data Flows. Any time we needed to make a change, it took half a day to get it refreshed. I also don't understand why the performance is so slow. In this day and age, partitioning 1 billion rows shouldn't be such a huge undertaking.
Question: I have data that utilizes 4 SQL sources to create the final Table. Each one of those SQL sources has a Date column and the data for each of the 4 SQL sources go back years and years.
I only want the past 3 years total and only want the past two days updated.
Here's the question. Do I need to apply the 'RangeStart' and 'RangeEnd' to all 4 SQL sources or just the last Table that is Loaded?